python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30005 --dashboard_places=sevran --rootfolder_sla=/data_4/data_log/job/memo/sevran -v --mtr_id=1042 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30005, Date : 2025-11 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Inconsistency in dashboard_places dashboard_places from input : sevran dashboard_name_from_port found from datou STS from crontab from raspi : Sevran We force the correct camera_place_name ! TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 94 month : 11 mtr_id : 1042 dashboard_places : Sevran date : 2025-11 year : 2025 raspi : 30005 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'Sevran' and date like '%2025-11%') and created_at like '%2025-11%'))); nb_day : (5, 30) after unwanted_material_data nb_day : (5, 30) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30005%' AND ms.result_str like '%2025/11%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 19, 'nb_images_finished': 1006, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1006, 'last_update': '2025/11/23', 'portfolio_id': 28802263, 'last_run_id': 2639132, 'total_number_of_photos': 7040}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 52, 'nb_images_finished': 2089, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2089, 'last_update': '2025/11/23', 'portfolio_id': 28762589, 'last_run_id': 2637094, 'total_number_of_photos': 6886}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1465, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 577, 'nb_selected_images': 2042, 'last_update': '2025/11/23', 'portfolio_id': 28729200, 'last_run_id': 2629008, 'total_number_of_photos': 6971}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2335, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2335, 'last_update': '2025/11/21', 'portfolio_id': 28683437, 'last_run_id': 2622846, 'total_number_of_photos': 7627}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1627, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1627, 'last_update': '2025/11/20', 'portfolio_id': 28631123, 'last_run_id': 2616210, 'total_number_of_photos': 7048}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2337, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2337, 'last_update': '2025/11/19', 'portfolio_id': 28585668, 'last_run_id': 2607247, 'total_number_of_photos': 6625}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 1978, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 111, 'nb_selected_images': 2089, 'last_update': '2025/11/22', 'portfolio_id': 28762589, 'last_run_id': 2635884, 'total_number_of_photos': 6886}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1465, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 577, 'nb_selected_images': 2042, 'last_update': '2025/11/22', 'portfolio_id': 28729200, 'last_run_id': 2629008, 'total_number_of_photos': 6971}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2335, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2335, 'last_update': '2025/11/21', 'portfolio_id': 28683437, 'last_run_id': 2622846, 'total_number_of_photos': 7627}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1627, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1627, 'last_update': '2025/11/20', 'portfolio_id': 28631123, 'last_run_id': 2616210, 'total_number_of_photos': 7048}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2337, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2337, 'last_update': '2025/11/19', 'portfolio_id': 28585668, 'last_run_id': 2607247, 'total_number_of_photos': 6625}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1465, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 577, 'nb_selected_images': 2042, 'last_update': '2025/11/21', 'portfolio_id': 28729200, 'last_run_id': 2629008, 'total_number_of_photos': 6971}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2335, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2335, 'last_update': '2025/11/21', 'portfolio_id': 28683437, 'last_run_id': 2622846, 'total_number_of_photos': 7627}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1627, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1627, 'last_update': '2025/11/20', 'portfolio_id': 28631123, 'last_run_id': 2616210, 'total_number_of_photos': 7048}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2337, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2337, 'last_update': '2025/11/19', 'portfolio_id': 28585668, 'last_run_id': 2607247, 'total_number_of_photos': 6625}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1627, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1627, 'last_update': '2025/11/19', 'portfolio_id': 28631123, 'last_run_id': 2615152, 'total_number_of_photos': 7048}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2337, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2337, 'last_update': '2025/11/19', 'portfolio_id': 28585668, 'last_run_id': 2607247, 'total_number_of_photos': 6625}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/15', 'portfolio_id': 28471900, 'last_run_id': 2586863, 'total_number_of_photos': 5515}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2337, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2337, 'last_update': '2025/11/18', 'portfolio_id': 28585668, 'last_run_id': 2607247, 'total_number_of_photos': 6625}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/15', 'portfolio_id': 28471900, 'last_run_id': 2586863, 'total_number_of_photos': 5515}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7970}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/15', 'portfolio_id': 28471900, 'last_run_id': 2586863, 'total_number_of_photos': 5515}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7970}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6088}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 47, 'nb_images_finished': 2453, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2453, 'last_update': '2025/11/16', 'portfolio_id': 28552775, 'last_run_id': 2598459, 'total_number_of_photos': 7167}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/15', 'portfolio_id': 28471900, 'last_run_id': 2586863, 'total_number_of_photos': 5515}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7970}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6088}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 49, 'nb_images_finished': 1625, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1625, 'last_update': '2025/11/15', 'portfolio_id': 28503878, 'last_run_id': 2594387, 'total_number_of_photos': 6694}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/15', 'portfolio_id': 28471900, 'last_run_id': 2586863, 'total_number_of_photos': 5515}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7012}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7970}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6088}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 7000}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 1740, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1740, 'last_update': '2025/11/14', 'portfolio_id': 28471900, 'last_run_id': 2586199, 'total_number_of_photos': 5512}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7008}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7958}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6077}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1870, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1870, 'last_update': '2025/11/13', 'portfolio_id': 28437303, 'last_run_id': 2580200, 'total_number_of_photos': 7008}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7958}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6077}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/09', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 41, 'nb_images_finished': 2264, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2264, 'last_update': '2025/11/12', 'portfolio_id': 28415138, 'last_run_id': 2572766, 'total_number_of_photos': 7958}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6077}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/09', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/10', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 32, 'nb_images_finished': 2283, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2283, 'last_update': '2025/11/11', 'portfolio_id': 28369575, 'last_run_id': 2565553, 'total_number_of_photos': 6077}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/09', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/10', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/10', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/09', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/10', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/10', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/10', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1558, 'last_update': '2025/11/09', 'portfolio_id': 28335772, 'last_run_id': 2554236, 'total_number_of_photos': 6993}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/09', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/09', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/09', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/09', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/08', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 34, 'nb_images_finished': 893, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 13, 'nb_images_started': 989, 'nb_selected_images': 1882, 'last_update': '2025/11/08', 'portfolio_id': 28281493, 'last_run_id': 2549196, 'total_number_of_photos': 5713}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/07', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/08', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/08', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/07', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/03', 'portfolio_id': 28049188, 'last_run_id': 2507945, 'total_number_of_photos': 2609}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 1660, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 310, 'nb_selected_images': 1970, 'last_update': '2025/11/07', 'portfolio_id': 28235377, 'last_run_id': 2539472, 'total_number_of_photos': 6624}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/06', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/07', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/04', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/03', 'portfolio_id': 28049188, 'last_run_id': 2507945, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 1300, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 15, 'nb_images_started': 797, 'nb_selected_images': 2097, 'last_update': '2025/11/06', 'portfolio_id': 28185479, 'last_run_id': 2530629, 'total_number_of_photos': 7610}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/05', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/04', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/03', 'portfolio_id': 28049188, 'last_run_id': 2507945, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 33, 'nb_images_finished': 1211, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1318, 'nb_selected_images': 2529, 'last_update': '2025/11/05', 'portfolio_id': 28123387, 'last_run_id': 2521542, 'total_number_of_photos': 7414}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 182, 'nb_selected_images': 301, 'last_update': '2025/11/04', 'portfolio_id': 28076890, 'last_run_id': 2514843, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/03', 'portfolio_id': 28049188, 'last_run_id': 2507945, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 8, 'nb_images_finished': 119, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 180, 'nb_selected_images': 299, 'last_update': '2025/11/04', 'portfolio_id': 28076890, 'last_run_id': 2512027, 'total_number_of_photos': 6485}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/03', 'portfolio_id': 28049188, 'last_run_id': 2507945, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/02', 'portfolio_id': 28049188, 'last_run_id': 2502049, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 0, 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/11/02', 'portfolio_id': 28049188, 'last_run_id': 2502049, 'total_number_of_photos': 2609}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-11-22 00:00:00 Found day : 2025-11-21 00:00:00 Found day : 2025-11-20 00:00:00 Found day : 2025-11-19 00:00:00 Found day : 2025-11-18 00:00:00 Found day : 2025-11-17 00:00:00 Found day : 2025-11-15 00:00:00 Found day : 2025-11-14 00:00:00 Found day : 2025-11-13 00:00:00 Found day : 2025-11-12 00:00:00 Found day : 2025-11-11 00:00:00 Found day : 2025-11-10 00:00:00 Found day : 2025-11-08 00:00:00 Found day : 2025-11-07 00:00:00 Found day : 2025-11-06 00:00:00 Found day : 2025-11-05 00:00:00 Found day : 2025-11-04 00:00:00 Found day : 2025-11-03 00:00:00 Found day : 2025-11-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-11-24 00:00:00,2025-11-25 00:00:00,2025-11-26 00:00:00,2025-11-27 00:00:00,2025-11-28 00:00:00,2025-11-29 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______refus' and ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pcnc' and ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______film_pedb' and ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______jrm' and ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______pet_clair' and ded.dashboard_place_id = 94 and month(ded.date) = 11 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 94 and mp.name like '%112025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-11-01 : dt_date_just_month_year : 2025-11-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "Sevran" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-11-01" AND ded.date <= "2025-11-30" apple3 {'emr': {'mat': 'emr', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'pcm': {'mat': 'pcm', 'pht': 4209, 'datou_carac_id': 3994, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'pcnc': {'mat': 'pcnc', 'pht': 4207, 'datou_carac_id': 3993, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'carton,background'}, 'jrm': {'mat': 'jrm', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier,background'}, 'ela': {'mat': 'ela', 'pht': 4203, 'datou_carac_id': 3991, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'ela,background'}, 'pet_clair': {'mat': 'pet_clair', 'pht': 3327, 'datou_carac_id': 3804, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_clair,bouchon,etiquette,barquette_avec_film,background'}, 'film_pedb': {'mat': 'film_pedb', 'pht': 4461, 'datou_carac_id': 4322, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'film_plastique'}, 'pehd_pp': {'mat': 'pehd_pp', 'pht': 4211, 'datou_carac_id': 3995, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pehd,background'}, 'flux_dev': {'mat': 'flux_dev', 'pht': 4200, 'datou_carac_id': 4153, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'pet_fonce,background'}, 'aluminium': {'mat': 'aluminium', 'pht': 4205, 'datou_carac_id': 3992, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'metal,background'}, 'refus': {'mat': 'refus', 'pht': 3594, 'datou_carac_id': 3318, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus,background'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (2507945,2508055,2514843,2521542,2530629,2539472,2549196,2554236,2557401,2565553,2572766,2580200,2586863,2594387,2598459,2599614,2607247,2616210,2622846,2629008,2637094,2639244) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (4207,4209,4207,3726,4203,3327,4461,4211,4200,4205,3594) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.008550660849840378, 'nb_photo': 4, 'list_port_cont': '28540474', 'assoc_port': '28540307:28540474', 'assoc_mat': '28540307:autre:3327:28540474'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013393891209683222, 'nb_photo': 267, 'list_port_cont': '28089862,28146655,28150563,28156756,28180291,28186429,28195380,28195893,28208080,28218833,28221547,28223990,28256398,28266213,28268667,28272173,28275371,28298716,28299388,28318610,28319475,28320449,28322771,28325745,28353026,28353522,28353855,28353949,28354633,28355245,28356789,28381419,28395829,28396199,28404050,28407704,28416315,28427271,28429017,28429178,28431202,28431774,28431905,28445031,28448034,28457906,28463148,28463281,28463343,28464078,28466775,28472096,28484852,28485259,28485521,28495695,28496197,28496556,28497009,28540477,28540758,28541486,28542515,28543348,28543772,28546024,28565452,28565827,28566250,28571778,28574962,28575593,28597531,28598170,28599116,28606285,28612981,28614016,28616100,28616709,28622350,28623064,28650875,28657645,28658413,28661072,28667019,28677951,28686013,28699916,28700404,28701239,28703030,28707265,28708616,28742902,28743943,28759212,28765506,28765701,28768302,28790487,28799760,28800653,28801037,28813585,28817348', 'assoc_port': '28089596:28089862,28146548:28146655,28150110:28150563,28156462:28156756,28180176:28186429,28180200:28180291,28195056:28195893,28195059:28195380,28204164:28208080,28218602:28218833,28220920:28221547,28220943:28223990,28254382:28256398,28265444:28266213,28268516:28268667,28271938:28272173,28275226:28275371,28298577:28299388,28298580:28298716,28317467:28320449,28317536:28318610,28318849:28319475,28318855:28322771,28325353:28325745,28352791:28353949,28352794:28353855,28352797:28353026,28353420:28353522,28354585:28354633,28355212:28355245,28356749:28356789,28381336:28381419,28395537:28396199,28395540:28395829,28403692:28404050,28406458:28407704,28415993:28416315,28427141:28427271,28428916:28429178,28428919:28429017,28429804:28431202,28431664:28431905,28431669:28431774,28442120:28445031,28447946:28448034,28457119:28457906,28463061:28466775,28463063:28464078,28463064:28463343,28463065:28463281,28463067:28463148,28472052:28472096,28484569:28485259,28484571:28484852,28485361:28485521,28495449:28497009,28495453:2849655', 'assoc_mat': '28089596:autre:3594:28089862,28146548:autre:3594:28146655,28150110:autre:3594:28150563,28156462:autre:3594:28156756,28180176:autre:3594:28186429,28180200:autre:3594:28180291,28195056:autre:3594:28195893,28195059:autre:3594:28195380,28204164:autre:3594:28208080,28218602:autre:3594:28218833,28220920:autre:3594:28221547,28220943:autre:3594:28223990,28254382:autre:3594:28256398,28265444:autre:3594:28266213,28268516:autre:3594:28268667,28271938:autre:3594:28272173,28275226:autre:3594:28275371,28298577:autre:3594:28299388,28298580:autre:3594:28298716,28317467:autre:3594:28320449,28317536:autre:3594:28318610,28318849:autre:3594:28319475,28318855:autre:3594:28322771,28325353:autre:3594:28325745,28352791:autre:3594:28353949,28352794:autre:3594:28353855,28352797:autre:3594:28353026,28353420:autre:3594:28353522,28354585:autre:3594:28354633,28355212:autre:3594:28355245,28356749:autre:3594:28356789,28381336:autre:3594:28381419,28395537:autre:3594:28396199,28395540:autre:3594:28395829,28403692:autre:3594:28404050,28406458:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.009417491015240835, 'nb_photo': 1, 'list_port_cont': '28150224', 'assoc_port': '28150125:28150224', 'assoc_mat': '28150125:autre_refus:3726:28150224'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004456384039622031, 'nb_photo': 15, 'list_port_cont': '28156650,28388697,28406630,28462791,28497863,28542264,28574922,28706828,28752414,28759189,28789138,28798838,28799409', 'assoc_port': '28156465:28156650,28388421:28388697,28406456:28406630,28462656:28462791,28497674:28497863,28541862:28542264,28574866:28574922,28700517:28706828,28743771:28752414,28759072:28759189,28789023:28789138,28798432:28799409,28798464:28798838', 'assoc_mat': '28156465:barquette_opaque:4461:28156650,28388421:barquette_opaque:4461:28388697,28406456:barquette_opaque:4461:28406630,28462656:barquette_opaque:4461:28462791,28497674:barquette_opaque:4461:28497863,28541862:barquette_opaque:4461:28542264,28574866:barquette_opaque:4461:28574922,28700517:barquette_opaque:4461:28706828,28743771:barquette_opaque:4461:28752414,28759072:barquette_opaque:4461:28759189,28789023:barquette_opaque:4461:28789138,28798432:barquette_opaque:4461:28799409,28798464:barquette_opaque:4461:28798838'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010174151471107626, 'nb_photo': 2353, 'list_port_cont': '28089207,28090069,28090230,28090498,28148156,28153567,28156684,28157056,28170227,28181232,28181350,28181415,28181454,28181499,28186738,28187515,28195146,28204227,28221203,28224849,28225848,28227776,28228210,28238373,28238388,28238405,28250155,28254939,28258014,28259323,28259589,28261882,28265575,28266528,28266576,28266942,28269024,28274013,28283736,28283816,28288472,28288674,28288776,28290827,28292301,28298694,28298794,28299135,28301029,28301693,28304221,28305954,28307587,28317921,28318140,28327721,28327902,28328320,28328461,28328564,28329660,28330827,28332040,28335162,28336082,28336998,28337811,28338276,28339000,28339129,28342771,28343013,28344643,28345034,28345232,28347321,28347375,28347416,28347428,28347466,28347563,28350130,28350315,28352365,28352802,28352823,28352918,28353011,28353051,28353164,28353461,28353645,28354058,28354113,28354155,28354202,28355397,28356527,28356833,28356927,28357060,28357743,28358770,28359575,28359640,28359711,28360100,28360415,28360581,28360817,28361830,28362172,28362347,2836373', 'assoc_port': '28088708:28089207,28089590:28090230,28089593:28090498,28089595:28090069,28089597:28170227,28146550:28288472,28146552:28288674,28146554:28288776,28146562:28148156,28148277:28157056,28148280:28301693,28148282:28298694,28148283:28299135,28148308:28298794,28150094:28307587,28150096:28336998,28150112:28332040,28153517:28153567,28153518:28339000,28154448:28330827,28156460:28328564,28156464:28156684,28163832:28338276,28180156:28181499,28180177:28181415,28180178:28181454,28180199:28181350,28180201:28181232,28180202:28186738,28180207:28327721,28186185:28327902,28187382:28187515,28187383:28335162,28195055:28347321,28195057:28345034,28195058:28344643,28195060:28195146,28204165:28204227,28204166:28342771,28204168:28343013,28207350:28345232,28211945:28347375,28211946:28347563,28220916:28347416,28220918:28347428,28220922:28347466,28220931:28221203,28224647:28224849,28225682:28228210,28225691:28227776,28225702:28225848,28238295:28238405,28238297:28238373,28238299:28238388,28249999:28350130,28250000:28350315,28250001:2825015', 'assoc_mat': '28088708:barquette_opaque:4207:28089207,28089590:barquette_opaque:4207:28090230,28089593:barquette_opaque:4207:28090498,28089595:barquette_opaque:4207:28090069,28089597:barquette_opaque:4207:28170227,28146550:barquette_opaque:4207:28288472,28146552:barquette_opaque:4207:28288674,28146554:barquette_opaque:4207:28288776,28146562:barquette_opaque:4207:28148156,28148277:barquette_opaque:4207:28157056,28148280:barquette_opaque:4207:28301693,28148282:barquette_opaque:4207:28298694,28148283:barquette_opaque:4207:28299135,28148308:barquette_opaque:4207:28298794,28150094:barquette_opaque:4207:28307587,28150096:barquette_opaque:4207:28336998,28150112:barquette_opaque:4207:28332040,28153517:barquette_opaque:4207:28153567,28153518:barquette_opaque:4207:28339000,28154448:barquette_opaque:4207:28330827,28156460:barquette_opaque:4207:28328564,28156464:barquette_opaque:4207:28156684,28163832:barquette_opaque:4207:28338276,28180156:barquette_opaque:4207:28181499,28180177:barquette_opaque:4207:28181415,28180178:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004701025151634024, 'nb_photo': 138, 'list_port_cont': '28146794,28156577,28156649,28180453,28180532,28180983,28204448,28218814,28219179,28227720,28259517,28310038,28316210,28316951,28325708,28325957,28352853,28353474,28357778,28358644,28359552,28388710,28388784,28389048,28406641,28428668,28431733,28432405,28432435,28449360,28451363,28462790,28462819,28467800,28482300,28484719,28485419,28488746,28488906,28497857,28506817,28540527,28540648,28542268,28563722,28569589,28574429,28574913,28575529,28597353,28606009,28622353,28664797,28712993,28716032,28722544,28724935,28752409,28759194,28759238,28766911,28767620,28770205,28798716,28798832,28799422,28806890,28813649,28817317,28817426', 'assoc_port': '28146551:28146794,28156465:28156649,28156468:28156577,28180167:28180983,28180198:28180532,28180203:28180453,28204167:28204448,28218590:28227720,28218599:28219179,28218604:28218814,28259206:28259517,28268244:28316951,28271935:28316210,28304080:28310038,28325355:28325957,28325358:28325708,28352798:28352853,28353422:28353474,28357716:28357778,28358578:28358644,28359466:28359552,28388414:28389048,28388417:28388784,28388421:28388710,28406456:28406641,28428627:28428668,28431663:28431733,28432326:28432435,28432328:28432405,28449243:28449360,28451135:28451363,28462655:28462819,28462656:28462790,28467747:28467800,28482033:28482300,28484570:28484719,28485365:28485419,28488525:28488906,28488540:28488746,28497674:28497857,28506597:28506817,28540290:28540648,28540296:28540527,28541862:28542268,28563677:28563722,28569479:28569589,28574249:28574429,28574866:28574913,28575473:28575529,28596984:28597353,28605912:28606009,28622102:28622353,28657585:28664797,28712823:28712993,28715840:28716032,28722253:28724935,28722255:2872254', 'assoc_mat': '28146551:carton:4461:28146794,28156465:carton:4461:28156649,28156468:carton:4461:28156577,28180167:carton:4461:28180983,28180198:carton:4461:28180532,28180203:carton:4461:28180453,28204167:carton:4461:28204448,28218590:carton:4461:28227720,28218599:carton:4461:28219179,28218604:carton:4461:28218814,28259206:carton:4461:28259517,28268244:carton:4461:28316951,28271935:carton:4461:28316210,28304080:carton:4461:28310038,28325355:carton:4461:28325957,28325358:carton:4461:28325708,28352798:carton:4461:28352853,28353422:carton:4461:28353474,28357716:carton:4461:28357778,28358578:carton:4461:28358644,28359466:carton:4461:28359552,28388414:carton:4461:28389048,28388417:carton:4461:28388784,28388421:carton:4461:28388710,28406456:carton:4461:28406641,28428627:carton:4461:28428668,28431663:carton:4461:28431733,28432326:carton:4461:28432435,28432328:carton:4461:28432405,28449243:carton:4461:28449360,28451135:carton:4461:28451363,28462655:carton:4461:28462819,28462656:carton:4461:28462790,28467747:carton:4461:28467800,2848'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9840725431178392, 'nb_photo': 4187, 'list_port_cont': '28089193,28148165,28153556,28157048,28170222,28180238,28180792,28181224,28181356,28181402,28181456,28181493,28186739,28187514,28195145,28204234,28218961,28221199,28224856,28225837,28225860,28227767,28228213,28238385,28238409,28250157,28254940,28258018,28259328,28259599,28261888,28266536,28266569,28269034,28274022,28283743,28283823,28288679,28288786,28292315,28298690,28298783,28299136,28301552,28301689,28304224,28305947,28307586,28318142,28318431,28327729,28327907,28328463,28328563,28329659,28330825,28332041,28335155,28336996,28337803,28338278,28338988,28339132,28342762,28343004,28345233,28345856,28347328,28347380,28347437,28347459,28347472,28347566,28350128,28350326,28352359,28352829,28353006,28353048,28353168,28353468,28354027,28354112,28354154,28354209,28355306,28355393,28356520,28356820,28356827,28357058,28357744,28358773,28359574,28359714,28360085,28360419,28360580,28360815,28361838,28362052,28362175,28363744,28364018,28364040,28364097,28364108,28383011,28383189,28386591,28388823,28389020,28389337,2838936', 'assoc_port': '28088708:28089193,28089597:28170222,28146552:28288679,28146554:28288786,28146562:28148165,28148277:28157048,28148279:28301552,28148280:28301689,28148282:28298690,28148283:28299136,28148308:28298783,28150094:28307586,28150096:28336996,28150112:28332041,28153517:28153556,28153518:28338988,28154448:28330825,28156460:28328563,28163832:28338278,28180156:28181493,28180177:28181402,28180178:28181456,28180199:28181356,28180201:28181224,28180202:28186739,28180204:28180238,28180206:28180792,28180207:28327729,28186185:28327907,28187382:28187514,28187383:28335155,28195055:28347328,28195060:28195145,28204165:28204234,28204166:28342762,28204168:28343004,28207348:28345856,28207350:28345233,28211945:28347380,28211946:28347566,28218601:28218961,28220918:28347437,28220919:28347459,28220922:28347472,28220931:28221199,28224647:28224856,28225682:28228213,28225691:28227767,28225702:28225860,28225703:28225837,28238295:28238409,28238299:28238385,28249999:28350128,28250000:28350326,28250001:28250157,28254380:28254940,28257885:2825801', 'assoc_mat': '28088708:carton:4207:28089193,28089597:carton:4207:28170222,28146552:carton:4207:28288679,28146554:carton:4207:28288786,28146562:carton:4207:28148165,28148277:carton:4207:28157048,28148279:carton:4207:28301552,28148280:carton:4207:28301689,28148282:carton:4207:28298690,28148283:carton:4207:28299136,28148308:carton:4207:28298783,28150094:carton:4207:28307586,28150096:carton:4207:28336996,28150112:carton:4207:28332041,28153517:carton:4207:28153556,28153518:carton:4207:28338988,28154448:carton:4207:28330825,28156460:carton:4207:28328563,28163832:carton:4207:28338278,28180156:carton:4207:28181493,28180177:carton:4207:28181402,28180178:carton:4207:28181456,28180199:carton:4207:28181356,28180201:carton:4207:28181224,28180202:carton:4207:28186739,28180204:carton:4207:28180238,28180206:carton:4207:28180792,28180207:carton:4207:28327729,28186185:carton:4207:28327907,28187382:carton:4207:28187514,28187383:carton:4207:28335155,28195055:carton:4207:28347328,28195060:carton:4207:28195145,28204165:carton:4207:28204234,2820'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.09886390900474963, 'nb_photo': 2, 'list_port_cont': '28540464', 'assoc_port': '28540307:28540464', 'assoc_mat': '28540307:carton:3327:28540464'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.006474484896525085, 'nb_photo': 560, 'list_port_cont': '28089861,28090154,28150559,28156757,28180298,28186427,28195377,28195887,28208086,28221545,28223997,28255354,28256397,28266212,28267522,28268354,28268666,28272171,28275369,28298719,28299076,28299386,28304459,28318232,28318603,28319939,28320447,28321011,28322775,28325753,28353316,28353524,28353857,28353958,28354638,28355246,28356785,28381416,28395830,28396192,28407142,28407702,28416313,28427270,28428003,28429182,28431203,28431773,28432445,28445032,28448039,28457326,28457907,28463146,28463273,28463336,28464080,28466022,28466777,28472104,28484844,28485262,28485526,28496196,28496548,28497008,28497806,28519235,28540475,28540763,28540834,28541485,28542113,28542518,28543115,28543763,28545332,28546029,28563829,28565457,28565836,28566244,28571774,28572346,28574966,28575600,28597918,28598165,28599115,28606085,28606287,28612978,28614015,28616094,28616710,28622344,28622779,28623075,28624932,28650873,28657647,28658405,28661074,28667016,28677949,28682404,28686004,28699914,28700396,28700942,28703025,28703918,28706551,2870726', 'assoc_port': '28089594:28090154,28089596:28089861,28150110:28150559,28156462:28156757,28180176:28186427,28180200:28180298,28195056:28195887,28195059:28195377,28204164:28208086,28220920:28221545,28220943:28223997,28254378:28255354,28254382:28256397,28265444:28266212,28265455:28267522,28268247:28268354,28268516:28268666,28271938:28272171,28275226:28275369,28298577:28299386,28298579:28299076,28298580:28298719,28304078:28304459,28317465:28321011,28317467:28320447,28317509:28319939,28317536:28318603,28317550:28318232,28318855:28322775,28325353:28325753,28352790:28353316,28352791:28353958,28352794:28353857,28353420:28353524,28354585:28354638,28355212:28355246,28356749:28356785,28381336:28381416,28395537:28396192,28395540:28395830,28406458:28407702,28406460:28407142,28415993:28416313,28427141:28427270,28427879:28428003,28428916:28429182,28429804:28431203,28431669:28431773,28432327:28432445,28442120:28445032,28447946:28448039,28457119:28457907,28457120:28457326,28463061:28466777,28463062:28466022,28463063:28464080,28463064:2846333', 'assoc_mat': '28089594:carton:3594:28090154,28089596:carton:3594:28089861,28150110:carton:3594:28150559,28156462:carton:3594:28156757,28180176:carton:3594:28186427,28180200:carton:3594:28180298,28195056:carton:3594:28195887,28195059:carton:3594:28195377,28204164:carton:3594:28208086,28220920:carton:3594:28221545,28220943:carton:3594:28223997,28254378:carton:3594:28255354,28254382:carton:3594:28256397,28265444:carton:3594:28266212,28265455:carton:3594:28267522,28268247:carton:3594:28268354,28268516:carton:3594:28268666,28271938:carton:3594:28272171,28275226:carton:3594:28275369,28298577:carton:3594:28299386,28298579:carton:3594:28299076,28298580:carton:3594:28298719,28304078:carton:3594:28304459,28317465:carton:3594:28321011,28317467:carton:3594:28320447,28317509:carton:3594:28319939,28317536:carton:3594:28318603,28317550:carton:3594:28318232,28318855:carton:3594:28322775,28325353:carton:3594:28325753,28352790:carton:3594:28353316,28352791:carton:3594:28353958,28352794:carton:3594:28353857,28353420:carton:3594:28353524,2835'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.1537737284090292, 'nb_photo': 4, 'list_port_cont': '28150231,28447988', 'assoc_port': '28150125:28150231,28447947:28447988', 'assoc_mat': '28150125:Carton_brun:3726:28150231,28447947:Carton_brun:3726:28447988'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00035354251354998366, 'nb_photo': 1, 'list_port_cont': '28432407', 'assoc_port': '28432328:28432407', 'assoc_mat': '28432328:etiquette:4461:28432407'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00026263290500634016, 'nb_photo': 939, 'list_port_cont': '28090227,28153561,28157059,28180791,28181405,28181450,28181489,28187517,28204230,28224847,28225842,28225858,28227778,28228215,28238376,28238415,28250143,28258022,28259593,28261931,28266527,28266578,28266940,28269036,28283738,28288678,28288788,28299133,28301024,28301541,28318439,28327718,28328561,28330829,28332042,28335160,28337004,28337810,28339128,28342773,28345237,28347318,28347381,28347468,28352800,28352827,28353010,28353167,28353463,28354016,28354111,28354162,28354208,28355303,28355384,28356523,28356829,28357055,28357739,28358774,28359572,28359713,28360098,28360420,28361828,28362166,28363738,28364029,28364035,28364092,28383184,28388812,28389327,28389376,28395576,28397014,28405049,28410537,28414102,28424646,28425911,28427149,28427180,28428763,28431797,28432374,28432842,28433719,28433736,28448300,28449470,28452435,28458609,28462882,28463079,28467793,28468188,28470006,28470154,28470717,28472062,28482211,28485447,28497703,28497753,28504609,28505330,28505983,28506402,28506927,28525767,28540613,28540743,2854282', 'assoc_port': '28089590:28090227,28146552:28288678,28146554:28288788,28148277:28157059,28148279:28301541,28148283:28299133,28150096:28337004,28150112:28332042,28153517:28153561,28154448:28330829,28156460:28328561,28180156:28181489,28180177:28181405,28180178:28181450,28180206:28180791,28180207:28327718,28187382:28187517,28187383:28335160,28195055:28347318,28204165:28204230,28204166:28342773,28207350:28345237,28211945:28347381,28220922:28347468,28224647:28224847,28225682:28228215,28225691:28227778,28225702:28225858,28225703:28225842,28238295:28238415,28238299:28238376,28250001:28250143,28257885:28258022,28259203:28259593,28261836:28261931,28266489:28266940,28266490:28266578,28266491:28266527,28268245:28354016,28268494:28354111,28268495:28354162,28268496:28354208,28268498:28269036,28283585:28283738,28298578:28359713,28299784:28360098,28299811:28301024,28304075:28360420,28317456:28361828,28317487:28318439,28318847:28362166,28325348:28356523,28325351:28337810,28339120:28339128,28352787:28353167,28352789:28353010,28352792:2835280', 'assoc_mat': '28089590:etiquette:4207:28090227,28146552:etiquette:4207:28288678,28146554:etiquette:4207:28288788,28148277:etiquette:4207:28157059,28148279:etiquette:4207:28301541,28148283:etiquette:4207:28299133,28150096:etiquette:4207:28337004,28150112:etiquette:4207:28332042,28153517:etiquette:4207:28153561,28154448:etiquette:4207:28330829,28156460:etiquette:4207:28328561,28180156:etiquette:4207:28181489,28180177:etiquette:4207:28181405,28180178:etiquette:4207:28181450,28180206:etiquette:4207:28180791,28180207:etiquette:4207:28327718,28187382:etiquette:4207:28187517,28187383:etiquette:4207:28335160,28195055:etiquette:4207:28347318,28204165:etiquette:4207:28204230,28204166:etiquette:4207:28342773,28207350:etiquette:4207:28345237,28211945:etiquette:4207:28347381,28220922:etiquette:4207:28347468,28224647:etiquette:4207:28224847,28225682:etiquette:4207:28228215,28225691:etiquette:4207:28227778,28225702:etiquette:4207:28225858,28225703:etiquette:4207:28225842,28238295:etiquette:4207:28238415,28238299:etiquette:4207:28238376,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9336741976020435, 'nb_photo': 2087, 'list_port_cont': '28089740,28146788,28148391,28150444,28153699,28153881,28156568,28156654,28166945,28180253,28180446,28180533,28180977,28204455,28207480,28218815,28219178,28219266,28221152,28221307,28227718,28254425,28259345,28259508,28310041,28310510,28316212,28316952,28319035,28325705,28325966,28329050,28352859,28353486,28353557,28357774,28358649,28359499,28359560,28388535,28388600,28388704,28388780,28389043,28406637,28424911,28427209,28428660,28428709,28431730,28432406,28432456,28433671,28448060,28449362,28451362,28462787,28462821,28467801,28482169,28482297,28484715,28485425,28488749,28488911,28489200,28497724,28497822,28497862,28506825,28540364,28540525,28540640,28542001,28542152,28542269,28552808,28563717,28563787,28569590,28570519,28574021,28574434,28574908,28575537,28597188,28597344,28597507,28606005,28606056,28616638,28622356,28624637,28624793,28657664,28657740,28664810,28706261,28706831,28707010,28707137,28707235,28713004,28716037,28722342,28722535,28723787,28724929,28743901,28744175,28752420,28759185,28759225,2876691', 'assoc_port': '28089592:28089740,28146551:28146788,28146555:28166945,28148321:28148391,28150095:28150444,28153519:28153699,28153520:28153881,28156465:28156654,28156468:28156568,28180167:28180977,28180198:28180533,28180203:28180446,28180205:28180253,28204167:28204455,28207346:28207480,28218590:28227718,28218595:28219266,28218599:28219178,28218604:28218815,28220923:28221307,28220924:28221152,28254384:28254425,28259206:28259508,28259208:28259345,28268244:28316952,28271935:28316212,28304076:28310510,28304080:28310041,28318850:28329050,28318852:28319035,28325355:28325966,28325358:28325705,28352798:28352859,28353419:28353557,28353422:28353486,28357716:28357774,28358578:28358649,28359466:28359560,28359467:28359499,28388414:28389043,28388417:28388780,28388421:28388704,28388423:28388600,28388424:28388535,28406456:28406637,28424873:28424911,28427144:28427209,28428626:28428709,28428627:28428660,28431663:28431730,28432326:28432456,28432328:28432406,28433635:28433671,28447944:28448060,28449243:28449362,28451135:28451362,28462655:2846282', 'assoc_mat': '28089592:film_plastique:4461:28089740,28146551:film_plastique:4461:28146788,28146555:film_plastique:4461:28166945,28148321:film_plastique:4461:28148391,28150095:film_plastique:4461:28150444,28153519:film_plastique:4461:28153699,28153520:film_plastique:4461:28153881,28156465:film_plastique:4461:28156654,28156468:film_plastique:4461:28156568,28180167:film_plastique:4461:28180977,28180198:film_plastique:4461:28180533,28180203:film_plastique:4461:28180446,28180205:film_plastique:4461:28180253,28204167:film_plastique:4461:28204455,28207346:film_plastique:4461:28207480,28218590:film_plastique:4461:28227718,28218595:film_plastique:4461:28219266,28218599:film_plastique:4461:28219178,28218604:film_plastique:4461:28218815,28220923:film_plastique:4461:28221307,28220924:film_plastique:4461:28221152,28254384:film_plastique:4461:28254425,28259206:film_plastique:4461:28259508,28259208:film_plastique:4461:28259345,28268244:film_plastique:4461:28316952,28271935:film_plastique:4461:28316212,28304076:film_plastique:4461:2831051'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005058416005910822, 'nb_photo': 13020, 'list_port_cont': '28089196,28090067,28090225,28090484,28148170,28153557,28156687,28157052,28170228,28180234,28180795,28181220,28181353,28181413,28181459,28181486,28186747,28186834,28187519,28195152,28204220,28218963,28221200,28224853,28225833,28225850,28227770,28228005,28228201,28238365,28238378,28238419,28250152,28254934,28258025,28259321,28259590,28261897,28261929,28265572,28266525,28266575,28266936,28269035,28274028,28283733,28283829,28288482,28288684,28288787,28290822,28292308,28298660,28298695,28298779,28299142,28301023,28301543,28301685,28304219,28305956,28307592,28317919,28318145,28318419,28318443,28321255,28327725,28327897,28328315,28328454,28328574,28329661,28330822,28332048,28335149,28336080,28337002,28337805,28338273,28338989,28339126,28342763,28343009,28344632,28345031,28345223,28345864,28347031,28347325,28347385,28347393,28347407,28347429,28347477,28347575,28350131,28350318,28352367,28352804,28352831,28352904,28353009,28353044,28353166,28353469,28353659,28354017,28354056,28354119,28354163,28354198,28355297,2835538', 'assoc_port': '28088708:28089196,28089590:28090225,28089593:28090484,28089595:28090067,28089597:28170228,28146550:28288482,28146552:28288684,28146554:28288787,28146562:28148170,28148277:28157052,28148279:28301543,28148280:28301685,28148282:28298695,28148283:28299142,28148308:28298779,28150094:28307592,28150096:28337002,28150112:28332048,28153517:28153557,28153518:28338989,28154448:28330822,28156460:28328574,28156464:28156687,28156466:28321255,28163832:28338273,28180156:28181486,28180177:28181413,28180178:28181459,28180197:28186834,28180199:28181353,28180201:28181220,28180202:28186747,28180204:28180234,28180206:28180795,28180207:28327725,28186185:28327897,28187382:28187519,28187383:28335149,28195055:28347325,28195057:28345031,28195058:28344632,28195060:28195152,28204165:28204220,28204166:28342763,28204168:28343009,28207348:28345864,28207350:28345223,28211945:28347385,28211946:28347575,28211948:28347393,28218598:28347031,28218601:28218963,28220916:28347407,28220918:28347429,28220922:28347477,28220931:28221200,28224647:2822485', 'assoc_mat': '28088708:film_plastique:4207:28089196,28089590:film_plastique:4207:28090225,28089593:film_plastique:4207:28090484,28089595:film_plastique:4207:28090067,28089597:film_plastique:4207:28170228,28146550:film_plastique:4207:28288482,28146552:film_plastique:4207:28288684,28146554:film_plastique:4207:28288787,28146562:film_plastique:4207:28148170,28148277:film_plastique:4207:28157052,28148279:film_plastique:4207:28301543,28148280:film_plastique:4207:28301685,28148282:film_plastique:4207:28298695,28148283:film_plastique:4207:28299142,28148308:film_plastique:4207:28298779,28150094:film_plastique:4207:28307592,28150096:film_plastique:4207:28337002,28150112:film_plastique:4207:28332048,28153517:film_plastique:4207:28153557,28153518:film_plastique:4207:28338989,28154448:film_plastique:4207:28330822,28156460:film_plastique:4207:28328574,28156464:film_plastique:4207:28156687,28156466:film_plastique:4207:28321255,28163832:film_plastique:4207:28338273,28180156:film_plastique:4207:28181486,28180177:film_plastique:4207:2818141'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0001649748814406841, 'nb_photo': 21, 'list_port_cont': '28259602,28299137,28327720,28353174,28356517,28470162,28472069,28506917,28540738,28542820,28570250,28576719,28605979,28625859,28723495,28768512,28813603', 'assoc_port': '28148283:28299137,28180207:28327720,28259203:28259602,28325348:28356517,28352787:28353174,28469941:28470162,28472051:28472069,28506596:28506917,28540256:28542820,28540302:28540738,28565315:28570250,28576680:28576719,28605914:28605979,28622088:28625859,28723349:28723495,28768492:28768512,28813574:28813603', 'assoc_mat': '28148283:kraft:4207:28299137,28180207:kraft:4207:28327720,28259203:kraft:4207:28259602,28325348:kraft:4207:28356517,28352787:kraft:4207:28353174,28469941:kraft:4207:28470162,28472051:kraft:4207:28472069,28506596:kraft:4207:28506917,28540256:kraft:4207:28542820,28540302:kraft:4207:28540738,28565315:kraft:4207:28570250,28576680:kraft:4207:28576719,28605914:kraft:4207:28605979,28622088:kraft:4207:28625859,28723349:kraft:4207:28723495,28768492:kraft:4207:28768512,28813574:kraft:4207:28813603'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0031611812824809933, 'nb_photo': 731, 'list_port_cont': '28148162,28153562,28157047,28180244,28181230,28181495,28187520,28195153,28218958,28221222,28224834,28225851,28227771,28228214,28238362,28238380,28238414,28258024,28259324,28259594,28266573,28266935,28269025,28274020,28283742,28283827,28288681,28298691,28299130,28301018,28304211,28318448,28327727,28328566,28329657,28330828,28335151,28336079,28336997,28337812,28338994,28339134,28342772,28344633,28345023,28345226,28347319,28347378,28347395,28347417,28347430,28347471,28347576,28352801,28352836,28353001,28353170,28353465,28354025,28355392,28356524,28356812,28356826,28356924,28357048,28357734,28359573,28359634,28359723,28360086,28360577,28361833,28362165,28362352,28363739,28364038,28364096,28382998,28383193,28389027,28389366,28395577,28410534,28414109,28424687,28425885,28425902,28427151,28428770,28429815,28431808,28432363,28432831,28433723,28433737,28448310,28450490,28452438,28452466,28462874,28463077,28467791,28468182,28470013,28470167,28472059,28482225,28484700,28485380,28485451,28497712,28497749,28504610,2850533', 'assoc_port': '28146552:28288681,28146562:28148162,28148277:28157047,28148282:28298691,28148283:28299130,28150096:28336997,28153517:28153562,28153518:28338994,28154448:28330828,28156460:28328566,28180156:28181495,28180201:28181230,28180204:28180244,28180207:28327727,28187382:28187520,28187383:28335151,28195055:28347319,28195057:28345023,28195058:28344633,28195060:28195153,28204166:28342772,28207350:28345226,28211945:28347378,28211946:28347576,28211948:28347395,28218601:28218958,28220916:28347417,28220918:28347430,28220922:28347471,28220931:28221222,28224647:28224834,28225682:28228214,28225691:28227771,28225702:28225851,28238295:28238414,28238297:28238362,28238299:28238380,28257885:28258024,28259203:28259594,28259205:28259324,28266489:28266935,28266490:28266573,28268245:28354025,28268498:28269025,28271939:28274020,28275225:28283827,28283585:28283742,28298576:28359634,28298578:28359723,28299784:28360086,28299811:28301018,28304077:28360577,28304082:28304211,28317456:28361833,28317487:28318448,28318847:28362165,28318851:2836235', 'assoc_mat': '28146552:metal:4207:28288681,28146562:metal:4207:28148162,28148277:metal:4207:28157047,28148282:metal:4207:28298691,28148283:metal:4207:28299130,28150096:metal:4207:28336997,28153517:metal:4207:28153562,28153518:metal:4207:28338994,28154448:metal:4207:28330828,28156460:metal:4207:28328566,28180156:metal:4207:28181495,28180201:metal:4207:28181230,28180204:metal:4207:28180244,28180207:metal:4207:28327727,28187382:metal:4207:28187520,28187383:metal:4207:28335151,28195055:metal:4207:28347319,28195057:metal:4207:28345023,28195058:metal:4207:28344633,28195060:metal:4207:28195153,28204166:metal:4207:28342772,28207350:metal:4207:28345226,28211945:metal:4207:28347378,28211946:metal:4207:28347576,28211948:metal:4207:28347395,28218601:metal:4207:28218958,28220916:metal:4207:28347417,28220918:metal:4207:28347430,28220922:metal:4207:28347471,28220931:metal:4207:28221222,28224647:metal:4207:28224834,28225682:metal:4207:28228214,28225691:metal:4207:28227771,28225702:metal:4207:28225851,28238295:metal:4207:28238414,28238297:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00033458533835039825, 'nb_photo': 108, 'list_port_cont': '28090157,28156755,28195374,28208082,28223995,28255085,28255352,28266220,28304457,28318609,28352417,28353853,28353959,28354629,28381421,28396196,28404058,28427265,28428004,28429180,28448040,28457900,28463271,28463340,28464072,28472105,28484848,28485529,28496199,28519233,28540480,28540754,28542124,28542513,28565829,28571769,28575592,28597533,28599122,28614012,28622349,28650872,28657643,28661070,28677956,28682398,28686008,28700946,28703021,28719564,28720024,28742625,28768305,28791266,28800236,28800648,28817352', 'assoc_port': '28089594:28090157,28156462:28156755,28195059:28195374,28204164:28208082,28220943:28223995,28254378:28255352,28254381:28255085,28265444:28266220,28304078:28304457,28317536:28318609,28348936:28352417,28352791:28353959,28352794:28353853,28354585:28354629,28381336:28381421,28395537:28396196,28403692:28404058,28427141:28427265,28427879:28428004,28428916:28429180,28447946:28448040,28457119:28457900,28463063:28464072,28463064:28463340,28463065:28463271,28472052:28472105,28484571:28484848,28485361:28485529,28495493:28496199,28518833:28519233,28540300:28540754,28540305:28540480,28541868:28542513,28541870:28542124,28565335:28565829,28571215:28571769,28575469:28575592,28596960:28599122,28596986:28597533,28612812:28614012,28622098:28622349,28650767:28650872,28657578:28661070,28657587:28657643,28676890:28682398,28677782:28677956,28685556:28686008,28700487:28700946,28700488:28703021,28718887:28720024,28718888:28719564,28741478:28742625,28766813:28768305,28789008:28791266,28798422:28800648,28798435:28800236,28817312:2881735', 'assoc_mat': '28089594:metal:3594:28090157,28156462:metal:3594:28156755,28195059:metal:3594:28195374,28204164:metal:3594:28208082,28220943:metal:3594:28223995,28254378:metal:3594:28255352,28254381:metal:3594:28255085,28265444:metal:3594:28266220,28304078:metal:3594:28304457,28317536:metal:3594:28318609,28348936:metal:3594:28352417,28352791:metal:3594:28353959,28352794:metal:3594:28353853,28354585:metal:3594:28354629,28381336:metal:3594:28381421,28395537:metal:3594:28396196,28403692:metal:3594:28404058,28427141:metal:3594:28427265,28427879:metal:3594:28428004,28428916:metal:3594:28429180,28447946:metal:3594:28448040,28457119:metal:3594:28457900,28463063:metal:3594:28464072,28463064:metal:3594:28463340,28463065:metal:3594:28463271,28472052:metal:3594:28472105,28484571:metal:3594:28484848,28485361:metal:3594:28485529,28495493:metal:3594:28496199,28518833:metal:3594:28519233,28540300:metal:3594:28540754,28540305:metal:3594:28540480,28541868:metal:3594:28542513,28541870:metal:3594:28542124,28565335:metal:3594:28565829,28571215:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.06847760296521882, 'nb_photo': 6543, 'list_port_cont': '28089736,28146790,28148400,28150438,28153701,28153885,28156565,28156648,28166934,28180255,28180450,28180537,28180982,28204450,28207465,28218822,28219172,28219271,28221151,28221292,28227724,28254419,28259333,28259503,28310042,28310502,28316216,28316954,28319040,28325713,28325958,28329053,28352846,28353475,28353549,28357781,28358647,28359493,28359563,28388536,28388597,28388695,28388779,28389045,28406638,28424922,28427207,28428674,28428712,28431718,28432394,28432450,28433677,28448055,28449350,28451372,28462788,28462829,28467806,28482165,28482301,28484728,28485422,28488757,28488907,28489204,28497719,28497823,28497865,28506820,28540372,28540522,28540644,28541997,28542147,28542266,28552805,28563719,28563782,28569598,28570527,28574024,28574437,28574920,28575538,28597194,28597345,28597503,28605998,28606052,28616637,28622365,28624626,28624779,28657654,28657744,28664807,28706247,28706841,28707006,28707128,28707233,28712995,28716031,28722341,28722542,28723784,28724937,28743903,28744177,28752408,28759190,28759224,2876691', 'assoc_port': '28089592:28089736,28146551:28146790,28146555:28166934,28148321:28148400,28150095:28150438,28153519:28153701,28153520:28153885,28156465:28156648,28156468:28156565,28180167:28180982,28180198:28180537,28180203:28180450,28180205:28180255,28204167:28204450,28207346:28207465,28218590:28227724,28218595:28219271,28218599:28219172,28218604:28218822,28220923:28221292,28220924:28221151,28254384:28254419,28259206:28259503,28259208:28259333,28268244:28316954,28271935:28316216,28304076:28310502,28304080:28310042,28318850:28329053,28318852:28319040,28325355:28325958,28325358:28325713,28352798:28352846,28353419:28353549,28353422:28353475,28357716:28357781,28358578:28358647,28359466:28359563,28359467:28359493,28388414:28389045,28388417:28388779,28388421:28388695,28388423:28388597,28388424:28388536,28406456:28406638,28424873:28424922,28427144:28427207,28428626:28428712,28428627:28428674,28431663:28431718,28432326:28432450,28432328:28432394,28433635:28433677,28447944:28448055,28449243:28449350,28451135:28451372,28462655:2846282', 'assoc_mat': '28089592:papier:4461:28089736,28146551:papier:4461:28146790,28146555:papier:4461:28166934,28148321:papier:4461:28148400,28150095:papier:4461:28150438,28153519:papier:4461:28153701,28153520:papier:4461:28153885,28156465:papier:4461:28156648,28156468:papier:4461:28156565,28180167:papier:4461:28180982,28180198:papier:4461:28180537,28180203:papier:4461:28180450,28180205:papier:4461:28180255,28204167:papier:4461:28204450,28207346:papier:4461:28207465,28218590:papier:4461:28227724,28218595:papier:4461:28219271,28218599:papier:4461:28219172,28218604:papier:4461:28218822,28220923:papier:4461:28221292,28220924:papier:4461:28221151,28254384:papier:4461:28254419,28259206:papier:4461:28259503,28259208:papier:4461:28259333,28268244:papier:4461:28316954,28271935:papier:4461:28316216,28304076:papier:4461:28310502,28304080:papier:4461:28310042,28318850:papier:4461:28329053,28318852:papier:4461:28319040,28325355:papier:4461:28325958,28325358:papier:4461:28325713,28352798:papier:4461:28352846,28353419:papier:4461:28353549,2835'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0065056728183815115, 'nb_photo': 20452, 'list_port_cont': '28089208,28090055,28090221,28090486,28148166,28153552,28156692,28157054,28170218,28180232,28180794,28181219,28181351,28181412,28181457,28181496,28186741,28186819,28187526,28195151,28204233,28218960,28221223,28224850,28225835,28225862,28227766,28227995,28228204,28238375,28238391,28238406,28250150,28254935,28258016,28259326,28259596,28261896,28261934,28265514,28265563,28266529,28266571,28266930,28269031,28274015,28283735,28283824,28288486,28288677,28288778,28290829,28292316,28298665,28298684,28298789,28299131,28301033,28301550,28301687,28304223,28305945,28306309,28307578,28317929,28318144,28318423,28318442,28321254,28327722,28327896,28328313,28328455,28328576,28329667,28330835,28332036,28335147,28336091,28337006,28337806,28338274,28339001,28339133,28342769,28343003,28344646,28345026,28345227,28347019,28347323,28347377,28347396,28347406,28347435,28347449,28347476,28347570,28350134,28350322,28352372,28352807,28352822,28352919,28353000,28353043,28353160,28353458,28353658,28354022,28354057,28354110,28354159,2835420', 'assoc_port': '28088708:28089208,28089590:28090221,28089593:28090486,28089595:28090055,28089597:28170218,28146550:28288486,28146552:28288677,28146554:28288778,28146562:28148166,28148277:28157054,28148279:28301550,28148280:28301687,28148282:28298684,28148283:28299131,28148308:28298789,28150094:28307578,28150096:28337006,28150112:28332036,28153517:28153552,28153518:28339001,28154448:28330835,28156460:28328576,28156464:28156692,28156466:28321254,28163832:28338274,28180156:28181496,28180177:28181412,28180178:28181457,28180197:28186819,28180199:28181351,28180201:28181219,28180202:28186741,28180204:28180232,28180206:28180794,28180207:28327722,28186185:28327896,28187382:28187526,28187383:28335147,28195055:28347323,28195057:28345026,28195058:28344646,28195060:28195151,28204165:28204233,28204166:28342769,28204168:28343003,28207350:28345227,28211945:28347377,28211946:28347570,28211948:28347396,28218598:28347019,28218601:28218960,28220916:28347406,28220918:28347435,28220919:28347449,28220922:28347476,28220931:28221223,28224647:2822485', 'assoc_mat': '28088708:papier:4207:28089208,28089590:papier:4207:28090221,28089593:papier:4207:28090486,28089595:papier:4207:28090055,28089597:papier:4207:28170218,28146550:papier:4207:28288486,28146552:papier:4207:28288677,28146554:papier:4207:28288778,28146562:papier:4207:28148166,28148277:papier:4207:28157054,28148279:papier:4207:28301550,28148280:papier:4207:28301687,28148282:papier:4207:28298684,28148283:papier:4207:28299131,28148308:papier:4207:28298789,28150094:papier:4207:28307578,28150096:papier:4207:28337006,28150112:papier:4207:28332036,28153517:papier:4207:28153552,28153518:papier:4207:28339001,28154448:papier:4207:28330835,28156460:papier:4207:28328576,28156464:papier:4207:28156692,28156466:papier:4207:28321254,28163832:papier:4207:28338274,28180156:papier:4207:28181496,28180177:papier:4207:28181412,28180178:papier:4207:28181457,28180197:papier:4207:28186819,28180199:papier:4207:28181351,28180201:papier:4207:28181219,28180202:papier:4207:28186741,28180204:papier:4207:28180232,28180206:papier:4207:28180794,2818'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.005736430811779723, 'nb_photo': 2, 'list_port_cont': '28540468', 'assoc_port': '28540307:28540468', 'assoc_mat': '28540307:papier:3327:28540468'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0072657192207601605, 'nb_photo': 3275, 'list_port_cont': '28089853,28090152,28090382,28146657,28150560,28156754,28180296,28186434,28195379,28195886,28208088,28218841,28221541,28223992,28225870,28254715,28255090,28255344,28256401,28266216,28267525,28268355,28268669,28272170,28275372,28298721,28299078,28299382,28304455,28318242,28318600,28319470,28319938,28320441,28321010,28321389,28322765,28325744,28352418,28353021,28353309,28353523,28353852,28353954,28354631,28355244,28356782,28381423,28388649,28388999,28395828,28396197,28404052,28407141,28407709,28416312,28427266,28427960,28428009,28429018,28429186,28431208,28431771,28431904,28432439,28445028,28448037,28457324,28457898,28463139,28463272,28463344,28464073,28466029,28466778,28472097,28484851,28485257,28485525,28495699,28496204,28496545,28497004,28497815,28519238,28540478,28540762,28540836,28541482,28542119,28542514,28543116,28543346,28543769,28545334,28546030,28563826,28565453,28565826,28566243,28570941,28571770,28572342,28574958,28575591,28597912,28598164,28599124,28606086,28606277,28612977,28614014,28616103,2861671', 'assoc_port': '28089591:28090382,28089594:28090152,28089596:28089853,28146548:28146657,28150110:28150560,28156462:28156754,28180176:28186434,28180200:28180296,28195056:28195886,28195059:28195379,28204164:28208088,28218602:28218841,28220920:28221541,28220943:28223992,28225687:28225870,28254378:28255344,28254381:28255090,28254382:28256401,28254385:28254715,28265444:28266216,28265455:28267525,28268247:28268355,28268516:28268669,28271938:28272170,28275226:28275372,28298577:28299382,28298579:28299078,28298580:28298721,28304078:28304455,28317462:28321389,28317465:28321010,28317467:28320441,28317509:28319938,28317536:28318600,28317550:28318242,28318849:28319470,28318855:28322765,28325353:28325744,28348936:28352418,28352790:28353309,28352791:28353954,28352794:28353852,28352797:28353021,28353420:28353523,28354585:28354631,28355212:28355244,28356749:28356782,28381336:28381423,28388418:28388999,28388428:28388649,28395537:28396197,28395540:28395828,28403692:28404052,28406458:28407709,28406460:28407141,28415993:28416312,28427141:2842726', 'assoc_mat': '28089591:papier:3594:28090382,28089594:papier:3594:28090152,28089596:papier:3594:28089853,28146548:papier:3594:28146657,28150110:papier:3594:28150560,28156462:papier:3594:28156754,28180176:papier:3594:28186434,28180200:papier:3594:28180296,28195056:papier:3594:28195886,28195059:papier:3594:28195379,28204164:papier:3594:28208088,28218602:papier:3594:28218841,28220920:papier:3594:28221541,28220943:papier:3594:28223992,28225687:papier:3594:28225870,28254378:papier:3594:28255344,28254381:papier:3594:28255090,28254382:papier:3594:28256401,28254385:papier:3594:28254715,28265444:papier:3594:28266216,28265455:papier:3594:28267525,28268247:papier:3594:28268355,28268516:papier:3594:28268669,28271938:papier:3594:28272170,28275226:papier:3594:28275372,28298577:papier:3594:28299382,28298579:papier:3594:28299078,28298580:papier:3594:28298721,28304078:papier:3594:28304455,28317462:papier:3594:28321389,28317465:papier:3594:28321010,28317467:papier:3594:28320441,28317509:papier:3594:28319938,28317536:papier:3594:28318600,2831'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00029480760441903653, 'nb_photo': 48, 'list_port_cont': '28187521,28224851,28227998,28266567,28301546,28318139,28328567,28335148,28337813,28342764,28343015,28350132,28353003,28353169,28355398,28359721,28433729,28448303,28450491,28497752,28546655,28555855,28571544,28576802,28606369,28607172,28685714,28726978,28732277,28758087,28765688,28806230,28817580,28817686', 'assoc_port': '28148279:28301546,28156460:28328567,28187382:28187521,28187383:28335148,28204166:28342764,28204168:28343015,28224647:28224851,28225686:28227998,28249999:28350132,28266490:28266567,28298578:28359721,28317507:28318139,28325351:28337813,28352787:28353169,28352789:28353003,28355213:28355398,28433628:28433729,28447945:28448303,28449229:28450491,28497678:28497752,28546234:28546655,28555645:28555855,28571216:28571544,28576678:28576802,28605908:28607172,28605911:28606369,28685559:28685714,28722257:28726978,28731815:28732277,28743777:28758087,28765413:28765688,28798448:28806230,28817304:28817580,28817308:28817686', 'assoc_mat': '28148279:pehd:4207:28301546,28156460:pehd:4207:28328567,28187382:pehd:4207:28187521,28187383:pehd:4207:28335148,28204166:pehd:4207:28342764,28204168:pehd:4207:28343015,28224647:pehd:4207:28224851,28225686:pehd:4207:28227998,28249999:pehd:4207:28350132,28266490:pehd:4207:28266567,28298578:pehd:4207:28359721,28317507:pehd:4207:28318139,28325351:pehd:4207:28337813,28352787:pehd:4207:28353169,28352789:pehd:4207:28353003,28355213:pehd:4207:28355398,28433628:pehd:4207:28433729,28447945:pehd:4207:28448303,28449229:pehd:4207:28450491,28497678:pehd:4207:28497752,28546234:pehd:4207:28546655,28555645:pehd:4207:28555855,28571216:pehd:4207:28571544,28576678:pehd:4207:28576802,28605908:pehd:4207:28607172,28605911:pehd:4207:28606369,28685559:pehd:4207:28685714,28722257:pehd:4207:28726978,28731815:pehd:4207:28732277,28743777:pehd:4207:28758087,28765413:pehd:4207:28765688,28798448:pehd:4207:28806230,28817304:pehd:4207:28817580,28817308:pehd:4207:28817686'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003412552971291397, 'nb_photo': 18, 'list_port_cont': '28195373,28266218,28304458,28353951,28354635,28428011,28472101,28540483,28543770,28571779,28597538,28703026,28768303,28791267,28801042', 'assoc_port': '28195059:28195373,28265444:28266218,28304078:28304458,28352791:28353951,28354585:28354635,28427879:28428011,28472052:28472101,28540286:28543770,28540305:28540483,28571215:28571779,28596986:28597538,28700488:28703026,28766813:28768303,28789008:28791267,28798419:28801042', 'assoc_mat': '28195059:pehd:3594:28195373,28265444:pehd:3594:28266218,28304078:pehd:3594:28304458,28352791:pehd:3594:28353951,28354585:pehd:3594:28354635,28427879:pehd:3594:28428011,28472052:pehd:3594:28472101,28540286:pehd:3594:28543770,28540305:pehd:3594:28540483,28571215:pehd:3594:28571779,28596986:pehd:3594:28597538,28700488:pehd:3594:28703026,28766813:pehd:3594:28768303,28789008:pehd:3594:28791267,28798419:pehd:3594:28801042'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019883975327020503, 'nb_photo': 951, 'list_port_cont': '28090217,28090490,28148169,28153566,28157055,28170229,28180796,28181342,28181404,28181458,28187527,28204222,28221196,28224838,28228001,28228208,28238379,28238407,28250145,28254936,28258026,28259591,28261889,28265508,28265576,28266579,28266928,28269039,28274014,28283732,28290818,28298654,28299141,28301553,28304222,28317920,28318137,28318433,28327719,28327903,28328569,28329669,28330830,28335154,28336087,28337005,28337817,28339136,28342774,28343011,28344635,28347329,28347374,28347392,28347426,28352368,28352809,28353171,28353457,28353654,28354207,28355394,28356519,28356916,28357745,28359571,28359719,28360088,28360818,28362037,28362171,28362351,28363732,28364037,28364101,28364123,28383194,28386576,28388826,28389025,28389328,28389372,28395575,28405052,28409798,28410526,28414113,28424647,28425909,28427172,28428747,28428997,28429918,28431800,28431821,28432839,28433722,28433738,28437624,28448306,28450483,28452446,28458616,28462881,28468186,28470008,28470164,28470716,28472067,28482214,28484689,28485462,28497693,2849775', 'assoc_port': '28089590:28090217,28089593:28090490,28089597:28170229,28146562:28148169,28148277:28157055,28148279:28301553,28148283:28299141,28150096:28337005,28153517:28153566,28154448:28330830,28156460:28328569,28180177:28181404,28180178:28181458,28180199:28181342,28180206:28180796,28180207:28327719,28186185:28327903,28187382:28187527,28187383:28335154,28195055:28347329,28195058:28344635,28204165:28204222,28204166:28342774,28204168:28343011,28211945:28347374,28211948:28347392,28220918:28347426,28220931:28221196,28224647:28224838,28225682:28228208,28225686:28228001,28238295:28238407,28238299:28238379,28250001:28250145,28254380:28254936,28257885:28258026,28259203:28259591,28261834:28261889,28265470:28265576,28265471:28265508,28266489:28266928,28266490:28266579,28268496:28354207,28268498:28269039,28271937:28290818,28271939:28274014,28283585:28283732,28298578:28359719,28298584:28298654,28299784:28360088,28304079:28360818,28304082:28304222,28317463:28362037,28317487:28318433,28317507:28318137,28317521:28317920,28318847:2836217', 'assoc_mat': '28089590:pet_clair:4207:28090217,28089593:pet_clair:4207:28090490,28089597:pet_clair:4207:28170229,28146562:pet_clair:4207:28148169,28148277:pet_clair:4207:28157055,28148279:pet_clair:4207:28301553,28148283:pet_clair:4207:28299141,28150096:pet_clair:4207:28337005,28153517:pet_clair:4207:28153566,28154448:pet_clair:4207:28330830,28156460:pet_clair:4207:28328569,28180177:pet_clair:4207:28181404,28180178:pet_clair:4207:28181458,28180199:pet_clair:4207:28181342,28180206:pet_clair:4207:28180796,28180207:pet_clair:4207:28327719,28186185:pet_clair:4207:28327903,28187382:pet_clair:4207:28187527,28187383:pet_clair:4207:28335154,28195055:pet_clair:4207:28347329,28195058:pet_clair:4207:28344635,28204165:pet_clair:4207:28204222,28204166:pet_clair:4207:28342774,28204168:pet_clair:4207:28343011,28211945:pet_clair:4207:28347374,28211948:pet_clair:4207:28347392,28220918:pet_clair:4207:28347426,28220931:pet_clair:4207:28221196,28224647:pet_clair:4207:28224838,28225682:pet_clair:4207:28228208,28225686:pet_clair:4207:28228001,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8702991828304787, 'nb_photo': 85, 'list_port_cont': '28540466', 'assoc_port': '28540307:28540466', 'assoc_mat': '28540307:pet_clair:3327:28540466'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07762241589606983, 'nb_photo': 2677, 'list_port_cont': '28089854,28090160,28090381,28146663,28150562,28156758,28180288,28186425,28195372,28195891,28208079,28218840,28221542,28224000,28225872,28254709,28255089,28255346,28256402,28259461,28266215,28267519,28268350,28268675,28272167,28275366,28298717,28299073,28299387,28304454,28318237,28318608,28319472,28319937,28320443,28321003,28321388,28322773,28325748,28352421,28353017,28353314,28353528,28353856,28353950,28354639,28355241,28356788,28381424,28388653,28389003,28395832,28396202,28404056,28407143,28407703,28416321,28427274,28427955,28428010,28429012,28429176,28431205,28431778,28431898,28432436,28445035,28448036,28457325,28457899,28463142,28463280,28463337,28464075,28466026,28466774,28472098,28484850,28485263,28485527,28495703,28496198,28496554,28497005,28497816,28519241,28540484,28540753,28540832,28541488,28542122,28542516,28543122,28543351,28543764,28545337,28546027,28563821,28565451,28565831,28566254,28570945,28571776,28572339,28574960,28575596,28597537,28597915,28598173,28599114,28606079,28606278,28612979,2861400', 'assoc_port': '28089591:28090381,28089594:28090160,28089596:28089854,28146548:28146663,28150110:28150562,28156462:28156758,28180176:28186425,28180200:28180288,28195056:28195891,28195059:28195372,28204164:28208079,28218602:28218840,28220920:28221542,28220943:28224000,28225687:28225872,28254378:28255346,28254381:28255089,28254382:28256402,28254385:28254709,28259204:28259461,28265444:28266215,28265455:28267519,28268247:28268350,28268516:28268675,28271938:28272167,28275226:28275366,28298577:28299387,28298579:28299073,28298580:28298717,28304078:28304454,28317462:28321388,28317465:28321003,28317467:28320443,28317509:28319937,28317536:28318608,28317550:28318237,28318849:28319472,28318855:28322773,28325353:28325748,28348936:28352421,28352790:28353314,28352791:28353950,28352794:28353856,28352797:28353017,28353420:28353528,28354585:28354639,28355212:28355241,28356749:28356788,28381336:28381424,28388418:28389003,28388428:28388653,28395537:28396202,28395540:28395832,28403692:28404056,28406458:28407703,28406460:28407143,28415993:2841632', 'assoc_mat': '28089591:pet_clair:3594:28090381,28089594:pet_clair:3594:28090160,28089596:pet_clair:3594:28089854,28146548:pet_clair:3594:28146663,28150110:pet_clair:3594:28150562,28156462:pet_clair:3594:28156758,28180176:pet_clair:3594:28186425,28180200:pet_clair:3594:28180288,28195056:pet_clair:3594:28195891,28195059:pet_clair:3594:28195372,28204164:pet_clair:3594:28208079,28218602:pet_clair:3594:28218840,28220920:pet_clair:3594:28221542,28220943:pet_clair:3594:28224000,28225687:pet_clair:3594:28225872,28254378:pet_clair:3594:28255346,28254381:pet_clair:3594:28255089,28254382:pet_clair:3594:28256402,28254385:pet_clair:3594:28254709,28259204:pet_clair:3594:28259461,28265444:pet_clair:3594:28266215,28265455:pet_clair:3594:28267519,28268247:pet_clair:3594:28268350,28268516:pet_clair:3594:28268675,28271938:pet_clair:3594:28272167,28275226:pet_clair:3594:28275366,28298577:pet_clair:3594:28299387,28298579:pet_clair:3594:28299073,28298580:pet_clair:3594:28298717,28304078:pet_clair:3594:28304454,28317462:pet_clair:3594:28321388,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00021990845607222246, 'nb_photo': 87, 'list_port_cont': '28090493,28181347,28181452,28187523,28254937,28258023,28259603,28261928,28269027,28283731,28290831,28299132,28317926,28335150,28339124,28342765,28343000,28347427,28354167,28356528,28356813,28360091,28360422,28386583,28389026,28425900,28431803,28433714,28433742,28437610,28448312,28462877,28467789,28495578,28497748,28504326,28504603,28505971,28546648,28547446,28555852,28575017,28576943,28598088,28606360,28614566,28616620,28684439,28703649,28718960,28721843,28722018,28757709,28765696,28768510,28789111,28793267,28805542,28805922,28806549,28810314,28813601', 'assoc_port': '28089593:28090493,28148283:28299132,28180178:28181452,28180199:28181347,28187382:28187523,28187383:28335150,28204166:28342765,28204168:28343000,28220918:28347427,28254380:28254937,28257885:28258023,28259203:28259603,28261836:28261928,28268495:28354167,28268498:28269027,28271937:28290831,28283585:28283731,28299784:28360091,28304075:28360422,28317521:28317926,28325348:28356528,28339120:28339124,28356748:28356813,28385092:28386583,28388426:28389026,28425861:28425900,28431668:28431803,28433628:28433742,28433632:28433714,28437592:28437610,28447945:28448312,28462654:28462877,28467748:28467789,28495451:28504326,28495454:28504603,28495508:28495578,28497669:28505971,28497678:28497748,28541864:28547446,28546234:28546648,28555645:28555852,28574865:28575017,28576675:28576943,28596967:28598088,28605911:28606360,28612828:28614566,28616550:28616620,28676873:28684439,28700485:28703649,28718886:28721843,28718891:28722018,28718896:28718960,28743767:28757709,28765413:28765696,28768492:28768510,28789009:28793267,28789016:2878911', 'assoc_mat': '28089593:pet_fonce:4207:28090493,28148283:pet_fonce:4207:28299132,28180178:pet_fonce:4207:28181452,28180199:pet_fonce:4207:28181347,28187382:pet_fonce:4207:28187523,28187383:pet_fonce:4207:28335150,28204166:pet_fonce:4207:28342765,28204168:pet_fonce:4207:28343000,28220918:pet_fonce:4207:28347427,28254380:pet_fonce:4207:28254937,28257885:pet_fonce:4207:28258023,28259203:pet_fonce:4207:28259603,28261836:pet_fonce:4207:28261928,28268495:pet_fonce:4207:28354167,28268498:pet_fonce:4207:28269027,28271937:pet_fonce:4207:28290831,28283585:pet_fonce:4207:28283731,28299784:pet_fonce:4207:28360091,28304075:pet_fonce:4207:28360422,28317521:pet_fonce:4207:28317926,28325348:pet_fonce:4207:28356528,28339120:pet_fonce:4207:28339124,28356748:pet_fonce:4207:28356813,28385092:pet_fonce:4207:28386583,28388426:pet_fonce:4207:28389026,28425861:pet_fonce:4207:28425900,28431668:pet_fonce:4207:28431803,28433628:pet_fonce:4207:28433742,28433632:pet_fonce:4207:28433714,28437592:pet_fonce:4207:28437610,28447945:pet_fonce:4207:28448312,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.014294082572562015, 'nb_photo': 2, 'list_port_cont': '28540463', 'assoc_port': '28540307:28540463', 'assoc_mat': '28540307:pet_fonce:3327:28540463'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003313185439799291, 'nb_photo': 48, 'list_port_cont': '28208085,28223996,28266214,28319477,28325754,28353311,28356791,28396198,28427273,28431770,28431897,28457902,28463275,28472102,28484843,28485266,28540760,28543765,28571771,28597908,28614017,28661071,28677954,28700398,28700947,28703020,28720027,28744409,28759214,28790486,28800649,28801041', 'assoc_port': '28204164:28208085,28220943:28223996,28265444:28266214,28318849:28319477,28325353:28325754,28352790:28353311,28356749:28356791,28395537:28396198,28427141:28427273,28431664:28431897,28431669:28431770,28457119:28457902,28463065:28463275,28472052:28472102,28484569:28485266,28484571:28484843,28540286:28543765,28540300:28540760,28571215:28571771,28596970:28597908,28612812:28614017,28657578:28661071,28677782:28677954,28699663:28700398,28700487:28700947,28700488:28703020,28718887:28720027,28743775:28744409,28759074:28759214,28789015:28790486,28798419:28801041,28798422:28800649', 'assoc_mat': '28204164:pet_fonce:3594:28208085,28220943:pet_fonce:3594:28223996,28265444:pet_fonce:3594:28266214,28318849:pet_fonce:3594:28319477,28325353:pet_fonce:3594:28325754,28352790:pet_fonce:3594:28353311,28356749:pet_fonce:3594:28356791,28395537:pet_fonce:3594:28396198,28427141:pet_fonce:3594:28427273,28431664:pet_fonce:3594:28431897,28431669:pet_fonce:3594:28431770,28457119:pet_fonce:3594:28457902,28463065:pet_fonce:3594:28463275,28472052:pet_fonce:3594:28472102,28484569:pet_fonce:3594:28485266,28484571:pet_fonce:3594:28484843,28540286:pet_fonce:3594:28543765,28540300:pet_fonce:3594:28540760,28571215:pet_fonce:3594:28571771,28596970:pet_fonce:3594:28597908,28612812:pet_fonce:3594:28614017,28657578:pet_fonce:3594:28661071,28677782:pet_fonce:3594:28677954,28699663:pet_fonce:3594:28700398,28700487:pet_fonce:3594:28700947,28700488:pet_fonce:3594:28703020,28718887:pet_fonce:3594:28720027,28743775:pet_fonce:3594:28744409,28759074:pet_fonce:3594:28759214,28789015:pet_fonce:3594:28790486,28798419:pet_fonce:3594:28801041,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0050734853131264345, 'nb_photo': 2, 'list_port_cont': '28353476,28406633', 'assoc_port': '28353422:28353476,28406456:28406633', 'assoc_mat': '28353422:pet_opaque:4461:28353476,28406456:pet_opaque:4461:28406633'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0017315271405296557, 'nb_photo': 314, 'list_port_cont': '28089204,28090081,28148159,28181463,28187516,28218967,28221204,28224852,28228205,28238381,28250146,28258021,28259598,28261937,28266570,28269032,28283745,28288676,28290821,28298680,28298786,28299140,28318141,28318420,28327898,28328459,28328570,28330831,28335153,28337814,28338995,28342760,28344644,28345230,28347372,28347441,28350324,28352837,28353161,28353456,28354157,28355386,28356532,28357059,28357738,28359567,28359642,28359726,28359885,28360408,28361827,28363743,28364047,28382997,28388813,28389369,28395585,28404011,28410530,28414114,28424685,28425890,28425898,28427177,28428771,28429817,28431795,28432372,28433715,28433744,28448311,28449464,28452440,28452479,28452489,28458606,28462869,28467792,28470014,28470729,28472061,28482224,28485377,28495546,28497757,28500637,28504599,28505980,28506873,28540611,28542816,28543468,28543880,28546645,28547017,28547622,28547814,28564185,28570241,28570818,28571521,28571537,28574902,28574987,28575748,28576442,28576728,28576800,28576940,28581346,28605978,28606372,28607164,2861455', 'assoc_port': '28088708:28089204,28089595:28090081,28146552:28288676,28146562:28148159,28148282:28298680,28148283:28299140,28148308:28298786,28153518:28338995,28154448:28330831,28156460:28328570,28180178:28181463,28186185:28327898,28187382:28187516,28187383:28335153,28195058:28344644,28204166:28342760,28207350:28345230,28211945:28347372,28218601:28218967,28220918:28347441,28220931:28221204,28224647:28224852,28225682:28228205,28238299:28238381,28250000:28350324,28250001:28250146,28257885:28258021,28259203:28259598,28261836:28261937,28266490:28266570,28268495:28354157,28268498:28269032,28271937:28290821,28283585:28283745,28298576:28359642,28298578:28359726,28298582:28359885,28304075:28360408,28317456:28361827,28317471:28318420,28317507:28318141,28325348:28356532,28325351:28337814,28325357:28328459,28352787:28353161,28352796:28352837,28353423:28353456,28355213:28355386,28356745:28357059,28357715:28357738,28359465:28359567,28363709:28363743,28363980:28364047,28381333:28382997,28388415:28389369,28388427:28388813,28395542:2839558', 'assoc_mat': '28088708:pet_opaque:4207:28089204,28089595:pet_opaque:4207:28090081,28146552:pet_opaque:4207:28288676,28146562:pet_opaque:4207:28148159,28148282:pet_opaque:4207:28298680,28148283:pet_opaque:4207:28299140,28148308:pet_opaque:4207:28298786,28153518:pet_opaque:4207:28338995,28154448:pet_opaque:4207:28330831,28156460:pet_opaque:4207:28328570,28180178:pet_opaque:4207:28181463,28186185:pet_opaque:4207:28327898,28187382:pet_opaque:4207:28187516,28187383:pet_opaque:4207:28335153,28195058:pet_opaque:4207:28344644,28204166:pet_opaque:4207:28342760,28207350:pet_opaque:4207:28345230,28211945:pet_opaque:4207:28347372,28218601:pet_opaque:4207:28218967,28220918:pet_opaque:4207:28347441,28220931:pet_opaque:4207:28221204,28224647:pet_opaque:4207:28224852,28225682:pet_opaque:4207:28228205,28238299:pet_opaque:4207:28238381,28250000:pet_opaque:4207:28350324,28250001:pet_opaque:4207:28250146,28257885:pet_opaque:4207:28258021,28259203:pet_opaque:4207:28259598,28261836:pet_opaque:4207:28261937,28266490:pet_opaque:4207:28266570,2826'}, {'unwanted_material': 'plastique', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.04643993676496215, 'nb_photo': 3, 'list_port_cont': '28150227,28447994', 'assoc_port': '28150125:28150227,28447947:28447994', 'assoc_mat': '28150125:plastique:3726:28150227,28447947:plastique:3726:28447994'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.003628554788819732, 'nb_photo': 1, 'list_port_cont': '28150228', 'assoc_port': '28150125:28150228', 'assoc_mat': '28150125:Teint_Dans_La_Masse:3726:28150228'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 8.318546425201849e-05, 'nb_photo': 41, 'list_port_cont': '28148164,28181462,28228207,28238382,28335157,28353459,28354117,28357732,28360089,28363740,28431812,28432364,28433730,28482213,28497710,28504602,28505982,28525774,28547811,28607176,28657614,28677330,28684443,28685707,28700382,28700552,28706654,28726294,28732273,28757867,28764629,28798759,28805079,28806081,28817572', 'assoc_port': '28146562:28148164,28180178:28181462,28187383:28335157,28225682:28228207,28238299:28238382,28268494:28354117,28299784:28360089,28353423:28353459,28357715:28357732,28363709:28363740,28431667:28431812,28432324:28432364,28433628:28433730,28482028:28482213,28495454:28504602,28497669:28505982,28497680:28497710,28518808:28525774,28547792:28547811,28605908:28607176,28657588:28657614,28666744:28677330,28676873:28684443,28685559:28685707,28699664:28700382,28700518:28700552,28703321:28706654,28722252:28726294,28731815:28732273,28743769:28757867,28764623:28764629,28798445:28806081,28798476:28798759,28805051:28805079,28817304:28817572', 'assoc_mat': '28146562:textiles_sanitaires:4207:28148164,28180178:textiles_sanitaires:4207:28181462,28187383:textiles_sanitaires:4207:28335157,28225682:textiles_sanitaires:4207:28228207,28238299:textiles_sanitaires:4207:28238382,28268494:textiles_sanitaires:4207:28354117,28299784:textiles_sanitaires:4207:28360089,28353423:textiles_sanitaires:4207:28353459,28357715:textiles_sanitaires:4207:28357732,28363709:textiles_sanitaires:4207:28363740,28431667:textiles_sanitaires:4207:28431812,28432324:textiles_sanitaires:4207:28432364,28433628:textiles_sanitaires:4207:28433730,28482028:textiles_sanitaires:4207:28482213,28495454:textiles_sanitaires:4207:28504602,28497669:textiles_sanitaires:4207:28505982,28497680:textiles_sanitaires:4207:28497710,28518808:textiles_sanitaires:4207:28525774,28547792:textiles_sanitaires:4207:28547811,28605908:textiles_sanitaires:4207:28607176,28657588:textiles_sanitaires:4207:28657614,28666744:textiles_sanitaires:4207:28677330,28676873:textiles_sanitaires:4207:28684443,28685559:textiles_sanitaires:4207:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(2507945,2508055,2514843,2521542,2530629,2539472,2549196,2554236,2557401,2565553,2572766,2580200,2586863,2594387,2598459,2599614,2607247,2616210,2622846,2629008,2637094,2639244)); after get_hostname_from_raspi hasthag : refus hasthag that could be used but not yet : _______refus,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______refus' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-11-01' and date <= '2025-11-30') GROUP BY month order by month; hasthag : pcnc hasthag that could be used but not yet : _______carton,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pcnc' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-11-01' and date <= '2025-11-30') GROUP BY month order by month; hasthag : film_pedb hasthag that could be used but not yet : _______film_plastique SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______film_pedb' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-11-01' and date <= '2025-11-30') GROUP BY month order by month; hasthag : jrm hasthag that could be used but not yet : _______papier,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______jrm' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-11-01' and date <= '2025-11-30') GROUP BY month order by month; hasthag : pet_clair hasthag that could be used but not yet : _______pet_clair,bouchon,etiquette,barquette_avec_film,background SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______pet_clair' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1042) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=94 and date >='2025-11-01' and date <= '2025-11-30') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((34016,),), 'unwanted_material_monthly_percentage': ((0.029106531134711667,),), 'material_repartition': (('pcnc', 28881), ('refus', 2750), ('film_pedb', 2356), ('jrm', 19), ('pet_clair', 10)), 'material_dict': {'pcnc': 28881, 'refus': 2750, 'film_pedb': 2356, 'autres': 29}, 'coverage_data': (('2025/11/22/', 0.0), ('2025/11/21/', 0.0), ('2025/11/20/', 0.0), ('2025/11/19/', 0.0), ('2025/11/18/', 0.0), ('2025/11/17/', 0.0), ('2025/11/15/', 0.0), ('2025/11/14/', 0.0), ('2025/11/13/', 0.0), ('2025/11/12/', 0.0), ('2025/11/11/', 0.0), ('2025/11/10/', 0.0), ('2025/11/08/', 0.0), ('2025/11/07/', 0.0), ('2025/11/06/', 0.0), ('2025/11/05/', 0.0), ('2025/11/04/', 0.0), ('2025/11/03/', 0.0), ('2025/11/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 11, 2), 0.0, 8), (datetime.date(2025, 11, 3), 0.03885690324798023, 26), (datetime.date(2025, 11, 4), 0.027689626634126076, 38), (datetime.date(2025, 11, 5), 0.03603595888514179, 113), (datetime.date(2025, 11, 6), 0.029067339865345973, 22), (datetime.date(2025, 11, 7), 0.03359347096026605, 57), (datetime.date(2025, 11, 8), 0.03317294891785054, 10), (datetime.date(2025, 11, 10), 0.021062381330278837, 47), (datetime.date(2025, 11, 11), 0.0227421188768574, 43), (datetime.date(2025, 11, 12), 0.03308737651317219, 18), (datetime.date(2025, 11, 13), 0.02874753989238981, 245), (datetime.date(2025, 11, 14), 0.03116121902415886, 135), (datetime.date(2025, 11, 15), 0.022933760958828604, 172), (datetime.date(2025, 11, 17), 0.02524500721031865, 20), (datetime.date(2025, 11, 18), 0.033101546980552524, 121), (datetime.date(2025, 11, 19), 0.029772667630833485, 35), (datetime.date(2025, 11, 20), 0.029160536989066264, 29), (datetime.date(2025, 11, 21), 0.0354015343154964, 12), (datetime.date(2025, 11, 22), 0.02623713140099201, 14)), 'impurety_average_data_per_hashtag': {'refus': ((datetime.date(2025, 11, 2), 0.0, 8), (datetime.date(2025, 11, 3), 0.17223479887508128, 10), (datetime.date(2025, 11, 4), 0.04918995339328793, 13), (datetime.date(2025, 11, 5), 0.0822234024731969, 10), (datetime.date(2025, 11, 6), 0.09765133919702343, 17), (datetime.date(2025, 11, 7), 0.12041315274964635, 9), (datetime.date(2025, 11, 8), 0.06613166330115577, 10), (datetime.date(2025, 11, 10), 0.10079894565137869, 48), (datetime.date(2025, 11, 11), 0.07924323681619837, 17), (datetime.date(2025, 11, 12), 0.12700833059622124, 10), (datetime.date(2025, 11, 13), 0.09215495932130044, 12), (datetime.date(2025, 11, 14), 0.08106398996564437, 14), (datetime.date(2025, 11, 15), 0.08769219607961888, 12), (datetime.date(2025, 11, 17), 0.08548305852482065, 12), (datetime.date(2025, 11, 18), 0.0983068703576516, 17), (datetime.date(2025, 11, 19), 0.10486871572352564, 10), (datetime.date(2025, 11, 20), 0.07442924426891906, 10), (datetime.date(2025, 11, 21), 0.10202495464214215, 8), (datetime.date(2025, 11, 22), 0.060933680468401384, 9)), 'pcnc': ((datetime.date(2025, 11, 3), 0.018376292714903632, 26), (datetime.date(2025, 11, 4), 0.02248613608160587, 38), (datetime.date(2025, 11, 5), 0.03208776375494247, 113), (datetime.date(2025, 11, 6), 0.018940554441546527, 22), (datetime.date(2025, 11, 7), 0.021361044359133167, 57), (datetime.date(2025, 11, 8), 0.02419724915438273, 10), (datetime.date(2025, 11, 10), 0.012331604246799098, 47), (datetime.date(2025, 11, 11), 0.018039188531079203, 43), (datetime.date(2025, 11, 12), 0.018024124793930327, 18), (datetime.date(2025, 11, 13), 0.015561038184130332, 245), (datetime.date(2025, 11, 14), 0.01921906876678507, 135), (datetime.date(2025, 11, 15), 0.01380305787737808, 172), (datetime.date(2025, 11, 17), 0.017880513891065403, 20), (datetime.date(2025, 11, 18), 0.023992668117408304, 121), (datetime.date(2025, 11, 19), 0.015615017766205587, 35), (datetime.date(2025, 11, 20), 0.021798220833274064, 29), (datetime.date(2025, 11, 21), 0.027192648551095554, 12), (datetime.date(2025, 11, 22), 0.016269978778360318, 14)), 'film_pedb': ((datetime.date(2025, 11, 3), 0.036045211402087496, 18), (datetime.date(2025, 11, 4), 0.07188641620050677, 8), (datetime.date(2025, 11, 5), 0.05181008970991932, 16), (datetime.date(2025, 11, 6), 0.0651404168403607, 9), (datetime.date(2025, 11, 7), 0.06737738978848434, 8), (datetime.date(2025, 11, 8), 0.07948072748854598, 11), (datetime.date(2025, 11, 10), 0.05825493902436287, 36), (datetime.date(2025, 11, 11), 0.04735955796717856, 14), (datetime.date(2025, 11, 12), 0.07296076752757662, 32), (datetime.date(2025, 11, 13), 0.07665899946871099, 29), (datetime.date(2025, 11, 14), 0.05089258195428874, 29), (datetime.date(2025, 11, 15), 0.07360974237128368, 10), (datetime.date(2025, 11, 17), 0.04543650659649865, 12), (datetime.date(2025, 11, 18), 0.049891890169635605, 10), (datetime.date(2025, 11, 19), 0.06862712844590127, 12), (datetime.date(2025, 11, 20), 0.07173187433056354, 14), (datetime.date(2025, 11, 21), 0.0715224373128363, 10), (datetime.date(2025, 11, 22), 0.07589137781698364, 17)), 'jrm': ((datetime.date(2025, 11, 4), 0.26552927105724483, 8), (datetime.date(2025, 11, 12), 0.186505820738481, 11)), 'pet_clair': ((datetime.date(2025, 11, 14), 0.12744508323893175, 10),)}, 'quality_array': [['14.383313339963301', '02112025'], ['0.761307748004206', '03112025'], ['0.9877882405483445', '04112025'], ['1.4361209710121305', '05112025'], ['1.0840399937901626', '06112025'], ['0.8824032397657048', '07112025'], ['0.6655537054776379', '08112025'], ['0.8626215986625264', '10112025'], ['1.159297149270686', '11112025'], ['0.8010613358891142', '12112025'], ['0.9939078005903749', '13112025'], ['0.9751028304287332', '14112025'], ['1.2153296902493782', '15112025'], ['1.0988930915272574', '17112025'], ['1.0540595270973883', '18112025'], ['0.9869396923995979', '19112025'], ['0.9634373727168439', '20112025'], ['0.9809584709876678', '21112025'], ['0.3382006283926294', '22112025']], 'number_of_batch': ((736,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.008550660849840378, 'nb_photo': 4, 'list_port_cont': '28540474', 'assoc_port': '28540307:28540474', 'assoc_mat': '28540307:autre:3327:28540474'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013393891209683222, 'nb_photo': 267, 'list_port_cont': '28089862,28146655,28150563,28156756,28180291,28186429,28195380,28195893,28208080,28218833,28221547,28223990,28256398,28266213,28268667,28272173,28275371,28298716,28299388,28318610,28319475,28320449,28322771,28325745,28353026,28353522,28353855,28353949,28354633,28355245,28356789,28381419,28395829,28396199,28404050,28407704,28416315,28427271,28429017,28429178,28431202,28431774,28431905,28445031,28448034,28457906,28463148,28463281,28463343,28464078,28466775,28472096,28484852,28485259,28485521,28495695,28496197,28496556,28497009,28540477,28540758,28541486,28542515,28543348,28543772,28546024,28565452,28565827,28566250,28571778,28574962,28575593,28597531,28598170,28599116,28606285,28612981,28614016,28616100,28616709,28622350,28623064,28650875,28657645,28658413,28661072,28667019,28677951,28686013,28699916,28700404,28701239,28703030,28707265,28708616,28742902,28743943,28759212,28765506,28765701,28768302,28790487,28799760,28800653,28801037,28813585,28817348', 'assoc_port': '28089596:28089862,28146548:28146655,28150110:28150563,28156462:28156756,28180176:28186429,28180200:28180291,28195056:28195893,28195059:28195380,28204164:28208080,28218602:28218833,28220920:28221547,28220943:28223990,28254382:28256398,28265444:28266213,28268516:28268667,28271938:28272173,28275226:28275371,28298577:28299388,28298580:28298716,28317467:28320449,28317536:28318610,28318849:28319475,28318855:28322771,28325353:28325745,28352791:28353949,28352794:28353855,28352797:28353026,28353420:28353522,28354585:28354633,28355212:28355245,28356749:28356789,28381336:28381419,28395537:28396199,28395540:28395829,28403692:28404050,28406458:28407704,28415993:28416315,28427141:28427271,28428916:28429178,28428919:28429017,28429804:28431202,28431664:28431905,28431669:28431774,28442120:28445031,28447946:28448034,28457119:28457906,28463061:28466775,28463063:28464078,28463064:28463343,28463065:28463281,28463067:28463148,28472052:28472096,28484569:28485259,28484571:28484852,28485361:28485521,28495449:28497009,28495453:2849655', 'assoc_mat': '28089596:autre:3594:28089862,28146548:autre:3594:28146655,28150110:autre:3594:28150563,28156462:autre:3594:28156756,28180176:autre:3594:28186429,28180200:autre:3594:28180291,28195056:autre:3594:28195893,28195059:autre:3594:28195380,28204164:autre:3594:28208080,28218602:autre:3594:28218833,28220920:autre:3594:28221547,28220943:autre:3594:28223990,28254382:autre:3594:28256398,28265444:autre:3594:28266213,28268516:autre:3594:28268667,28271938:autre:3594:28272173,28275226:autre:3594:28275371,28298577:autre:3594:28299388,28298580:autre:3594:28298716,28317467:autre:3594:28320449,28317536:autre:3594:28318610,28318849:autre:3594:28319475,28318855:autre:3594:28322771,28325353:autre:3594:28325745,28352791:autre:3594:28353949,28352794:autre:3594:28353855,28352797:autre:3594:28353026,28353420:autre:3594:28353522,28354585:autre:3594:28354633,28355212:autre:3594:28355245,28356749:autre:3594:28356789,28381336:autre:3594:28381419,28395537:autre:3594:28396199,28395540:autre:3594:28395829,28403692:autre:3594:28404050,28406458:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.009417491015240835, 'nb_photo': 1, 'list_port_cont': '28150224', 'assoc_port': '28150125:28150224', 'assoc_mat': '28150125:autre_refus:3726:28150224'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004456384039622031, 'nb_photo': 15, 'list_port_cont': '28156650,28388697,28406630,28462791,28497863,28542264,28574922,28706828,28752414,28759189,28789138,28798838,28799409', 'assoc_port': '28156465:28156650,28388421:28388697,28406456:28406630,28462656:28462791,28497674:28497863,28541862:28542264,28574866:28574922,28700517:28706828,28743771:28752414,28759072:28759189,28789023:28789138,28798432:28799409,28798464:28798838', 'assoc_mat': '28156465:barquette_opaque:4461:28156650,28388421:barquette_opaque:4461:28388697,28406456:barquette_opaque:4461:28406630,28462656:barquette_opaque:4461:28462791,28497674:barquette_opaque:4461:28497863,28541862:barquette_opaque:4461:28542264,28574866:barquette_opaque:4461:28574922,28700517:barquette_opaque:4461:28706828,28743771:barquette_opaque:4461:28752414,28759072:barquette_opaque:4461:28759189,28789023:barquette_opaque:4461:28789138,28798432:barquette_opaque:4461:28799409,28798464:barquette_opaque:4461:28798838'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010174151471107626, 'nb_photo': 2353, 'list_port_cont': '28089207,28090069,28090230,28090498,28148156,28153567,28156684,28157056,28170227,28181232,28181350,28181415,28181454,28181499,28186738,28187515,28195146,28204227,28221203,28224849,28225848,28227776,28228210,28238373,28238388,28238405,28250155,28254939,28258014,28259323,28259589,28261882,28265575,28266528,28266576,28266942,28269024,28274013,28283736,28283816,28288472,28288674,28288776,28290827,28292301,28298694,28298794,28299135,28301029,28301693,28304221,28305954,28307587,28317921,28318140,28327721,28327902,28328320,28328461,28328564,28329660,28330827,28332040,28335162,28336082,28336998,28337811,28338276,28339000,28339129,28342771,28343013,28344643,28345034,28345232,28347321,28347375,28347416,28347428,28347466,28347563,28350130,28350315,28352365,28352802,28352823,28352918,28353011,28353051,28353164,28353461,28353645,28354058,28354113,28354155,28354202,28355397,28356527,28356833,28356927,28357060,28357743,28358770,28359575,28359640,28359711,28360100,28360415,28360581,28360817,28361830,28362172,28362347,2836373', 'assoc_port': '28088708:28089207,28089590:28090230,28089593:28090498,28089595:28090069,28089597:28170227,28146550:28288472,28146552:28288674,28146554:28288776,28146562:28148156,28148277:28157056,28148280:28301693,28148282:28298694,28148283:28299135,28148308:28298794,28150094:28307587,28150096:28336998,28150112:28332040,28153517:28153567,28153518:28339000,28154448:28330827,28156460:28328564,28156464:28156684,28163832:28338276,28180156:28181499,28180177:28181415,28180178:28181454,28180199:28181350,28180201:28181232,28180202:28186738,28180207:28327721,28186185:28327902,28187382:28187515,28187383:28335162,28195055:28347321,28195057:28345034,28195058:28344643,28195060:28195146,28204165:28204227,28204166:28342771,28204168:28343013,28207350:28345232,28211945:28347375,28211946:28347563,28220916:28347416,28220918:28347428,28220922:28347466,28220931:28221203,28224647:28224849,28225682:28228210,28225691:28227776,28225702:28225848,28238295:28238405,28238297:28238373,28238299:28238388,28249999:28350130,28250000:28350315,28250001:2825015', 'assoc_mat': '28088708:barquette_opaque:4207:28089207,28089590:barquette_opaque:4207:28090230,28089593:barquette_opaque:4207:28090498,28089595:barquette_opaque:4207:28090069,28089597:barquette_opaque:4207:28170227,28146550:barquette_opaque:4207:28288472,28146552:barquette_opaque:4207:28288674,28146554:barquette_opaque:4207:28288776,28146562:barquette_opaque:4207:28148156,28148277:barquette_opaque:4207:28157056,28148280:barquette_opaque:4207:28301693,28148282:barquette_opaque:4207:28298694,28148283:barquette_opaque:4207:28299135,28148308:barquette_opaque:4207:28298794,28150094:barquette_opaque:4207:28307587,28150096:barquette_opaque:4207:28336998,28150112:barquette_opaque:4207:28332040,28153517:barquette_opaque:4207:28153567,28153518:barquette_opaque:4207:28339000,28154448:barquette_opaque:4207:28330827,28156460:barquette_opaque:4207:28328564,28156464:barquette_opaque:4207:28156684,28163832:barquette_opaque:4207:28338276,28180156:barquette_opaque:4207:28181499,28180177:barquette_opaque:4207:28181415,28180178:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004701025151634024, 'nb_photo': 138, 'list_port_cont': '28146794,28156577,28156649,28180453,28180532,28180983,28204448,28218814,28219179,28227720,28259517,28310038,28316210,28316951,28325708,28325957,28352853,28353474,28357778,28358644,28359552,28388710,28388784,28389048,28406641,28428668,28431733,28432405,28432435,28449360,28451363,28462790,28462819,28467800,28482300,28484719,28485419,28488746,28488906,28497857,28506817,28540527,28540648,28542268,28563722,28569589,28574429,28574913,28575529,28597353,28606009,28622353,28664797,28712993,28716032,28722544,28724935,28752409,28759194,28759238,28766911,28767620,28770205,28798716,28798832,28799422,28806890,28813649,28817317,28817426', 'assoc_port': '28146551:28146794,28156465:28156649,28156468:28156577,28180167:28180983,28180198:28180532,28180203:28180453,28204167:28204448,28218590:28227720,28218599:28219179,28218604:28218814,28259206:28259517,28268244:28316951,28271935:28316210,28304080:28310038,28325355:28325957,28325358:28325708,28352798:28352853,28353422:28353474,28357716:28357778,28358578:28358644,28359466:28359552,28388414:28389048,28388417:28388784,28388421:28388710,28406456:28406641,28428627:28428668,28431663:28431733,28432326:28432435,28432328:28432405,28449243:28449360,28451135:28451363,28462655:28462819,28462656:28462790,28467747:28467800,28482033:28482300,28484570:28484719,28485365:28485419,28488525:28488906,28488540:28488746,28497674:28497857,28506597:28506817,28540290:28540648,28540296:28540527,28541862:28542268,28563677:28563722,28569479:28569589,28574249:28574429,28574866:28574913,28575473:28575529,28596984:28597353,28605912:28606009,28622102:28622353,28657585:28664797,28712823:28712993,28715840:28716032,28722253:28724935,28722255:2872254', 'assoc_mat': '28146551:carton:4461:28146794,28156465:carton:4461:28156649,28156468:carton:4461:28156577,28180167:carton:4461:28180983,28180198:carton:4461:28180532,28180203:carton:4461:28180453,28204167:carton:4461:28204448,28218590:carton:4461:28227720,28218599:carton:4461:28219179,28218604:carton:4461:28218814,28259206:carton:4461:28259517,28268244:carton:4461:28316951,28271935:carton:4461:28316210,28304080:carton:4461:28310038,28325355:carton:4461:28325957,28325358:carton:4461:28325708,28352798:carton:4461:28352853,28353422:carton:4461:28353474,28357716:carton:4461:28357778,28358578:carton:4461:28358644,28359466:carton:4461:28359552,28388414:carton:4461:28389048,28388417:carton:4461:28388784,28388421:carton:4461:28388710,28406456:carton:4461:28406641,28428627:carton:4461:28428668,28431663:carton:4461:28431733,28432326:carton:4461:28432435,28432328:carton:4461:28432405,28449243:carton:4461:28449360,28451135:carton:4461:28451363,28462655:carton:4461:28462819,28462656:carton:4461:28462790,28467747:carton:4461:28467800,2848'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9840725431178392, 'nb_photo': 4187, 'list_port_cont': '28089193,28148165,28153556,28157048,28170222,28180238,28180792,28181224,28181356,28181402,28181456,28181493,28186739,28187514,28195145,28204234,28218961,28221199,28224856,28225837,28225860,28227767,28228213,28238385,28238409,28250157,28254940,28258018,28259328,28259599,28261888,28266536,28266569,28269034,28274022,28283743,28283823,28288679,28288786,28292315,28298690,28298783,28299136,28301552,28301689,28304224,28305947,28307586,28318142,28318431,28327729,28327907,28328463,28328563,28329659,28330825,28332041,28335155,28336996,28337803,28338278,28338988,28339132,28342762,28343004,28345233,28345856,28347328,28347380,28347437,28347459,28347472,28347566,28350128,28350326,28352359,28352829,28353006,28353048,28353168,28353468,28354027,28354112,28354154,28354209,28355306,28355393,28356520,28356820,28356827,28357058,28357744,28358773,28359574,28359714,28360085,28360419,28360580,28360815,28361838,28362052,28362175,28363744,28364018,28364040,28364097,28364108,28383011,28383189,28386591,28388823,28389020,28389337,2838936', 'assoc_port': '28088708:28089193,28089597:28170222,28146552:28288679,28146554:28288786,28146562:28148165,28148277:28157048,28148279:28301552,28148280:28301689,28148282:28298690,28148283:28299136,28148308:28298783,28150094:28307586,28150096:28336996,28150112:28332041,28153517:28153556,28153518:28338988,28154448:28330825,28156460:28328563,28163832:28338278,28180156:28181493,28180177:28181402,28180178:28181456,28180199:28181356,28180201:28181224,28180202:28186739,28180204:28180238,28180206:28180792,28180207:28327729,28186185:28327907,28187382:28187514,28187383:28335155,28195055:28347328,28195060:28195145,28204165:28204234,28204166:28342762,28204168:28343004,28207348:28345856,28207350:28345233,28211945:28347380,28211946:28347566,28218601:28218961,28220918:28347437,28220919:28347459,28220922:28347472,28220931:28221199,28224647:28224856,28225682:28228213,28225691:28227767,28225702:28225860,28225703:28225837,28238295:28238409,28238299:28238385,28249999:28350128,28250000:28350326,28250001:28250157,28254380:28254940,28257885:2825801', 'assoc_mat': '28088708:carton:4207:28089193,28089597:carton:4207:28170222,28146552:carton:4207:28288679,28146554:carton:4207:28288786,28146562:carton:4207:28148165,28148277:carton:4207:28157048,28148279:carton:4207:28301552,28148280:carton:4207:28301689,28148282:carton:4207:28298690,28148283:carton:4207:28299136,28148308:carton:4207:28298783,28150094:carton:4207:28307586,28150096:carton:4207:28336996,28150112:carton:4207:28332041,28153517:carton:4207:28153556,28153518:carton:4207:28338988,28154448:carton:4207:28330825,28156460:carton:4207:28328563,28163832:carton:4207:28338278,28180156:carton:4207:28181493,28180177:carton:4207:28181402,28180178:carton:4207:28181456,28180199:carton:4207:28181356,28180201:carton:4207:28181224,28180202:carton:4207:28186739,28180204:carton:4207:28180238,28180206:carton:4207:28180792,28180207:carton:4207:28327729,28186185:carton:4207:28327907,28187382:carton:4207:28187514,28187383:carton:4207:28335155,28195055:carton:4207:28347328,28195060:carton:4207:28195145,28204165:carton:4207:28204234,2820'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.09886390900474963, 'nb_photo': 2, 'list_port_cont': '28540464', 'assoc_port': '28540307:28540464', 'assoc_mat': '28540307:carton:3327:28540464'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.006474484896525085, 'nb_photo': 560, 'list_port_cont': '28089861,28090154,28150559,28156757,28180298,28186427,28195377,28195887,28208086,28221545,28223997,28255354,28256397,28266212,28267522,28268354,28268666,28272171,28275369,28298719,28299076,28299386,28304459,28318232,28318603,28319939,28320447,28321011,28322775,28325753,28353316,28353524,28353857,28353958,28354638,28355246,28356785,28381416,28395830,28396192,28407142,28407702,28416313,28427270,28428003,28429182,28431203,28431773,28432445,28445032,28448039,28457326,28457907,28463146,28463273,28463336,28464080,28466022,28466777,28472104,28484844,28485262,28485526,28496196,28496548,28497008,28497806,28519235,28540475,28540763,28540834,28541485,28542113,28542518,28543115,28543763,28545332,28546029,28563829,28565457,28565836,28566244,28571774,28572346,28574966,28575600,28597918,28598165,28599115,28606085,28606287,28612978,28614015,28616094,28616710,28622344,28622779,28623075,28624932,28650873,28657647,28658405,28661074,28667016,28677949,28682404,28686004,28699914,28700396,28700942,28703025,28703918,28706551,2870726', 'assoc_port': '28089594:28090154,28089596:28089861,28150110:28150559,28156462:28156757,28180176:28186427,28180200:28180298,28195056:28195887,28195059:28195377,28204164:28208086,28220920:28221545,28220943:28223997,28254378:28255354,28254382:28256397,28265444:28266212,28265455:28267522,28268247:28268354,28268516:28268666,28271938:28272171,28275226:28275369,28298577:28299386,28298579:28299076,28298580:28298719,28304078:28304459,28317465:28321011,28317467:28320447,28317509:28319939,28317536:28318603,28317550:28318232,28318855:28322775,28325353:28325753,28352790:28353316,28352791:28353958,28352794:28353857,28353420:28353524,28354585:28354638,28355212:28355246,28356749:28356785,28381336:28381416,28395537:28396192,28395540:28395830,28406458:28407702,28406460:28407142,28415993:28416313,28427141:28427270,28427879:28428003,28428916:28429182,28429804:28431203,28431669:28431773,28432327:28432445,28442120:28445032,28447946:28448039,28457119:28457907,28457120:28457326,28463061:28466777,28463062:28466022,28463063:28464080,28463064:2846333', 'assoc_mat': '28089594:carton:3594:28090154,28089596:carton:3594:28089861,28150110:carton:3594:28150559,28156462:carton:3594:28156757,28180176:carton:3594:28186427,28180200:carton:3594:28180298,28195056:carton:3594:28195887,28195059:carton:3594:28195377,28204164:carton:3594:28208086,28220920:carton:3594:28221545,28220943:carton:3594:28223997,28254378:carton:3594:28255354,28254382:carton:3594:28256397,28265444:carton:3594:28266212,28265455:carton:3594:28267522,28268247:carton:3594:28268354,28268516:carton:3594:28268666,28271938:carton:3594:28272171,28275226:carton:3594:28275369,28298577:carton:3594:28299386,28298579:carton:3594:28299076,28298580:carton:3594:28298719,28304078:carton:3594:28304459,28317465:carton:3594:28321011,28317467:carton:3594:28320447,28317509:carton:3594:28319939,28317536:carton:3594:28318603,28317550:carton:3594:28318232,28318855:carton:3594:28322775,28325353:carton:3594:28325753,28352790:carton:3594:28353316,28352791:carton:3594:28353958,28352794:carton:3594:28353857,28353420:carton:3594:28353524,2835'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.1537737284090292, 'nb_photo': 4, 'list_port_cont': '28150231,28447988', 'assoc_port': '28150125:28150231,28447947:28447988', 'assoc_mat': '28150125:Carton_brun:3726:28150231,28447947:Carton_brun:3726:28447988'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00035354251354998366, 'nb_photo': 1, 'list_port_cont': '28432407', 'assoc_port': '28432328:28432407', 'assoc_mat': '28432328:etiquette:4461:28432407'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00026263290500634016, 'nb_photo': 939, 'list_port_cont': '28090227,28153561,28157059,28180791,28181405,28181450,28181489,28187517,28204230,28224847,28225842,28225858,28227778,28228215,28238376,28238415,28250143,28258022,28259593,28261931,28266527,28266578,28266940,28269036,28283738,28288678,28288788,28299133,28301024,28301541,28318439,28327718,28328561,28330829,28332042,28335160,28337004,28337810,28339128,28342773,28345237,28347318,28347381,28347468,28352800,28352827,28353010,28353167,28353463,28354016,28354111,28354162,28354208,28355303,28355384,28356523,28356829,28357055,28357739,28358774,28359572,28359713,28360098,28360420,28361828,28362166,28363738,28364029,28364035,28364092,28383184,28388812,28389327,28389376,28395576,28397014,28405049,28410537,28414102,28424646,28425911,28427149,28427180,28428763,28431797,28432374,28432842,28433719,28433736,28448300,28449470,28452435,28458609,28462882,28463079,28467793,28468188,28470006,28470154,28470717,28472062,28482211,28485447,28497703,28497753,28504609,28505330,28505983,28506402,28506927,28525767,28540613,28540743,2854282', 'assoc_port': '28089590:28090227,28146552:28288678,28146554:28288788,28148277:28157059,28148279:28301541,28148283:28299133,28150096:28337004,28150112:28332042,28153517:28153561,28154448:28330829,28156460:28328561,28180156:28181489,28180177:28181405,28180178:28181450,28180206:28180791,28180207:28327718,28187382:28187517,28187383:28335160,28195055:28347318,28204165:28204230,28204166:28342773,28207350:28345237,28211945:28347381,28220922:28347468,28224647:28224847,28225682:28228215,28225691:28227778,28225702:28225858,28225703:28225842,28238295:28238415,28238299:28238376,28250001:28250143,28257885:28258022,28259203:28259593,28261836:28261931,28266489:28266940,28266490:28266578,28266491:28266527,28268245:28354016,28268494:28354111,28268495:28354162,28268496:28354208,28268498:28269036,28283585:28283738,28298578:28359713,28299784:28360098,28299811:28301024,28304075:28360420,28317456:28361828,28317487:28318439,28318847:28362166,28325348:28356523,28325351:28337810,28339120:28339128,28352787:28353167,28352789:28353010,28352792:2835280', 'assoc_mat': '28089590:etiquette:4207:28090227,28146552:etiquette:4207:28288678,28146554:etiquette:4207:28288788,28148277:etiquette:4207:28157059,28148279:etiquette:4207:28301541,28148283:etiquette:4207:28299133,28150096:etiquette:4207:28337004,28150112:etiquette:4207:28332042,28153517:etiquette:4207:28153561,28154448:etiquette:4207:28330829,28156460:etiquette:4207:28328561,28180156:etiquette:4207:28181489,28180177:etiquette:4207:28181405,28180178:etiquette:4207:28181450,28180206:etiquette:4207:28180791,28180207:etiquette:4207:28327718,28187382:etiquette:4207:28187517,28187383:etiquette:4207:28335160,28195055:etiquette:4207:28347318,28204165:etiquette:4207:28204230,28204166:etiquette:4207:28342773,28207350:etiquette:4207:28345237,28211945:etiquette:4207:28347381,28220922:etiquette:4207:28347468,28224647:etiquette:4207:28224847,28225682:etiquette:4207:28228215,28225691:etiquette:4207:28227778,28225702:etiquette:4207:28225858,28225703:etiquette:4207:28225842,28238295:etiquette:4207:28238415,28238299:etiquette:4207:28238376,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9336741976020435, 'nb_photo': 2087, 'list_port_cont': '28089740,28146788,28148391,28150444,28153699,28153881,28156568,28156654,28166945,28180253,28180446,28180533,28180977,28204455,28207480,28218815,28219178,28219266,28221152,28221307,28227718,28254425,28259345,28259508,28310041,28310510,28316212,28316952,28319035,28325705,28325966,28329050,28352859,28353486,28353557,28357774,28358649,28359499,28359560,28388535,28388600,28388704,28388780,28389043,28406637,28424911,28427209,28428660,28428709,28431730,28432406,28432456,28433671,28448060,28449362,28451362,28462787,28462821,28467801,28482169,28482297,28484715,28485425,28488749,28488911,28489200,28497724,28497822,28497862,28506825,28540364,28540525,28540640,28542001,28542152,28542269,28552808,28563717,28563787,28569590,28570519,28574021,28574434,28574908,28575537,28597188,28597344,28597507,28606005,28606056,28616638,28622356,28624637,28624793,28657664,28657740,28664810,28706261,28706831,28707010,28707137,28707235,28713004,28716037,28722342,28722535,28723787,28724929,28743901,28744175,28752420,28759185,28759225,2876691', 'assoc_port': '28089592:28089740,28146551:28146788,28146555:28166945,28148321:28148391,28150095:28150444,28153519:28153699,28153520:28153881,28156465:28156654,28156468:28156568,28180167:28180977,28180198:28180533,28180203:28180446,28180205:28180253,28204167:28204455,28207346:28207480,28218590:28227718,28218595:28219266,28218599:28219178,28218604:28218815,28220923:28221307,28220924:28221152,28254384:28254425,28259206:28259508,28259208:28259345,28268244:28316952,28271935:28316212,28304076:28310510,28304080:28310041,28318850:28329050,28318852:28319035,28325355:28325966,28325358:28325705,28352798:28352859,28353419:28353557,28353422:28353486,28357716:28357774,28358578:28358649,28359466:28359560,28359467:28359499,28388414:28389043,28388417:28388780,28388421:28388704,28388423:28388600,28388424:28388535,28406456:28406637,28424873:28424911,28427144:28427209,28428626:28428709,28428627:28428660,28431663:28431730,28432326:28432456,28432328:28432406,28433635:28433671,28447944:28448060,28449243:28449362,28451135:28451362,28462655:2846282', 'assoc_mat': '28089592:film_plastique:4461:28089740,28146551:film_plastique:4461:28146788,28146555:film_plastique:4461:28166945,28148321:film_plastique:4461:28148391,28150095:film_plastique:4461:28150444,28153519:film_plastique:4461:28153699,28153520:film_plastique:4461:28153881,28156465:film_plastique:4461:28156654,28156468:film_plastique:4461:28156568,28180167:film_plastique:4461:28180977,28180198:film_plastique:4461:28180533,28180203:film_plastique:4461:28180446,28180205:film_plastique:4461:28180253,28204167:film_plastique:4461:28204455,28207346:film_plastique:4461:28207480,28218590:film_plastique:4461:28227718,28218595:film_plastique:4461:28219266,28218599:film_plastique:4461:28219178,28218604:film_plastique:4461:28218815,28220923:film_plastique:4461:28221307,28220924:film_plastique:4461:28221152,28254384:film_plastique:4461:28254425,28259206:film_plastique:4461:28259508,28259208:film_plastique:4461:28259345,28268244:film_plastique:4461:28316952,28271935:film_plastique:4461:28316212,28304076:film_plastique:4461:2831051'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005058416005910822, 'nb_photo': 13020, 'list_port_cont': '28089196,28090067,28090225,28090484,28148170,28153557,28156687,28157052,28170228,28180234,28180795,28181220,28181353,28181413,28181459,28181486,28186747,28186834,28187519,28195152,28204220,28218963,28221200,28224853,28225833,28225850,28227770,28228005,28228201,28238365,28238378,28238419,28250152,28254934,28258025,28259321,28259590,28261897,28261929,28265572,28266525,28266575,28266936,28269035,28274028,28283733,28283829,28288482,28288684,28288787,28290822,28292308,28298660,28298695,28298779,28299142,28301023,28301543,28301685,28304219,28305956,28307592,28317919,28318145,28318419,28318443,28321255,28327725,28327897,28328315,28328454,28328574,28329661,28330822,28332048,28335149,28336080,28337002,28337805,28338273,28338989,28339126,28342763,28343009,28344632,28345031,28345223,28345864,28347031,28347325,28347385,28347393,28347407,28347429,28347477,28347575,28350131,28350318,28352367,28352804,28352831,28352904,28353009,28353044,28353166,28353469,28353659,28354017,28354056,28354119,28354163,28354198,28355297,2835538', 'assoc_port': '28088708:28089196,28089590:28090225,28089593:28090484,28089595:28090067,28089597:28170228,28146550:28288482,28146552:28288684,28146554:28288787,28146562:28148170,28148277:28157052,28148279:28301543,28148280:28301685,28148282:28298695,28148283:28299142,28148308:28298779,28150094:28307592,28150096:28337002,28150112:28332048,28153517:28153557,28153518:28338989,28154448:28330822,28156460:28328574,28156464:28156687,28156466:28321255,28163832:28338273,28180156:28181486,28180177:28181413,28180178:28181459,28180197:28186834,28180199:28181353,28180201:28181220,28180202:28186747,28180204:28180234,28180206:28180795,28180207:28327725,28186185:28327897,28187382:28187519,28187383:28335149,28195055:28347325,28195057:28345031,28195058:28344632,28195060:28195152,28204165:28204220,28204166:28342763,28204168:28343009,28207348:28345864,28207350:28345223,28211945:28347385,28211946:28347575,28211948:28347393,28218598:28347031,28218601:28218963,28220916:28347407,28220918:28347429,28220922:28347477,28220931:28221200,28224647:2822485', 'assoc_mat': '28088708:film_plastique:4207:28089196,28089590:film_plastique:4207:28090225,28089593:film_plastique:4207:28090484,28089595:film_plastique:4207:28090067,28089597:film_plastique:4207:28170228,28146550:film_plastique:4207:28288482,28146552:film_plastique:4207:28288684,28146554:film_plastique:4207:28288787,28146562:film_plastique:4207:28148170,28148277:film_plastique:4207:28157052,28148279:film_plastique:4207:28301543,28148280:film_plastique:4207:28301685,28148282:film_plastique:4207:28298695,28148283:film_plastique:4207:28299142,28148308:film_plastique:4207:28298779,28150094:film_plastique:4207:28307592,28150096:film_plastique:4207:28337002,28150112:film_plastique:4207:28332048,28153517:film_plastique:4207:28153557,28153518:film_plastique:4207:28338989,28154448:film_plastique:4207:28330822,28156460:film_plastique:4207:28328574,28156464:film_plastique:4207:28156687,28156466:film_plastique:4207:28321255,28163832:film_plastique:4207:28338273,28180156:film_plastique:4207:28181486,28180177:film_plastique:4207:2818141'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0001649748814406841, 'nb_photo': 21, 'list_port_cont': '28259602,28299137,28327720,28353174,28356517,28470162,28472069,28506917,28540738,28542820,28570250,28576719,28605979,28625859,28723495,28768512,28813603', 'assoc_port': '28148283:28299137,28180207:28327720,28259203:28259602,28325348:28356517,28352787:28353174,28469941:28470162,28472051:28472069,28506596:28506917,28540256:28542820,28540302:28540738,28565315:28570250,28576680:28576719,28605914:28605979,28622088:28625859,28723349:28723495,28768492:28768512,28813574:28813603', 'assoc_mat': '28148283:kraft:4207:28299137,28180207:kraft:4207:28327720,28259203:kraft:4207:28259602,28325348:kraft:4207:28356517,28352787:kraft:4207:28353174,28469941:kraft:4207:28470162,28472051:kraft:4207:28472069,28506596:kraft:4207:28506917,28540256:kraft:4207:28542820,28540302:kraft:4207:28540738,28565315:kraft:4207:28570250,28576680:kraft:4207:28576719,28605914:kraft:4207:28605979,28622088:kraft:4207:28625859,28723349:kraft:4207:28723495,28768492:kraft:4207:28768512,28813574:kraft:4207:28813603'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0031611812824809933, 'nb_photo': 731, 'list_port_cont': '28148162,28153562,28157047,28180244,28181230,28181495,28187520,28195153,28218958,28221222,28224834,28225851,28227771,28228214,28238362,28238380,28238414,28258024,28259324,28259594,28266573,28266935,28269025,28274020,28283742,28283827,28288681,28298691,28299130,28301018,28304211,28318448,28327727,28328566,28329657,28330828,28335151,28336079,28336997,28337812,28338994,28339134,28342772,28344633,28345023,28345226,28347319,28347378,28347395,28347417,28347430,28347471,28347576,28352801,28352836,28353001,28353170,28353465,28354025,28355392,28356524,28356812,28356826,28356924,28357048,28357734,28359573,28359634,28359723,28360086,28360577,28361833,28362165,28362352,28363739,28364038,28364096,28382998,28383193,28389027,28389366,28395577,28410534,28414109,28424687,28425885,28425902,28427151,28428770,28429815,28431808,28432363,28432831,28433723,28433737,28448310,28450490,28452438,28452466,28462874,28463077,28467791,28468182,28470013,28470167,28472059,28482225,28484700,28485380,28485451,28497712,28497749,28504610,2850533', 'assoc_port': '28146552:28288681,28146562:28148162,28148277:28157047,28148282:28298691,28148283:28299130,28150096:28336997,28153517:28153562,28153518:28338994,28154448:28330828,28156460:28328566,28180156:28181495,28180201:28181230,28180204:28180244,28180207:28327727,28187382:28187520,28187383:28335151,28195055:28347319,28195057:28345023,28195058:28344633,28195060:28195153,28204166:28342772,28207350:28345226,28211945:28347378,28211946:28347576,28211948:28347395,28218601:28218958,28220916:28347417,28220918:28347430,28220922:28347471,28220931:28221222,28224647:28224834,28225682:28228214,28225691:28227771,28225702:28225851,28238295:28238414,28238297:28238362,28238299:28238380,28257885:28258024,28259203:28259594,28259205:28259324,28266489:28266935,28266490:28266573,28268245:28354025,28268498:28269025,28271939:28274020,28275225:28283827,28283585:28283742,28298576:28359634,28298578:28359723,28299784:28360086,28299811:28301018,28304077:28360577,28304082:28304211,28317456:28361833,28317487:28318448,28318847:28362165,28318851:2836235', 'assoc_mat': '28146552:metal:4207:28288681,28146562:metal:4207:28148162,28148277:metal:4207:28157047,28148282:metal:4207:28298691,28148283:metal:4207:28299130,28150096:metal:4207:28336997,28153517:metal:4207:28153562,28153518:metal:4207:28338994,28154448:metal:4207:28330828,28156460:metal:4207:28328566,28180156:metal:4207:28181495,28180201:metal:4207:28181230,28180204:metal:4207:28180244,28180207:metal:4207:28327727,28187382:metal:4207:28187520,28187383:metal:4207:28335151,28195055:metal:4207:28347319,28195057:metal:4207:28345023,28195058:metal:4207:28344633,28195060:metal:4207:28195153,28204166:metal:4207:28342772,28207350:metal:4207:28345226,28211945:metal:4207:28347378,28211946:metal:4207:28347576,28211948:metal:4207:28347395,28218601:metal:4207:28218958,28220916:metal:4207:28347417,28220918:metal:4207:28347430,28220922:metal:4207:28347471,28220931:metal:4207:28221222,28224647:metal:4207:28224834,28225682:metal:4207:28228214,28225691:metal:4207:28227771,28225702:metal:4207:28225851,28238295:metal:4207:28238414,28238297:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00033458533835039825, 'nb_photo': 108, 'list_port_cont': '28090157,28156755,28195374,28208082,28223995,28255085,28255352,28266220,28304457,28318609,28352417,28353853,28353959,28354629,28381421,28396196,28404058,28427265,28428004,28429180,28448040,28457900,28463271,28463340,28464072,28472105,28484848,28485529,28496199,28519233,28540480,28540754,28542124,28542513,28565829,28571769,28575592,28597533,28599122,28614012,28622349,28650872,28657643,28661070,28677956,28682398,28686008,28700946,28703021,28719564,28720024,28742625,28768305,28791266,28800236,28800648,28817352', 'assoc_port': '28089594:28090157,28156462:28156755,28195059:28195374,28204164:28208082,28220943:28223995,28254378:28255352,28254381:28255085,28265444:28266220,28304078:28304457,28317536:28318609,28348936:28352417,28352791:28353959,28352794:28353853,28354585:28354629,28381336:28381421,28395537:28396196,28403692:28404058,28427141:28427265,28427879:28428004,28428916:28429180,28447946:28448040,28457119:28457900,28463063:28464072,28463064:28463340,28463065:28463271,28472052:28472105,28484571:28484848,28485361:28485529,28495493:28496199,28518833:28519233,28540300:28540754,28540305:28540480,28541868:28542513,28541870:28542124,28565335:28565829,28571215:28571769,28575469:28575592,28596960:28599122,28596986:28597533,28612812:28614012,28622098:28622349,28650767:28650872,28657578:28661070,28657587:28657643,28676890:28682398,28677782:28677956,28685556:28686008,28700487:28700946,28700488:28703021,28718887:28720024,28718888:28719564,28741478:28742625,28766813:28768305,28789008:28791266,28798422:28800648,28798435:28800236,28817312:2881735', 'assoc_mat': '28089594:metal:3594:28090157,28156462:metal:3594:28156755,28195059:metal:3594:28195374,28204164:metal:3594:28208082,28220943:metal:3594:28223995,28254378:metal:3594:28255352,28254381:metal:3594:28255085,28265444:metal:3594:28266220,28304078:metal:3594:28304457,28317536:metal:3594:28318609,28348936:metal:3594:28352417,28352791:metal:3594:28353959,28352794:metal:3594:28353853,28354585:metal:3594:28354629,28381336:metal:3594:28381421,28395537:metal:3594:28396196,28403692:metal:3594:28404058,28427141:metal:3594:28427265,28427879:metal:3594:28428004,28428916:metal:3594:28429180,28447946:metal:3594:28448040,28457119:metal:3594:28457900,28463063:metal:3594:28464072,28463064:metal:3594:28463340,28463065:metal:3594:28463271,28472052:metal:3594:28472105,28484571:metal:3594:28484848,28485361:metal:3594:28485529,28495493:metal:3594:28496199,28518833:metal:3594:28519233,28540300:metal:3594:28540754,28540305:metal:3594:28540480,28541868:metal:3594:28542513,28541870:metal:3594:28542124,28565335:metal:3594:28565829,28571215:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.06847760296521882, 'nb_photo': 6543, 'list_port_cont': '28089736,28146790,28148400,28150438,28153701,28153885,28156565,28156648,28166934,28180255,28180450,28180537,28180982,28204450,28207465,28218822,28219172,28219271,28221151,28221292,28227724,28254419,28259333,28259503,28310042,28310502,28316216,28316954,28319040,28325713,28325958,28329053,28352846,28353475,28353549,28357781,28358647,28359493,28359563,28388536,28388597,28388695,28388779,28389045,28406638,28424922,28427207,28428674,28428712,28431718,28432394,28432450,28433677,28448055,28449350,28451372,28462788,28462829,28467806,28482165,28482301,28484728,28485422,28488757,28488907,28489204,28497719,28497823,28497865,28506820,28540372,28540522,28540644,28541997,28542147,28542266,28552805,28563719,28563782,28569598,28570527,28574024,28574437,28574920,28575538,28597194,28597345,28597503,28605998,28606052,28616637,28622365,28624626,28624779,28657654,28657744,28664807,28706247,28706841,28707006,28707128,28707233,28712995,28716031,28722341,28722542,28723784,28724937,28743903,28744177,28752408,28759190,28759224,2876691', 'assoc_port': '28089592:28089736,28146551:28146790,28146555:28166934,28148321:28148400,28150095:28150438,28153519:28153701,28153520:28153885,28156465:28156648,28156468:28156565,28180167:28180982,28180198:28180537,28180203:28180450,28180205:28180255,28204167:28204450,28207346:28207465,28218590:28227724,28218595:28219271,28218599:28219172,28218604:28218822,28220923:28221292,28220924:28221151,28254384:28254419,28259206:28259503,28259208:28259333,28268244:28316954,28271935:28316216,28304076:28310502,28304080:28310042,28318850:28329053,28318852:28319040,28325355:28325958,28325358:28325713,28352798:28352846,28353419:28353549,28353422:28353475,28357716:28357781,28358578:28358647,28359466:28359563,28359467:28359493,28388414:28389045,28388417:28388779,28388421:28388695,28388423:28388597,28388424:28388536,28406456:28406638,28424873:28424922,28427144:28427207,28428626:28428712,28428627:28428674,28431663:28431718,28432326:28432450,28432328:28432394,28433635:28433677,28447944:28448055,28449243:28449350,28451135:28451372,28462655:2846282', 'assoc_mat': '28089592:papier:4461:28089736,28146551:papier:4461:28146790,28146555:papier:4461:28166934,28148321:papier:4461:28148400,28150095:papier:4461:28150438,28153519:papier:4461:28153701,28153520:papier:4461:28153885,28156465:papier:4461:28156648,28156468:papier:4461:28156565,28180167:papier:4461:28180982,28180198:papier:4461:28180537,28180203:papier:4461:28180450,28180205:papier:4461:28180255,28204167:papier:4461:28204450,28207346:papier:4461:28207465,28218590:papier:4461:28227724,28218595:papier:4461:28219271,28218599:papier:4461:28219172,28218604:papier:4461:28218822,28220923:papier:4461:28221292,28220924:papier:4461:28221151,28254384:papier:4461:28254419,28259206:papier:4461:28259503,28259208:papier:4461:28259333,28268244:papier:4461:28316954,28271935:papier:4461:28316216,28304076:papier:4461:28310502,28304080:papier:4461:28310042,28318850:papier:4461:28329053,28318852:papier:4461:28319040,28325355:papier:4461:28325958,28325358:papier:4461:28325713,28352798:papier:4461:28352846,28353419:papier:4461:28353549,2835'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0065056728183815115, 'nb_photo': 20452, 'list_port_cont': '28089208,28090055,28090221,28090486,28148166,28153552,28156692,28157054,28170218,28180232,28180794,28181219,28181351,28181412,28181457,28181496,28186741,28186819,28187526,28195151,28204233,28218960,28221223,28224850,28225835,28225862,28227766,28227995,28228204,28238375,28238391,28238406,28250150,28254935,28258016,28259326,28259596,28261896,28261934,28265514,28265563,28266529,28266571,28266930,28269031,28274015,28283735,28283824,28288486,28288677,28288778,28290829,28292316,28298665,28298684,28298789,28299131,28301033,28301550,28301687,28304223,28305945,28306309,28307578,28317929,28318144,28318423,28318442,28321254,28327722,28327896,28328313,28328455,28328576,28329667,28330835,28332036,28335147,28336091,28337006,28337806,28338274,28339001,28339133,28342769,28343003,28344646,28345026,28345227,28347019,28347323,28347377,28347396,28347406,28347435,28347449,28347476,28347570,28350134,28350322,28352372,28352807,28352822,28352919,28353000,28353043,28353160,28353458,28353658,28354022,28354057,28354110,28354159,2835420', 'assoc_port': '28088708:28089208,28089590:28090221,28089593:28090486,28089595:28090055,28089597:28170218,28146550:28288486,28146552:28288677,28146554:28288778,28146562:28148166,28148277:28157054,28148279:28301550,28148280:28301687,28148282:28298684,28148283:28299131,28148308:28298789,28150094:28307578,28150096:28337006,28150112:28332036,28153517:28153552,28153518:28339001,28154448:28330835,28156460:28328576,28156464:28156692,28156466:28321254,28163832:28338274,28180156:28181496,28180177:28181412,28180178:28181457,28180197:28186819,28180199:28181351,28180201:28181219,28180202:28186741,28180204:28180232,28180206:28180794,28180207:28327722,28186185:28327896,28187382:28187526,28187383:28335147,28195055:28347323,28195057:28345026,28195058:28344646,28195060:28195151,28204165:28204233,28204166:28342769,28204168:28343003,28207350:28345227,28211945:28347377,28211946:28347570,28211948:28347396,28218598:28347019,28218601:28218960,28220916:28347406,28220918:28347435,28220919:28347449,28220922:28347476,28220931:28221223,28224647:2822485', 'assoc_mat': '28088708:papier:4207:28089208,28089590:papier:4207:28090221,28089593:papier:4207:28090486,28089595:papier:4207:28090055,28089597:papier:4207:28170218,28146550:papier:4207:28288486,28146552:papier:4207:28288677,28146554:papier:4207:28288778,28146562:papier:4207:28148166,28148277:papier:4207:28157054,28148279:papier:4207:28301550,28148280:papier:4207:28301687,28148282:papier:4207:28298684,28148283:papier:4207:28299131,28148308:papier:4207:28298789,28150094:papier:4207:28307578,28150096:papier:4207:28337006,28150112:papier:4207:28332036,28153517:papier:4207:28153552,28153518:papier:4207:28339001,28154448:papier:4207:28330835,28156460:papier:4207:28328576,28156464:papier:4207:28156692,28156466:papier:4207:28321254,28163832:papier:4207:28338274,28180156:papier:4207:28181496,28180177:papier:4207:28181412,28180178:papier:4207:28181457,28180197:papier:4207:28186819,28180199:papier:4207:28181351,28180201:papier:4207:28181219,28180202:papier:4207:28186741,28180204:papier:4207:28180232,28180206:papier:4207:28180794,2818'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.005736430811779723, 'nb_photo': 2, 'list_port_cont': '28540468', 'assoc_port': '28540307:28540468', 'assoc_mat': '28540307:papier:3327:28540468'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0072657192207601605, 'nb_photo': 3275, 'list_port_cont': '28089853,28090152,28090382,28146657,28150560,28156754,28180296,28186434,28195379,28195886,28208088,28218841,28221541,28223992,28225870,28254715,28255090,28255344,28256401,28266216,28267525,28268355,28268669,28272170,28275372,28298721,28299078,28299382,28304455,28318242,28318600,28319470,28319938,28320441,28321010,28321389,28322765,28325744,28352418,28353021,28353309,28353523,28353852,28353954,28354631,28355244,28356782,28381423,28388649,28388999,28395828,28396197,28404052,28407141,28407709,28416312,28427266,28427960,28428009,28429018,28429186,28431208,28431771,28431904,28432439,28445028,28448037,28457324,28457898,28463139,28463272,28463344,28464073,28466029,28466778,28472097,28484851,28485257,28485525,28495699,28496204,28496545,28497004,28497815,28519238,28540478,28540762,28540836,28541482,28542119,28542514,28543116,28543346,28543769,28545334,28546030,28563826,28565453,28565826,28566243,28570941,28571770,28572342,28574958,28575591,28597912,28598164,28599124,28606086,28606277,28612977,28614014,28616103,2861671', 'assoc_port': '28089591:28090382,28089594:28090152,28089596:28089853,28146548:28146657,28150110:28150560,28156462:28156754,28180176:28186434,28180200:28180296,28195056:28195886,28195059:28195379,28204164:28208088,28218602:28218841,28220920:28221541,28220943:28223992,28225687:28225870,28254378:28255344,28254381:28255090,28254382:28256401,28254385:28254715,28265444:28266216,28265455:28267525,28268247:28268355,28268516:28268669,28271938:28272170,28275226:28275372,28298577:28299382,28298579:28299078,28298580:28298721,28304078:28304455,28317462:28321389,28317465:28321010,28317467:28320441,28317509:28319938,28317536:28318600,28317550:28318242,28318849:28319470,28318855:28322765,28325353:28325744,28348936:28352418,28352790:28353309,28352791:28353954,28352794:28353852,28352797:28353021,28353420:28353523,28354585:28354631,28355212:28355244,28356749:28356782,28381336:28381423,28388418:28388999,28388428:28388649,28395537:28396197,28395540:28395828,28403692:28404052,28406458:28407709,28406460:28407141,28415993:28416312,28427141:2842726', 'assoc_mat': '28089591:papier:3594:28090382,28089594:papier:3594:28090152,28089596:papier:3594:28089853,28146548:papier:3594:28146657,28150110:papier:3594:28150560,28156462:papier:3594:28156754,28180176:papier:3594:28186434,28180200:papier:3594:28180296,28195056:papier:3594:28195886,28195059:papier:3594:28195379,28204164:papier:3594:28208088,28218602:papier:3594:28218841,28220920:papier:3594:28221541,28220943:papier:3594:28223992,28225687:papier:3594:28225870,28254378:papier:3594:28255344,28254381:papier:3594:28255090,28254382:papier:3594:28256401,28254385:papier:3594:28254715,28265444:papier:3594:28266216,28265455:papier:3594:28267525,28268247:papier:3594:28268355,28268516:papier:3594:28268669,28271938:papier:3594:28272170,28275226:papier:3594:28275372,28298577:papier:3594:28299382,28298579:papier:3594:28299078,28298580:papier:3594:28298721,28304078:papier:3594:28304455,28317462:papier:3594:28321389,28317465:papier:3594:28321010,28317467:papier:3594:28320441,28317509:papier:3594:28319938,28317536:papier:3594:28318600,2831'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00029480760441903653, 'nb_photo': 48, 'list_port_cont': '28187521,28224851,28227998,28266567,28301546,28318139,28328567,28335148,28337813,28342764,28343015,28350132,28353003,28353169,28355398,28359721,28433729,28448303,28450491,28497752,28546655,28555855,28571544,28576802,28606369,28607172,28685714,28726978,28732277,28758087,28765688,28806230,28817580,28817686', 'assoc_port': '28148279:28301546,28156460:28328567,28187382:28187521,28187383:28335148,28204166:28342764,28204168:28343015,28224647:28224851,28225686:28227998,28249999:28350132,28266490:28266567,28298578:28359721,28317507:28318139,28325351:28337813,28352787:28353169,28352789:28353003,28355213:28355398,28433628:28433729,28447945:28448303,28449229:28450491,28497678:28497752,28546234:28546655,28555645:28555855,28571216:28571544,28576678:28576802,28605908:28607172,28605911:28606369,28685559:28685714,28722257:28726978,28731815:28732277,28743777:28758087,28765413:28765688,28798448:28806230,28817304:28817580,28817308:28817686', 'assoc_mat': '28148279:pehd:4207:28301546,28156460:pehd:4207:28328567,28187382:pehd:4207:28187521,28187383:pehd:4207:28335148,28204166:pehd:4207:28342764,28204168:pehd:4207:28343015,28224647:pehd:4207:28224851,28225686:pehd:4207:28227998,28249999:pehd:4207:28350132,28266490:pehd:4207:28266567,28298578:pehd:4207:28359721,28317507:pehd:4207:28318139,28325351:pehd:4207:28337813,28352787:pehd:4207:28353169,28352789:pehd:4207:28353003,28355213:pehd:4207:28355398,28433628:pehd:4207:28433729,28447945:pehd:4207:28448303,28449229:pehd:4207:28450491,28497678:pehd:4207:28497752,28546234:pehd:4207:28546655,28555645:pehd:4207:28555855,28571216:pehd:4207:28571544,28576678:pehd:4207:28576802,28605908:pehd:4207:28607172,28605911:pehd:4207:28606369,28685559:pehd:4207:28685714,28722257:pehd:4207:28726978,28731815:pehd:4207:28732277,28743777:pehd:4207:28758087,28765413:pehd:4207:28765688,28798448:pehd:4207:28806230,28817304:pehd:4207:28817580,28817308:pehd:4207:28817686'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003412552971291397, 'nb_photo': 18, 'list_port_cont': '28195373,28266218,28304458,28353951,28354635,28428011,28472101,28540483,28543770,28571779,28597538,28703026,28768303,28791267,28801042', 'assoc_port': '28195059:28195373,28265444:28266218,28304078:28304458,28352791:28353951,28354585:28354635,28427879:28428011,28472052:28472101,28540286:28543770,28540305:28540483,28571215:28571779,28596986:28597538,28700488:28703026,28766813:28768303,28789008:28791267,28798419:28801042', 'assoc_mat': '28195059:pehd:3594:28195373,28265444:pehd:3594:28266218,28304078:pehd:3594:28304458,28352791:pehd:3594:28353951,28354585:pehd:3594:28354635,28427879:pehd:3594:28428011,28472052:pehd:3594:28472101,28540286:pehd:3594:28543770,28540305:pehd:3594:28540483,28571215:pehd:3594:28571779,28596986:pehd:3594:28597538,28700488:pehd:3594:28703026,28766813:pehd:3594:28768303,28789008:pehd:3594:28791267,28798419:pehd:3594:28801042'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019883975327020503, 'nb_photo': 951, 'list_port_cont': '28090217,28090490,28148169,28153566,28157055,28170229,28180796,28181342,28181404,28181458,28187527,28204222,28221196,28224838,28228001,28228208,28238379,28238407,28250145,28254936,28258026,28259591,28261889,28265508,28265576,28266579,28266928,28269039,28274014,28283732,28290818,28298654,28299141,28301553,28304222,28317920,28318137,28318433,28327719,28327903,28328569,28329669,28330830,28335154,28336087,28337005,28337817,28339136,28342774,28343011,28344635,28347329,28347374,28347392,28347426,28352368,28352809,28353171,28353457,28353654,28354207,28355394,28356519,28356916,28357745,28359571,28359719,28360088,28360818,28362037,28362171,28362351,28363732,28364037,28364101,28364123,28383194,28386576,28388826,28389025,28389328,28389372,28395575,28405052,28409798,28410526,28414113,28424647,28425909,28427172,28428747,28428997,28429918,28431800,28431821,28432839,28433722,28433738,28437624,28448306,28450483,28452446,28458616,28462881,28468186,28470008,28470164,28470716,28472067,28482214,28484689,28485462,28497693,2849775', 'assoc_port': '28089590:28090217,28089593:28090490,28089597:28170229,28146562:28148169,28148277:28157055,28148279:28301553,28148283:28299141,28150096:28337005,28153517:28153566,28154448:28330830,28156460:28328569,28180177:28181404,28180178:28181458,28180199:28181342,28180206:28180796,28180207:28327719,28186185:28327903,28187382:28187527,28187383:28335154,28195055:28347329,28195058:28344635,28204165:28204222,28204166:28342774,28204168:28343011,28211945:28347374,28211948:28347392,28220918:28347426,28220931:28221196,28224647:28224838,28225682:28228208,28225686:28228001,28238295:28238407,28238299:28238379,28250001:28250145,28254380:28254936,28257885:28258026,28259203:28259591,28261834:28261889,28265470:28265576,28265471:28265508,28266489:28266928,28266490:28266579,28268496:28354207,28268498:28269039,28271937:28290818,28271939:28274014,28283585:28283732,28298578:28359719,28298584:28298654,28299784:28360088,28304079:28360818,28304082:28304222,28317463:28362037,28317487:28318433,28317507:28318137,28317521:28317920,28318847:2836217', 'assoc_mat': '28089590:pet_clair:4207:28090217,28089593:pet_clair:4207:28090490,28089597:pet_clair:4207:28170229,28146562:pet_clair:4207:28148169,28148277:pet_clair:4207:28157055,28148279:pet_clair:4207:28301553,28148283:pet_clair:4207:28299141,28150096:pet_clair:4207:28337005,28153517:pet_clair:4207:28153566,28154448:pet_clair:4207:28330830,28156460:pet_clair:4207:28328569,28180177:pet_clair:4207:28181404,28180178:pet_clair:4207:28181458,28180199:pet_clair:4207:28181342,28180206:pet_clair:4207:28180796,28180207:pet_clair:4207:28327719,28186185:pet_clair:4207:28327903,28187382:pet_clair:4207:28187527,28187383:pet_clair:4207:28335154,28195055:pet_clair:4207:28347329,28195058:pet_clair:4207:28344635,28204165:pet_clair:4207:28204222,28204166:pet_clair:4207:28342774,28204168:pet_clair:4207:28343011,28211945:pet_clair:4207:28347374,28211948:pet_clair:4207:28347392,28220918:pet_clair:4207:28347426,28220931:pet_clair:4207:28221196,28224647:pet_clair:4207:28224838,28225682:pet_clair:4207:28228208,28225686:pet_clair:4207:28228001,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8702991828304787, 'nb_photo': 85, 'list_port_cont': '28540466', 'assoc_port': '28540307:28540466', 'assoc_mat': '28540307:pet_clair:3327:28540466'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07762241589606983, 'nb_photo': 2677, 'list_port_cont': '28089854,28090160,28090381,28146663,28150562,28156758,28180288,28186425,28195372,28195891,28208079,28218840,28221542,28224000,28225872,28254709,28255089,28255346,28256402,28259461,28266215,28267519,28268350,28268675,28272167,28275366,28298717,28299073,28299387,28304454,28318237,28318608,28319472,28319937,28320443,28321003,28321388,28322773,28325748,28352421,28353017,28353314,28353528,28353856,28353950,28354639,28355241,28356788,28381424,28388653,28389003,28395832,28396202,28404056,28407143,28407703,28416321,28427274,28427955,28428010,28429012,28429176,28431205,28431778,28431898,28432436,28445035,28448036,28457325,28457899,28463142,28463280,28463337,28464075,28466026,28466774,28472098,28484850,28485263,28485527,28495703,28496198,28496554,28497005,28497816,28519241,28540484,28540753,28540832,28541488,28542122,28542516,28543122,28543351,28543764,28545337,28546027,28563821,28565451,28565831,28566254,28570945,28571776,28572339,28574960,28575596,28597537,28597915,28598173,28599114,28606079,28606278,28612979,2861400', 'assoc_port': '28089591:28090381,28089594:28090160,28089596:28089854,28146548:28146663,28150110:28150562,28156462:28156758,28180176:28186425,28180200:28180288,28195056:28195891,28195059:28195372,28204164:28208079,28218602:28218840,28220920:28221542,28220943:28224000,28225687:28225872,28254378:28255346,28254381:28255089,28254382:28256402,28254385:28254709,28259204:28259461,28265444:28266215,28265455:28267519,28268247:28268350,28268516:28268675,28271938:28272167,28275226:28275366,28298577:28299387,28298579:28299073,28298580:28298717,28304078:28304454,28317462:28321388,28317465:28321003,28317467:28320443,28317509:28319937,28317536:28318608,28317550:28318237,28318849:28319472,28318855:28322773,28325353:28325748,28348936:28352421,28352790:28353314,28352791:28353950,28352794:28353856,28352797:28353017,28353420:28353528,28354585:28354639,28355212:28355241,28356749:28356788,28381336:28381424,28388418:28389003,28388428:28388653,28395537:28396202,28395540:28395832,28403692:28404056,28406458:28407703,28406460:28407143,28415993:2841632', 'assoc_mat': '28089591:pet_clair:3594:28090381,28089594:pet_clair:3594:28090160,28089596:pet_clair:3594:28089854,28146548:pet_clair:3594:28146663,28150110:pet_clair:3594:28150562,28156462:pet_clair:3594:28156758,28180176:pet_clair:3594:28186425,28180200:pet_clair:3594:28180288,28195056:pet_clair:3594:28195891,28195059:pet_clair:3594:28195372,28204164:pet_clair:3594:28208079,28218602:pet_clair:3594:28218840,28220920:pet_clair:3594:28221542,28220943:pet_clair:3594:28224000,28225687:pet_clair:3594:28225872,28254378:pet_clair:3594:28255346,28254381:pet_clair:3594:28255089,28254382:pet_clair:3594:28256402,28254385:pet_clair:3594:28254709,28259204:pet_clair:3594:28259461,28265444:pet_clair:3594:28266215,28265455:pet_clair:3594:28267519,28268247:pet_clair:3594:28268350,28268516:pet_clair:3594:28268675,28271938:pet_clair:3594:28272167,28275226:pet_clair:3594:28275366,28298577:pet_clair:3594:28299387,28298579:pet_clair:3594:28299073,28298580:pet_clair:3594:28298717,28304078:pet_clair:3594:28304454,28317462:pet_clair:3594:28321388,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00021990845607222246, 'nb_photo': 87, 'list_port_cont': '28090493,28181347,28181452,28187523,28254937,28258023,28259603,28261928,28269027,28283731,28290831,28299132,28317926,28335150,28339124,28342765,28343000,28347427,28354167,28356528,28356813,28360091,28360422,28386583,28389026,28425900,28431803,28433714,28433742,28437610,28448312,28462877,28467789,28495578,28497748,28504326,28504603,28505971,28546648,28547446,28555852,28575017,28576943,28598088,28606360,28614566,28616620,28684439,28703649,28718960,28721843,28722018,28757709,28765696,28768510,28789111,28793267,28805542,28805922,28806549,28810314,28813601', 'assoc_port': '28089593:28090493,28148283:28299132,28180178:28181452,28180199:28181347,28187382:28187523,28187383:28335150,28204166:28342765,28204168:28343000,28220918:28347427,28254380:28254937,28257885:28258023,28259203:28259603,28261836:28261928,28268495:28354167,28268498:28269027,28271937:28290831,28283585:28283731,28299784:28360091,28304075:28360422,28317521:28317926,28325348:28356528,28339120:28339124,28356748:28356813,28385092:28386583,28388426:28389026,28425861:28425900,28431668:28431803,28433628:28433742,28433632:28433714,28437592:28437610,28447945:28448312,28462654:28462877,28467748:28467789,28495451:28504326,28495454:28504603,28495508:28495578,28497669:28505971,28497678:28497748,28541864:28547446,28546234:28546648,28555645:28555852,28574865:28575017,28576675:28576943,28596967:28598088,28605911:28606360,28612828:28614566,28616550:28616620,28676873:28684439,28700485:28703649,28718886:28721843,28718891:28722018,28718896:28718960,28743767:28757709,28765413:28765696,28768492:28768510,28789009:28793267,28789016:2878911', 'assoc_mat': '28089593:pet_fonce:4207:28090493,28148283:pet_fonce:4207:28299132,28180178:pet_fonce:4207:28181452,28180199:pet_fonce:4207:28181347,28187382:pet_fonce:4207:28187523,28187383:pet_fonce:4207:28335150,28204166:pet_fonce:4207:28342765,28204168:pet_fonce:4207:28343000,28220918:pet_fonce:4207:28347427,28254380:pet_fonce:4207:28254937,28257885:pet_fonce:4207:28258023,28259203:pet_fonce:4207:28259603,28261836:pet_fonce:4207:28261928,28268495:pet_fonce:4207:28354167,28268498:pet_fonce:4207:28269027,28271937:pet_fonce:4207:28290831,28283585:pet_fonce:4207:28283731,28299784:pet_fonce:4207:28360091,28304075:pet_fonce:4207:28360422,28317521:pet_fonce:4207:28317926,28325348:pet_fonce:4207:28356528,28339120:pet_fonce:4207:28339124,28356748:pet_fonce:4207:28356813,28385092:pet_fonce:4207:28386583,28388426:pet_fonce:4207:28389026,28425861:pet_fonce:4207:28425900,28431668:pet_fonce:4207:28431803,28433628:pet_fonce:4207:28433742,28433632:pet_fonce:4207:28433714,28437592:pet_fonce:4207:28437610,28447945:pet_fonce:4207:28448312,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.014294082572562015, 'nb_photo': 2, 'list_port_cont': '28540463', 'assoc_port': '28540307:28540463', 'assoc_mat': '28540307:pet_fonce:3327:28540463'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003313185439799291, 'nb_photo': 48, 'list_port_cont': '28208085,28223996,28266214,28319477,28325754,28353311,28356791,28396198,28427273,28431770,28431897,28457902,28463275,28472102,28484843,28485266,28540760,28543765,28571771,28597908,28614017,28661071,28677954,28700398,28700947,28703020,28720027,28744409,28759214,28790486,28800649,28801041', 'assoc_port': '28204164:28208085,28220943:28223996,28265444:28266214,28318849:28319477,28325353:28325754,28352790:28353311,28356749:28356791,28395537:28396198,28427141:28427273,28431664:28431897,28431669:28431770,28457119:28457902,28463065:28463275,28472052:28472102,28484569:28485266,28484571:28484843,28540286:28543765,28540300:28540760,28571215:28571771,28596970:28597908,28612812:28614017,28657578:28661071,28677782:28677954,28699663:28700398,28700487:28700947,28700488:28703020,28718887:28720027,28743775:28744409,28759074:28759214,28789015:28790486,28798419:28801041,28798422:28800649', 'assoc_mat': '28204164:pet_fonce:3594:28208085,28220943:pet_fonce:3594:28223996,28265444:pet_fonce:3594:28266214,28318849:pet_fonce:3594:28319477,28325353:pet_fonce:3594:28325754,28352790:pet_fonce:3594:28353311,28356749:pet_fonce:3594:28356791,28395537:pet_fonce:3594:28396198,28427141:pet_fonce:3594:28427273,28431664:pet_fonce:3594:28431897,28431669:pet_fonce:3594:28431770,28457119:pet_fonce:3594:28457902,28463065:pet_fonce:3594:28463275,28472052:pet_fonce:3594:28472102,28484569:pet_fonce:3594:28485266,28484571:pet_fonce:3594:28484843,28540286:pet_fonce:3594:28543765,28540300:pet_fonce:3594:28540760,28571215:pet_fonce:3594:28571771,28596970:pet_fonce:3594:28597908,28612812:pet_fonce:3594:28614017,28657578:pet_fonce:3594:28661071,28677782:pet_fonce:3594:28677954,28699663:pet_fonce:3594:28700398,28700487:pet_fonce:3594:28700947,28700488:pet_fonce:3594:28703020,28718887:pet_fonce:3594:28720027,28743775:pet_fonce:3594:28744409,28759074:pet_fonce:3594:28759214,28789015:pet_fonce:3594:28790486,28798419:pet_fonce:3594:28801041,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0050734853131264345, 'nb_photo': 2, 'list_port_cont': '28353476,28406633', 'assoc_port': '28353422:28353476,28406456:28406633', 'assoc_mat': '28353422:pet_opaque:4461:28353476,28406456:pet_opaque:4461:28406633'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0017315271405296557, 'nb_photo': 314, 'list_port_cont': '28089204,28090081,28148159,28181463,28187516,28218967,28221204,28224852,28228205,28238381,28250146,28258021,28259598,28261937,28266570,28269032,28283745,28288676,28290821,28298680,28298786,28299140,28318141,28318420,28327898,28328459,28328570,28330831,28335153,28337814,28338995,28342760,28344644,28345230,28347372,28347441,28350324,28352837,28353161,28353456,28354157,28355386,28356532,28357059,28357738,28359567,28359642,28359726,28359885,28360408,28361827,28363743,28364047,28382997,28388813,28389369,28395585,28404011,28410530,28414114,28424685,28425890,28425898,28427177,28428771,28429817,28431795,28432372,28433715,28433744,28448311,28449464,28452440,28452479,28452489,28458606,28462869,28467792,28470014,28470729,28472061,28482224,28485377,28495546,28497757,28500637,28504599,28505980,28506873,28540611,28542816,28543468,28543880,28546645,28547017,28547622,28547814,28564185,28570241,28570818,28571521,28571537,28574902,28574987,28575748,28576442,28576728,28576800,28576940,28581346,28605978,28606372,28607164,2861455', 'assoc_port': '28088708:28089204,28089595:28090081,28146552:28288676,28146562:28148159,28148282:28298680,28148283:28299140,28148308:28298786,28153518:28338995,28154448:28330831,28156460:28328570,28180178:28181463,28186185:28327898,28187382:28187516,28187383:28335153,28195058:28344644,28204166:28342760,28207350:28345230,28211945:28347372,28218601:28218967,28220918:28347441,28220931:28221204,28224647:28224852,28225682:28228205,28238299:28238381,28250000:28350324,28250001:28250146,28257885:28258021,28259203:28259598,28261836:28261937,28266490:28266570,28268495:28354157,28268498:28269032,28271937:28290821,28283585:28283745,28298576:28359642,28298578:28359726,28298582:28359885,28304075:28360408,28317456:28361827,28317471:28318420,28317507:28318141,28325348:28356532,28325351:28337814,28325357:28328459,28352787:28353161,28352796:28352837,28353423:28353456,28355213:28355386,28356745:28357059,28357715:28357738,28359465:28359567,28363709:28363743,28363980:28364047,28381333:28382997,28388415:28389369,28388427:28388813,28395542:2839558', 'assoc_mat': '28088708:pet_opaque:4207:28089204,28089595:pet_opaque:4207:28090081,28146552:pet_opaque:4207:28288676,28146562:pet_opaque:4207:28148159,28148282:pet_opaque:4207:28298680,28148283:pet_opaque:4207:28299140,28148308:pet_opaque:4207:28298786,28153518:pet_opaque:4207:28338995,28154448:pet_opaque:4207:28330831,28156460:pet_opaque:4207:28328570,28180178:pet_opaque:4207:28181463,28186185:pet_opaque:4207:28327898,28187382:pet_opaque:4207:28187516,28187383:pet_opaque:4207:28335153,28195058:pet_opaque:4207:28344644,28204166:pet_opaque:4207:28342760,28207350:pet_opaque:4207:28345230,28211945:pet_opaque:4207:28347372,28218601:pet_opaque:4207:28218967,28220918:pet_opaque:4207:28347441,28220931:pet_opaque:4207:28221204,28224647:pet_opaque:4207:28224852,28225682:pet_opaque:4207:28228205,28238299:pet_opaque:4207:28238381,28250000:pet_opaque:4207:28350324,28250001:pet_opaque:4207:28250146,28257885:pet_opaque:4207:28258021,28259203:pet_opaque:4207:28259598,28261836:pet_opaque:4207:28261937,28266490:pet_opaque:4207:28266570,2826'}, {'unwanted_material': 'plastique', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.04643993676496215, 'nb_photo': 3, 'list_port_cont': '28150227,28447994', 'assoc_port': '28150125:28150227,28447947:28447994', 'assoc_mat': '28150125:plastique:3726:28150227,28447947:plastique:3726:28447994'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.003628554788819732, 'nb_photo': 1, 'list_port_cont': '28150228', 'assoc_port': '28150125:28150228', 'assoc_mat': '28150125:Teint_Dans_La_Masse:3726:28150228'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 8.318546425201849e-05, 'nb_photo': 41, 'list_port_cont': '28148164,28181462,28228207,28238382,28335157,28353459,28354117,28357732,28360089,28363740,28431812,28432364,28433730,28482213,28497710,28504602,28505982,28525774,28547811,28607176,28657614,28677330,28684443,28685707,28700382,28700552,28706654,28726294,28732273,28757867,28764629,28798759,28805079,28806081,28817572', 'assoc_port': '28146562:28148164,28180178:28181462,28187383:28335157,28225682:28228207,28238299:28238382,28268494:28354117,28299784:28360089,28353423:28353459,28357715:28357732,28363709:28363740,28431667:28431812,28432324:28432364,28433628:28433730,28482028:28482213,28495454:28504602,28497669:28505982,28497680:28497710,28518808:28525774,28547792:28547811,28605908:28607176,28657588:28657614,28666744:28677330,28676873:28684443,28685559:28685707,28699664:28700382,28700518:28700552,28703321:28706654,28722252:28726294,28731815:28732273,28743769:28757867,28764623:28764629,28798445:28806081,28798476:28798759,28805051:28805079,28817304:28817572', 'assoc_mat': '28146562:textiles_sanitaires:4207:28148164,28180178:textiles_sanitaires:4207:28181462,28187383:textiles_sanitaires:4207:28335157,28225682:textiles_sanitaires:4207:28228207,28238299:textiles_sanitaires:4207:28238382,28268494:textiles_sanitaires:4207:28354117,28299784:textiles_sanitaires:4207:28360089,28353423:textiles_sanitaires:4207:28353459,28357715:textiles_sanitaires:4207:28357732,28363709:textiles_sanitaires:4207:28363740,28431667:textiles_sanitaires:4207:28431812,28432324:textiles_sanitaires:4207:28432364,28433628:textiles_sanitaires:4207:28433730,28482028:textiles_sanitaires:4207:28482213,28495454:textiles_sanitaires:4207:28504602,28497669:textiles_sanitaires:4207:28505982,28497680:textiles_sanitaires:4207:28497710,28518808:textiles_sanitaires:4207:28525774,28547792:textiles_sanitaires:4207:28547811,28605908:textiles_sanitaires:4207:28607176,28657588:textiles_sanitaires:4207:28657614,28666744:textiles_sanitaires:4207:28677330,28676873:textiles_sanitaires:4207:28684443,28685559:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 34016}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('refus', '2025-11', 0.09319346527949272),), (('pcnc', '2025-11', 0.019892228040303026),), (('film_pedb', '2025-11', 0.06530052907418749),), (('jrm', '2025-11', 0.21977885245164472),), (('pet_clair', '2025-11', 0.12744508323893175),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4887 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4887 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4887 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4887 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="Sevran"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4101 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4101 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4101 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4101 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3994 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3994 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3994 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3994 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11488 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11496 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11497 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11495 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11495 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11489 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11575 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11575 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11491 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11490 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11490 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11498 send_mail_cod have less outputs used (0) than in the step definition (1) : some outputs may be not used ! Step 11499 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11491 doesn't seem to be define in the database( WARNING : type of input 3 of step 11490 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11488 doesn't seem to be define in the database( WARNING : type of input 2 of step 11492 doesn't seem to be define in the database( WARNING : output 1 of step 11488 have datatype=2 whereas input 1 of step 11495 have datatype=7 WARNING : type of output 2 of step 11495 doesn't seem to be define in the database( WARNING : type of input 1 of step 11489 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11491 have datatype=10 whereas input 3 of step 11498 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11575 doesn't seem to be define in the database( WARNING : output 1 of step 11489 have datatype=7 whereas input 2 of step 11575 have datatype=None WARNING : type of output 3 of step 11575 doesn't seem to be define in the database( WARNING : type of input 1 of step 11491 doesn't seem to be define in the database( WARNING : output 0 of step 11491 have datatype=10 whereas input 0 of step 11581 have datatype=18 WARNING : type of input 5 of step 11498 doesn't seem to be define in the database( WARNING : output 0 of step 11581 have datatype=11 whereas input 5 of step 11498 have datatype=None WARNING : type of output 1 of step 11496 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : type of output 1 of step 11497 doesn't seem to be define in the database( WARNING : type of input 3 of step 11492 doesn't seem to be define in the database( WARNING : output 0 of step 11495 have datatype=1 whereas input 0 of step 11489 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4209, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'papier,background', 'hashtag_background': 'papier', 'hashtag_weights': {'barquette_opaque': 0.7, 'carton': 0.7, 'ela': 0.7, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.7, 'metal': 1.5, 'pehd': 0.7, 'pet_clair': 0.7, 'pet_opaque': 0.7, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.7}, 'ETA': 600} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3993 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3993 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3993 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3993 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4207, 'hashtag_proportion': 'barquette_opaque,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'carton,background', 'hashtag_weights': {'barquette_opaque': 1, 'ela': 1, 'etiquette': 1.0, 'film_plastique': 0.5, 'kraft': 1, 'metal': 3.0, 'papier': 1, 'pehd': 2, 'pet_clair': 2, 'pet_opaque': 2, 'textiles_sanitaires': 1.0, 'pet_fonce': 2}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3991 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3991 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3991 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3991 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11512 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11521 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11520 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11516 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11516 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11519 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11519 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11513 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11577 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11577 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11515 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11514 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11514 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11523 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11515 doesn't seem to be define in the database( WARNING : type of input 3 of step 11514 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11512 doesn't seem to be define in the database( WARNING : type of input 2 of step 11516 doesn't seem to be define in the database( WARNING : output 1 of step 11512 have datatype=2 whereas input 1 of step 11519 have datatype=7 WARNING : type of output 2 of step 11519 doesn't seem to be define in the database( WARNING : type of input 1 of step 11513 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11515 have datatype=10 whereas input 3 of step 11522 have datatype=6 WARNING : type of input 2 of step 11577 doesn't seem to be define in the database( WARNING : output 1 of step 11513 have datatype=7 whereas input 2 of step 11577 have datatype=None WARNING : type of output 3 of step 11577 doesn't seem to be define in the database( WARNING : type of input 1 of step 11515 doesn't seem to be define in the database( WARNING : output 0 of step 11515 have datatype=10 whereas input 0 of step 11583 have datatype=18 WARNING : type of input 5 of step 11522 doesn't seem to be define in the database( WARNING : output 0 of step 11583 have datatype=11 whereas input 5 of step 11522 have datatype=None WARNING : type of output 1 of step 11521 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : type of output 1 of step 11520 doesn't seem to be define in the database( WARNING : type of input 3 of step 11516 doesn't seem to be define in the database( WARNING : output 0 of step 11519 have datatype=1 whereas input 0 of step 11513 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4203, 'hashtag_proportion': 'barquette_opaque,carton,etiquette,film_plastique,kraft,metal,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'ela,background', 'hashtag_background': 'ela', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1, 'etiquette': 0.5, 'film_plastique': 0.5, 'kraft': 0.8, 'metal': 2, 'papier': 0.8, 'pehd': 0.8, 'pet_clair': 0.8, 'pet_opaque': 0.8, 'textiles_sanitaires': 0.5, 'pet_fonce': 0.8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3804 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3804 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3804 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3804 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11560 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11567 mask_detect have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11567 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11563 crop_condition is not consistent : 4 used against 2 in the step definition ! Step 11563 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11564 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11564 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11565 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11573 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11573 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11568 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11566 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11566 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 1 of step 11560 have datatype=2 whereas input 1 of step 11564 have datatype=7 WARNING : type of output 2 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11565 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11567 doesn't seem to be define in the database( WARNING : type of input 3 of step 11563 doesn't seem to be define in the database( WARNING : type of output 3 of step 11564 doesn't seem to be define in the database( WARNING : type of input 1 of step 11568 doesn't seem to be define in the database( WARNING : type of output 1 of step 11568 doesn't seem to be define in the database( WARNING : type of input 3 of step 11566 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11570 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of input 2 of step 11563 doesn't seem to be define in the database( WARNING : output 0 of step 11569 have datatype=6 whereas input 2 of step 11563 have datatype=None WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11570 doesn't seem to be define in the database( WARNING : type of output 2 of step 11560 doesn't seem to be define in the database( WARNING : type of input 1 of step 11569 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11568 have datatype=10 whereas input 3 of step 11571 have datatype=6 WARNING : type of input 2 of step 11573 doesn't seem to be define in the database( WARNING : output 1 of step 11565 have datatype=7 whereas input 2 of step 11573 have datatype=None WARNING : type of output 3 of step 11573 doesn't seem to be define in the database( WARNING : type of input 3 of step 11568 doesn't seem to be define in the database( WARNING : output 0 of step 11568 have datatype=10 whereas input 0 of step 11587 have datatype=18 WARNING : type of input 5 of step 11571 doesn't seem to be define in the database( WARNING : output 0 of step 11587 have datatype=11 whereas input 5 of step 11571 have datatype=None WARNING : output 0 of step 11564 have datatype=1 whereas input 0 of step 11565 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3327, 'hashtag_proportion': 'autre,carton,metal,papier,pehd,pet_fonce', 'hashtag_parmi': 'pet_clair,bouchon,etiquette,barquette_avec_film,background', 'hashtag_background': 'pet_clair', 'hashtag_weights': {'autre': 8.0, 'barquette_avec_film': 6, 'carton': 8.0, 'metal': 12, 'papier': 5, 'pehd': 8, 'pet_fonce': 8, 'bouchon': 8, 'etiquette': 8}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4322 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4322 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4322 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4322 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11978 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11987 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11986 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11982 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11982 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11985 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11985 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11979 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11990 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11990 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11981 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11980 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11980 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11989 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11981 doesn't seem to be define in the database( WARNING : type of input 3 of step 11980 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11978 doesn't seem to be define in the database( WARNING : type of input 2 of step 11982 doesn't seem to be define in the database( WARNING : output 1 of step 11978 have datatype=2 whereas input 1 of step 11985 have datatype=7 WARNING : type of output 2 of step 11985 doesn't seem to be define in the database( WARNING : type of input 1 of step 11979 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11981 have datatype=10 whereas input 3 of step 11988 have datatype=6 WARNING : type of input 2 of step 11990 doesn't seem to be define in the database( WARNING : output 1 of step 11979 have datatype=7 whereas input 2 of step 11990 have datatype=None WARNING : type of output 3 of step 11990 doesn't seem to be define in the database( WARNING : type of input 1 of step 11981 doesn't seem to be define in the database( WARNING : output 0 of step 11981 have datatype=10 whereas input 0 of step 11991 have datatype=18 WARNING : type of input 5 of step 11988 doesn't seem to be define in the database( WARNING : output 0 of step 11991 have datatype=11 whereas input 5 of step 11988 have datatype=None WARNING : type of output 1 of step 11987 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : type of output 1 of step 11986 doesn't seem to be define in the database( WARNING : type of input 3 of step 11982 doesn't seem to be define in the database( WARNING : output 0 of step 11985 have datatype=1 whereas input 0 of step 11979 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4461, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,pehd,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'film_plastique', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3995 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3995 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3995 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3995 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11524 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11533 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11532 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11528 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11528 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11531 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11531 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11525 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11578 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11578 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11527 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11526 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11526 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11535 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11527 doesn't seem to be define in the database( WARNING : type of input 3 of step 11526 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11524 doesn't seem to be define in the database( WARNING : type of input 2 of step 11528 doesn't seem to be define in the database( WARNING : output 1 of step 11524 have datatype=2 whereas input 1 of step 11531 have datatype=7 WARNING : type of output 2 of step 11531 doesn't seem to be define in the database( WARNING : type of input 1 of step 11525 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11527 have datatype=10 whereas input 3 of step 11534 have datatype=6 WARNING : type of input 2 of step 11578 doesn't seem to be define in the database( WARNING : output 1 of step 11525 have datatype=7 whereas input 2 of step 11578 have datatype=None WARNING : type of output 3 of step 11578 doesn't seem to be define in the database( WARNING : type of input 1 of step 11527 doesn't seem to be define in the database( WARNING : output 0 of step 11527 have datatype=10 whereas input 0 of step 11584 have datatype=18 WARNING : type of input 5 of step 11534 doesn't seem to be define in the database( WARNING : output 0 of step 11584 have datatype=11 whereas input 5 of step 11534 have datatype=None WARNING : type of output 1 of step 11533 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : type of output 1 of step 11532 doesn't seem to be define in the database( WARNING : type of input 3 of step 11528 doesn't seem to be define in the database( WARNING : output 0 of step 11531 have datatype=1 whereas input 0 of step 11525 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4211, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,metal,papier,pet_fonce,pet_clair,pet_opaque,textiles_sanitaires', 'hashtag_parmi': 'pehd,background', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 0.3, 'ela': 0.3, 'etiquette': 0.1, 'film_plastique': 0.1, 'kraft': 0.3, 'metal': 1.5, 'papier': 0.3, 'pet_clair': 0.3, 'pet_opaque': 0.3, 'textiles_sanitaires': 0.3, 'pet_fonce': 0.3, 'background': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4153 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4153 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4153 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4153 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11548 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11556 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11557 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11552 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11552 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11555 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11555 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11549 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11580 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11580 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11551 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11550 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11550 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11559 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11551 doesn't seem to be define in the database( WARNING : type of input 3 of step 11550 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11548 doesn't seem to be define in the database( WARNING : type of input 2 of step 11552 doesn't seem to be define in the database( WARNING : output 1 of step 11548 have datatype=2 whereas input 1 of step 11555 have datatype=7 WARNING : type of output 2 of step 11555 doesn't seem to be define in the database( WARNING : type of input 1 of step 11549 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11551 have datatype=10 whereas input 3 of step 11558 have datatype=6 WARNING : type of input 2 of step 11580 doesn't seem to be define in the database( WARNING : output 1 of step 11549 have datatype=7 whereas input 2 of step 11580 have datatype=None WARNING : type of output 3 of step 11580 doesn't seem to be define in the database( WARNING : type of input 1 of step 11551 doesn't seem to be define in the database( WARNING : output 0 of step 11551 have datatype=10 whereas input 0 of step 11586 have datatype=18 WARNING : type of input 5 of step 11558 doesn't seem to be define in the database( WARNING : output 0 of step 11586 have datatype=11 whereas input 5 of step 11558 have datatype=None WARNING : type of output 1 of step 11556 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : type of output 1 of step 11557 doesn't seem to be define in the database( WARNING : type of input 3 of step 11552 doesn't seem to be define in the database( WARNING : output 0 of step 11555 have datatype=1 whereas input 0 of step 11549 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4200, 'hashtag_proportion': 'carton,ela,etiquette,film_plastique,kraft,metal,papier,pehd,pet_opaque,textiles_sanitaires,barquette_opaque,pet_clair', 'hashtag_parmi': 'pet_fonce,background', 'hashtag_weights': {'barquette_opaque': 1.5, 'carton': 2.5, 'ela': 1.5, 'etiquette': 1.5, 'film_plastique': 1, 'kraft': 1.5, 'metal': 3.0, 'papier': 1.2, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3992 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3992 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3992 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3992 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11536 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11545 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11544 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11540 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11540 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11543 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11543 merge_mask_thcl_custom have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 11537 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11579 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11579 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11539 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11538 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11538 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11547 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11539 doesn't seem to be define in the database( WARNING : type of input 3 of step 11538 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11536 doesn't seem to be define in the database( WARNING : type of input 2 of step 11540 doesn't seem to be define in the database( WARNING : output 1 of step 11536 have datatype=2 whereas input 1 of step 11543 have datatype=7 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11539 have datatype=10 whereas input 3 of step 11546 have datatype=6 WARNING : type of input 2 of step 11579 doesn't seem to be define in the database( WARNING : output 1 of step 11537 have datatype=7 whereas input 2 of step 11579 have datatype=None WARNING : type of output 3 of step 11579 doesn't seem to be define in the database( WARNING : type of input 1 of step 11539 doesn't seem to be define in the database( WARNING : output 0 of step 11539 have datatype=10 whereas input 0 of step 11585 have datatype=18 WARNING : type of input 5 of step 11546 doesn't seem to be define in the database( WARNING : output 0 of step 11585 have datatype=11 whereas input 5 of step 11546 have datatype=None WARNING : type of output 1 of step 11545 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : type of output 1 of step 11544 doesn't seem to be define in the database( WARNING : type of input 3 of step 11540 doesn't seem to be define in the database( WARNING : output 0 of step 11543 have datatype=1 whereas input 0 of step 11537 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4205, 'hashtag_proportion': 'barquette_opaque,carton,ela,etiquette,film_plastique,kraft,papier,pehd,pet_clair,pet_opaque,textiles_sanitaires,pet_fonce', 'hashtag_parmi': 'metal,background', 'hashtag_background': 'metal', 'hashtag_weights': {'barquette_opaque': 1, 'carton': 1.5, 'ela': 1.5, 'etiquette': 1, 'film_plastique': 1, 'kraft': 1, 'papier': 1, 'pehd': 1.5, 'pet_clair': 1.5, 'pet_opaque': 1.5, 'textiles_sanitaires': 1.5, 'pet_fonce': 1.5}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3318 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3318 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3318 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3318 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 7928 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 8092 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 8092 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7933 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 7935 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 7934 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 7934 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13649 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 9283 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 7935 doesn't seem to be define in the database( WARNING : type of input 3 of step 7934 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 1 of step 7935 doesn't seem to be define in the database( WARNING : output 1 of step 7933 have datatype=7 whereas input 1 of step 7935 have datatype=None WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 2 of step 8092 doesn't seem to be define in the database( WARNING : type of output 3 of step 8092 doesn't seem to be define in the database( WARNING : type of input 1 of step 7933 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10917 doesn't seem to be define in the database( WARNING : type of output 2 of step 7928 doesn't seem to be define in the database( WARNING : type of input 1 of step 10918 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 7935 have datatype=10 whereas input 3 of step 10916 have datatype=6 WARNING : output 0 of step 7935 have datatype=10 whereas input 0 of step 13649 have datatype=18 WARNING : type of output 1 of step 13649 doesn't seem to be define in the database( WARNING : type of input 5 of step 10916 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3594, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus,background', 'hashtag_weights': {'papier': 1, 'carton': 1, 'metal': 1, 'pet_clair': 1, 'autre': 1, 'pehd': 1, 'pet_fonce': 1, 'refus': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((34016,),), 'unwanted_material_monthly_percentage': ((0.029106531134711667,),), 'material_repartition': (('pcnc', 28881), ('refus', 2750), ('film_pedb', 2356), ('jrm', 19), ('pet_clair', 10)), 'material_dict': {'pcnc': 28881, 'refus': 2750, 'film_pedb': 2356, 'autres': 29}, 'coverage_data': (('2025/11/22/', 0.0), ('2025/11/21/', 0.0), ('2025/11/20/', 0.0), ('2025/11/19/', 0.0), ('2025/11/18/', 0.0), ('2025/11/17/', 0.0), ('2025/11/15/', 0.0), ('2025/11/14/', 0.0), ('2025/11/13/', 0.0), ('2025/11/12/', 0.0), ('2025/11/11/', 0.0), ('2025/11/10/', 0.0), ('2025/11/08/', 0.0), ('2025/11/07/', 0.0), ('2025/11/06/', 0.0), ('2025/11/05/', 0.0), ('2025/11/04/', 0.0), ('2025/11/03/', 0.0), ('2025/11/01/', 0.0)), 'impurety_average_data': ((datetime.date(2025, 11, 2), 0.0, 8), (datetime.date(2025, 11, 3), 0.03885690324798023, 26), (datetime.date(2025, 11, 4), 0.027689626634126076, 38), (datetime.date(2025, 11, 5), 0.03603595888514179, 113), (datetime.date(2025, 11, 6), 0.029067339865345973, 22), (datetime.date(2025, 11, 7), 0.03359347096026605, 57), (datetime.date(2025, 11, 8), 0.03317294891785054, 10), (datetime.date(2025, 11, 10), 0.021062381330278837, 47), (datetime.date(2025, 11, 11), 0.0227421188768574, 43), (datetime.date(2025, 11, 12), 0.03308737651317219, 18), (datetime.date(2025, 11, 13), 0.02874753989238981, 245), (datetime.date(2025, 11, 14), 0.03116121902415886, 135), (datetime.date(2025, 11, 15), 0.022933760958828604, 172), (datetime.date(2025, 11, 17), 0.02524500721031865, 20), (datetime.date(2025, 11, 18), 0.033101546980552524, 121), (datetime.date(2025, 11, 19), 0.029772667630833485, 35), (datetime.date(2025, 11, 20), 0.029160536989066264, 29), (datetime.date(2025, 11, 21), 0.0354015343154964, 12), (datetime.date(2025, 11, 22), 0.02623713140099201, 14)), 'impurety_average_data_per_hashtag': {'refus': ((datetime.date(2025, 11, 2), 0.0, 8), (datetime.date(2025, 11, 3), 0.17223479887508128, 10), (datetime.date(2025, 11, 4), 0.04918995339328793, 13), (datetime.date(2025, 11, 5), 0.0822234024731969, 10), (datetime.date(2025, 11, 6), 0.09765133919702343, 17), (datetime.date(2025, 11, 7), 0.12041315274964635, 9), (datetime.date(2025, 11, 8), 0.06613166330115577, 10), (datetime.date(2025, 11, 10), 0.10079894565137869, 48), (datetime.date(2025, 11, 11), 0.07924323681619837, 17), (datetime.date(2025, 11, 12), 0.12700833059622124, 10), (datetime.date(2025, 11, 13), 0.09215495932130044, 12), (datetime.date(2025, 11, 14), 0.08106398996564437, 14), (datetime.date(2025, 11, 15), 0.08769219607961888, 12), (datetime.date(2025, 11, 17), 0.08548305852482065, 12), (datetime.date(2025, 11, 18), 0.0983068703576516, 17), (datetime.date(2025, 11, 19), 0.10486871572352564, 10), (datetime.date(2025, 11, 20), 0.07442924426891906, 10), (datetime.date(2025, 11, 21), 0.10202495464214215, 8), (datetime.date(2025, 11, 22), 0.060933680468401384, 9)), 'pcnc': ((datetime.date(2025, 11, 3), 0.018376292714903632, 26), (datetime.date(2025, 11, 4), 0.02248613608160587, 38), (datetime.date(2025, 11, 5), 0.03208776375494247, 113), (datetime.date(2025, 11, 6), 0.018940554441546527, 22), (datetime.date(2025, 11, 7), 0.021361044359133167, 57), (datetime.date(2025, 11, 8), 0.02419724915438273, 10), (datetime.date(2025, 11, 10), 0.012331604246799098, 47), (datetime.date(2025, 11, 11), 0.018039188531079203, 43), (datetime.date(2025, 11, 12), 0.018024124793930327, 18), (datetime.date(2025, 11, 13), 0.015561038184130332, 245), (datetime.date(2025, 11, 14), 0.01921906876678507, 135), (datetime.date(2025, 11, 15), 0.01380305787737808, 172), (datetime.date(2025, 11, 17), 0.017880513891065403, 20), (datetime.date(2025, 11, 18), 0.023992668117408304, 121), (datetime.date(2025, 11, 19), 0.015615017766205587, 35), (datetime.date(2025, 11, 20), 0.021798220833274064, 29), (datetime.date(2025, 11, 21), 0.027192648551095554, 12), (datetime.date(2025, 11, 22), 0.016269978778360318, 14)), 'film_pedb': ((datetime.date(2025, 11, 3), 0.036045211402087496, 18), (datetime.date(2025, 11, 4), 0.07188641620050677, 8), (datetime.date(2025, 11, 5), 0.05181008970991932, 16), (datetime.date(2025, 11, 6), 0.0651404168403607, 9), (datetime.date(2025, 11, 7), 0.06737738978848434, 8), (datetime.date(2025, 11, 8), 0.07948072748854598, 11), (datetime.date(2025, 11, 10), 0.05825493902436287, 36), (datetime.date(2025, 11, 11), 0.04735955796717856, 14), (datetime.date(2025, 11, 12), 0.07296076752757662, 32), (datetime.date(2025, 11, 13), 0.07665899946871099, 29), (datetime.date(2025, 11, 14), 0.05089258195428874, 29), (datetime.date(2025, 11, 15), 0.07360974237128368, 10), (datetime.date(2025, 11, 17), 0.04543650659649865, 12), (datetime.date(2025, 11, 18), 0.049891890169635605, 10), (datetime.date(2025, 11, 19), 0.06862712844590127, 12), (datetime.date(2025, 11, 20), 0.07173187433056354, 14), (datetime.date(2025, 11, 21), 0.0715224373128363, 10), (datetime.date(2025, 11, 22), 0.07589137781698364, 17)), 'jrm': ((datetime.date(2025, 11, 4), 0.26552927105724483, 8), (datetime.date(2025, 11, 12), 0.186505820738481, 11)), 'pet_clair': ((datetime.date(2025, 11, 14), 0.12744508323893175, 10),)}, 'quality_array': [['14.383313339963301', '02112025'], ['0.761307748004206', '03112025'], ['0.9877882405483445', '04112025'], ['1.4361209710121305', '05112025'], ['1.0840399937901626', '06112025'], ['0.8824032397657048', '07112025'], ['0.6655537054776379', '08112025'], ['0.8626215986625264', '10112025'], ['1.159297149270686', '11112025'], ['0.8010613358891142', '12112025'], ['0.9939078005903749', '13112025'], ['0.9751028304287332', '14112025'], ['1.2153296902493782', '15112025'], ['1.0988930915272574', '17112025'], ['1.0540595270973883', '18112025'], ['0.9869396923995979', '19112025'], ['0.9634373727168439', '20112025'], ['0.9809584709876678', '21112025'], ['0.3382006283926294', '22112025']], 'number_of_batch': ((736,),), 'datou_id_sts': 4101, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.008550660849840378, 'nb_photo': 4, 'list_port_cont': '28540474', 'assoc_port': '28540307:28540474', 'assoc_mat': '28540307:autre:3327:28540474'}, {'unwanted_material': 'autre', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0013393891209683222, 'nb_photo': 267, 'list_port_cont': '28089862,28146655,28150563,28156756,28180291,28186429,28195380,28195893,28208080,28218833,28221547,28223990,28256398,28266213,28268667,28272173,28275371,28298716,28299388,28318610,28319475,28320449,28322771,28325745,28353026,28353522,28353855,28353949,28354633,28355245,28356789,28381419,28395829,28396199,28404050,28407704,28416315,28427271,28429017,28429178,28431202,28431774,28431905,28445031,28448034,28457906,28463148,28463281,28463343,28464078,28466775,28472096,28484852,28485259,28485521,28495695,28496197,28496556,28497009,28540477,28540758,28541486,28542515,28543348,28543772,28546024,28565452,28565827,28566250,28571778,28574962,28575593,28597531,28598170,28599116,28606285,28612981,28614016,28616100,28616709,28622350,28623064,28650875,28657645,28658413,28661072,28667019,28677951,28686013,28699916,28700404,28701239,28703030,28707265,28708616,28742902,28743943,28759212,28765506,28765701,28768302,28790487,28799760,28800653,28801037,28813585,28817348', 'assoc_port': '28089596:28089862,28146548:28146655,28150110:28150563,28156462:28156756,28180176:28186429,28180200:28180291,28195056:28195893,28195059:28195380,28204164:28208080,28218602:28218833,28220920:28221547,28220943:28223990,28254382:28256398,28265444:28266213,28268516:28268667,28271938:28272173,28275226:28275371,28298577:28299388,28298580:28298716,28317467:28320449,28317536:28318610,28318849:28319475,28318855:28322771,28325353:28325745,28352791:28353949,28352794:28353855,28352797:28353026,28353420:28353522,28354585:28354633,28355212:28355245,28356749:28356789,28381336:28381419,28395537:28396199,28395540:28395829,28403692:28404050,28406458:28407704,28415993:28416315,28427141:28427271,28428916:28429178,28428919:28429017,28429804:28431202,28431664:28431905,28431669:28431774,28442120:28445031,28447946:28448034,28457119:28457906,28463061:28466775,28463063:28464078,28463064:28463343,28463065:28463281,28463067:28463148,28472052:28472096,28484569:28485259,28484571:28484852,28485361:28485521,28495449:28497009,28495453:2849655', 'assoc_mat': '28089596:autre:3594:28089862,28146548:autre:3594:28146655,28150110:autre:3594:28150563,28156462:autre:3594:28156756,28180176:autre:3594:28186429,28180200:autre:3594:28180291,28195056:autre:3594:28195893,28195059:autre:3594:28195380,28204164:autre:3594:28208080,28218602:autre:3594:28218833,28220920:autre:3594:28221547,28220943:autre:3594:28223990,28254382:autre:3594:28256398,28265444:autre:3594:28266213,28268516:autre:3594:28268667,28271938:autre:3594:28272173,28275226:autre:3594:28275371,28298577:autre:3594:28299388,28298580:autre:3594:28298716,28317467:autre:3594:28320449,28317536:autre:3594:28318610,28318849:autre:3594:28319475,28318855:autre:3594:28322771,28325353:autre:3594:28325745,28352791:autre:3594:28353949,28352794:autre:3594:28353855,28352797:autre:3594:28353026,28353420:autre:3594:28353522,28354585:autre:3594:28354633,28355212:autre:3594:28355245,28356749:autre:3594:28356789,28381336:autre:3594:28381419,28395537:autre:3594:28396199,28395540:autre:3594:28395829,28403692:autre:3594:28404050,28406458:'}, {'unwanted_material': 'autre_refus', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.009417491015240835, 'nb_photo': 1, 'list_port_cont': '28150224', 'assoc_port': '28150125:28150224', 'assoc_mat': '28150125:autre_refus:3726:28150224'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004456384039622031, 'nb_photo': 15, 'list_port_cont': '28156650,28388697,28406630,28462791,28497863,28542264,28574922,28706828,28752414,28759189,28789138,28798838,28799409', 'assoc_port': '28156465:28156650,28388421:28388697,28406456:28406630,28462656:28462791,28497674:28497863,28541862:28542264,28574866:28574922,28700517:28706828,28743771:28752414,28759072:28759189,28789023:28789138,28798432:28799409,28798464:28798838', 'assoc_mat': '28156465:barquette_opaque:4461:28156650,28388421:barquette_opaque:4461:28388697,28406456:barquette_opaque:4461:28406630,28462656:barquette_opaque:4461:28462791,28497674:barquette_opaque:4461:28497863,28541862:barquette_opaque:4461:28542264,28574866:barquette_opaque:4461:28574922,28700517:barquette_opaque:4461:28706828,28743771:barquette_opaque:4461:28752414,28759072:barquette_opaque:4461:28759189,28789023:barquette_opaque:4461:28789138,28798432:barquette_opaque:4461:28799409,28798464:barquette_opaque:4461:28798838'}, {'unwanted_material': 'barquette_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0010174151471107626, 'nb_photo': 2353, 'list_port_cont': '28089207,28090069,28090230,28090498,28148156,28153567,28156684,28157056,28170227,28181232,28181350,28181415,28181454,28181499,28186738,28187515,28195146,28204227,28221203,28224849,28225848,28227776,28228210,28238373,28238388,28238405,28250155,28254939,28258014,28259323,28259589,28261882,28265575,28266528,28266576,28266942,28269024,28274013,28283736,28283816,28288472,28288674,28288776,28290827,28292301,28298694,28298794,28299135,28301029,28301693,28304221,28305954,28307587,28317921,28318140,28327721,28327902,28328320,28328461,28328564,28329660,28330827,28332040,28335162,28336082,28336998,28337811,28338276,28339000,28339129,28342771,28343013,28344643,28345034,28345232,28347321,28347375,28347416,28347428,28347466,28347563,28350130,28350315,28352365,28352802,28352823,28352918,28353011,28353051,28353164,28353461,28353645,28354058,28354113,28354155,28354202,28355397,28356527,28356833,28356927,28357060,28357743,28358770,28359575,28359640,28359711,28360100,28360415,28360581,28360817,28361830,28362172,28362347,2836373', 'assoc_port': '28088708:28089207,28089590:28090230,28089593:28090498,28089595:28090069,28089597:28170227,28146550:28288472,28146552:28288674,28146554:28288776,28146562:28148156,28148277:28157056,28148280:28301693,28148282:28298694,28148283:28299135,28148308:28298794,28150094:28307587,28150096:28336998,28150112:28332040,28153517:28153567,28153518:28339000,28154448:28330827,28156460:28328564,28156464:28156684,28163832:28338276,28180156:28181499,28180177:28181415,28180178:28181454,28180199:28181350,28180201:28181232,28180202:28186738,28180207:28327721,28186185:28327902,28187382:28187515,28187383:28335162,28195055:28347321,28195057:28345034,28195058:28344643,28195060:28195146,28204165:28204227,28204166:28342771,28204168:28343013,28207350:28345232,28211945:28347375,28211946:28347563,28220916:28347416,28220918:28347428,28220922:28347466,28220931:28221203,28224647:28224849,28225682:28228210,28225691:28227776,28225702:28225848,28238295:28238405,28238297:28238373,28238299:28238388,28249999:28350130,28250000:28350315,28250001:2825015', 'assoc_mat': '28088708:barquette_opaque:4207:28089207,28089590:barquette_opaque:4207:28090230,28089593:barquette_opaque:4207:28090498,28089595:barquette_opaque:4207:28090069,28089597:barquette_opaque:4207:28170227,28146550:barquette_opaque:4207:28288472,28146552:barquette_opaque:4207:28288674,28146554:barquette_opaque:4207:28288776,28146562:barquette_opaque:4207:28148156,28148277:barquette_opaque:4207:28157056,28148280:barquette_opaque:4207:28301693,28148282:barquette_opaque:4207:28298694,28148283:barquette_opaque:4207:28299135,28148308:barquette_opaque:4207:28298794,28150094:barquette_opaque:4207:28307587,28150096:barquette_opaque:4207:28336998,28150112:barquette_opaque:4207:28332040,28153517:barquette_opaque:4207:28153567,28153518:barquette_opaque:4207:28339000,28154448:barquette_opaque:4207:28330827,28156460:barquette_opaque:4207:28328564,28156464:barquette_opaque:4207:28156684,28163832:barquette_opaque:4207:28338276,28180156:barquette_opaque:4207:28181499,28180177:barquette_opaque:4207:28181415,28180178:barquette_opaqu'}, {'unwanted_material': 'carton', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.004701025151634024, 'nb_photo': 138, 'list_port_cont': '28146794,28156577,28156649,28180453,28180532,28180983,28204448,28218814,28219179,28227720,28259517,28310038,28316210,28316951,28325708,28325957,28352853,28353474,28357778,28358644,28359552,28388710,28388784,28389048,28406641,28428668,28431733,28432405,28432435,28449360,28451363,28462790,28462819,28467800,28482300,28484719,28485419,28488746,28488906,28497857,28506817,28540527,28540648,28542268,28563722,28569589,28574429,28574913,28575529,28597353,28606009,28622353,28664797,28712993,28716032,28722544,28724935,28752409,28759194,28759238,28766911,28767620,28770205,28798716,28798832,28799422,28806890,28813649,28817317,28817426', 'assoc_port': '28146551:28146794,28156465:28156649,28156468:28156577,28180167:28180983,28180198:28180532,28180203:28180453,28204167:28204448,28218590:28227720,28218599:28219179,28218604:28218814,28259206:28259517,28268244:28316951,28271935:28316210,28304080:28310038,28325355:28325957,28325358:28325708,28352798:28352853,28353422:28353474,28357716:28357778,28358578:28358644,28359466:28359552,28388414:28389048,28388417:28388784,28388421:28388710,28406456:28406641,28428627:28428668,28431663:28431733,28432326:28432435,28432328:28432405,28449243:28449360,28451135:28451363,28462655:28462819,28462656:28462790,28467747:28467800,28482033:28482300,28484570:28484719,28485365:28485419,28488525:28488906,28488540:28488746,28497674:28497857,28506597:28506817,28540290:28540648,28540296:28540527,28541862:28542268,28563677:28563722,28569479:28569589,28574249:28574429,28574866:28574913,28575473:28575529,28596984:28597353,28605912:28606009,28622102:28622353,28657585:28664797,28712823:28712993,28715840:28716032,28722253:28724935,28722255:2872254', 'assoc_mat': '28146551:carton:4461:28146794,28156465:carton:4461:28156649,28156468:carton:4461:28156577,28180167:carton:4461:28180983,28180198:carton:4461:28180532,28180203:carton:4461:28180453,28204167:carton:4461:28204448,28218590:carton:4461:28227720,28218599:carton:4461:28219179,28218604:carton:4461:28218814,28259206:carton:4461:28259517,28268244:carton:4461:28316951,28271935:carton:4461:28316210,28304080:carton:4461:28310038,28325355:carton:4461:28325957,28325358:carton:4461:28325708,28352798:carton:4461:28352853,28353422:carton:4461:28353474,28357716:carton:4461:28357778,28358578:carton:4461:28358644,28359466:carton:4461:28359552,28388414:carton:4461:28389048,28388417:carton:4461:28388784,28388421:carton:4461:28388710,28406456:carton:4461:28406641,28428627:carton:4461:28428668,28431663:carton:4461:28431733,28432326:carton:4461:28432435,28432328:carton:4461:28432405,28449243:carton:4461:28449360,28451135:carton:4461:28451363,28462655:carton:4461:28462819,28462656:carton:4461:28462790,28467747:carton:4461:28467800,2848'}, {'unwanted_material': 'carton', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.9840725431178392, 'nb_photo': 4187, 'list_port_cont': '28089193,28148165,28153556,28157048,28170222,28180238,28180792,28181224,28181356,28181402,28181456,28181493,28186739,28187514,28195145,28204234,28218961,28221199,28224856,28225837,28225860,28227767,28228213,28238385,28238409,28250157,28254940,28258018,28259328,28259599,28261888,28266536,28266569,28269034,28274022,28283743,28283823,28288679,28288786,28292315,28298690,28298783,28299136,28301552,28301689,28304224,28305947,28307586,28318142,28318431,28327729,28327907,28328463,28328563,28329659,28330825,28332041,28335155,28336996,28337803,28338278,28338988,28339132,28342762,28343004,28345233,28345856,28347328,28347380,28347437,28347459,28347472,28347566,28350128,28350326,28352359,28352829,28353006,28353048,28353168,28353468,28354027,28354112,28354154,28354209,28355306,28355393,28356520,28356820,28356827,28357058,28357744,28358773,28359574,28359714,28360085,28360419,28360580,28360815,28361838,28362052,28362175,28363744,28364018,28364040,28364097,28364108,28383011,28383189,28386591,28388823,28389020,28389337,2838936', 'assoc_port': '28088708:28089193,28089597:28170222,28146552:28288679,28146554:28288786,28146562:28148165,28148277:28157048,28148279:28301552,28148280:28301689,28148282:28298690,28148283:28299136,28148308:28298783,28150094:28307586,28150096:28336996,28150112:28332041,28153517:28153556,28153518:28338988,28154448:28330825,28156460:28328563,28163832:28338278,28180156:28181493,28180177:28181402,28180178:28181456,28180199:28181356,28180201:28181224,28180202:28186739,28180204:28180238,28180206:28180792,28180207:28327729,28186185:28327907,28187382:28187514,28187383:28335155,28195055:28347328,28195060:28195145,28204165:28204234,28204166:28342762,28204168:28343004,28207348:28345856,28207350:28345233,28211945:28347380,28211946:28347566,28218601:28218961,28220918:28347437,28220919:28347459,28220922:28347472,28220931:28221199,28224647:28224856,28225682:28228213,28225691:28227767,28225702:28225860,28225703:28225837,28238295:28238409,28238299:28238385,28249999:28350128,28250000:28350326,28250001:28250157,28254380:28254940,28257885:2825801', 'assoc_mat': '28088708:carton:4207:28089193,28089597:carton:4207:28170222,28146552:carton:4207:28288679,28146554:carton:4207:28288786,28146562:carton:4207:28148165,28148277:carton:4207:28157048,28148279:carton:4207:28301552,28148280:carton:4207:28301689,28148282:carton:4207:28298690,28148283:carton:4207:28299136,28148308:carton:4207:28298783,28150094:carton:4207:28307586,28150096:carton:4207:28336996,28150112:carton:4207:28332041,28153517:carton:4207:28153556,28153518:carton:4207:28338988,28154448:carton:4207:28330825,28156460:carton:4207:28328563,28163832:carton:4207:28338278,28180156:carton:4207:28181493,28180177:carton:4207:28181402,28180178:carton:4207:28181456,28180199:carton:4207:28181356,28180201:carton:4207:28181224,28180202:carton:4207:28186739,28180204:carton:4207:28180238,28180206:carton:4207:28180792,28180207:carton:4207:28327729,28186185:carton:4207:28327907,28187382:carton:4207:28187514,28187383:carton:4207:28335155,28195055:carton:4207:28347328,28195060:carton:4207:28195145,28204165:carton:4207:28204234,2820'}, {'unwanted_material': 'carton', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.09886390900474963, 'nb_photo': 2, 'list_port_cont': '28540464', 'assoc_port': '28540307:28540464', 'assoc_mat': '28540307:carton:3327:28540464'}, {'unwanted_material': 'carton', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.006474484896525085, 'nb_photo': 560, 'list_port_cont': '28089861,28090154,28150559,28156757,28180298,28186427,28195377,28195887,28208086,28221545,28223997,28255354,28256397,28266212,28267522,28268354,28268666,28272171,28275369,28298719,28299076,28299386,28304459,28318232,28318603,28319939,28320447,28321011,28322775,28325753,28353316,28353524,28353857,28353958,28354638,28355246,28356785,28381416,28395830,28396192,28407142,28407702,28416313,28427270,28428003,28429182,28431203,28431773,28432445,28445032,28448039,28457326,28457907,28463146,28463273,28463336,28464080,28466022,28466777,28472104,28484844,28485262,28485526,28496196,28496548,28497008,28497806,28519235,28540475,28540763,28540834,28541485,28542113,28542518,28543115,28543763,28545332,28546029,28563829,28565457,28565836,28566244,28571774,28572346,28574966,28575600,28597918,28598165,28599115,28606085,28606287,28612978,28614015,28616094,28616710,28622344,28622779,28623075,28624932,28650873,28657647,28658405,28661074,28667016,28677949,28682404,28686004,28699914,28700396,28700942,28703025,28703918,28706551,2870726', 'assoc_port': '28089594:28090154,28089596:28089861,28150110:28150559,28156462:28156757,28180176:28186427,28180200:28180298,28195056:28195887,28195059:28195377,28204164:28208086,28220920:28221545,28220943:28223997,28254378:28255354,28254382:28256397,28265444:28266212,28265455:28267522,28268247:28268354,28268516:28268666,28271938:28272171,28275226:28275369,28298577:28299386,28298579:28299076,28298580:28298719,28304078:28304459,28317465:28321011,28317467:28320447,28317509:28319939,28317536:28318603,28317550:28318232,28318855:28322775,28325353:28325753,28352790:28353316,28352791:28353958,28352794:28353857,28353420:28353524,28354585:28354638,28355212:28355246,28356749:28356785,28381336:28381416,28395537:28396192,28395540:28395830,28406458:28407702,28406460:28407142,28415993:28416313,28427141:28427270,28427879:28428003,28428916:28429182,28429804:28431203,28431669:28431773,28432327:28432445,28442120:28445032,28447946:28448039,28457119:28457907,28457120:28457326,28463061:28466777,28463062:28466022,28463063:28464080,28463064:2846333', 'assoc_mat': '28089594:carton:3594:28090154,28089596:carton:3594:28089861,28150110:carton:3594:28150559,28156462:carton:3594:28156757,28180176:carton:3594:28186427,28180200:carton:3594:28180298,28195056:carton:3594:28195887,28195059:carton:3594:28195377,28204164:carton:3594:28208086,28220920:carton:3594:28221545,28220943:carton:3594:28223997,28254378:carton:3594:28255354,28254382:carton:3594:28256397,28265444:carton:3594:28266212,28265455:carton:3594:28267522,28268247:carton:3594:28268354,28268516:carton:3594:28268666,28271938:carton:3594:28272171,28275226:carton:3594:28275369,28298577:carton:3594:28299386,28298579:carton:3594:28299076,28298580:carton:3594:28298719,28304078:carton:3594:28304459,28317465:carton:3594:28321011,28317467:carton:3594:28320447,28317509:carton:3594:28319939,28317536:carton:3594:28318603,28317550:carton:3594:28318232,28318855:carton:3594:28322775,28325353:carton:3594:28325753,28352790:carton:3594:28353316,28352791:carton:3594:28353958,28352794:carton:3594:28353857,28353420:carton:3594:28353524,2835'}, {'unwanted_material': 'Carton_brun', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.1537737284090292, 'nb_photo': 4, 'list_port_cont': '28150231,28447988', 'assoc_port': '28150125:28150231,28447947:28447988', 'assoc_mat': '28150125:Carton_brun:3726:28150231,28447947:Carton_brun:3726:28447988'}, {'unwanted_material': 'etiquette', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.00035354251354998366, 'nb_photo': 1, 'list_port_cont': '28432407', 'assoc_port': '28432328:28432407', 'assoc_mat': '28432328:etiquette:4461:28432407'}, {'unwanted_material': 'etiquette', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00026263290500634016, 'nb_photo': 939, 'list_port_cont': '28090227,28153561,28157059,28180791,28181405,28181450,28181489,28187517,28204230,28224847,28225842,28225858,28227778,28228215,28238376,28238415,28250143,28258022,28259593,28261931,28266527,28266578,28266940,28269036,28283738,28288678,28288788,28299133,28301024,28301541,28318439,28327718,28328561,28330829,28332042,28335160,28337004,28337810,28339128,28342773,28345237,28347318,28347381,28347468,28352800,28352827,28353010,28353167,28353463,28354016,28354111,28354162,28354208,28355303,28355384,28356523,28356829,28357055,28357739,28358774,28359572,28359713,28360098,28360420,28361828,28362166,28363738,28364029,28364035,28364092,28383184,28388812,28389327,28389376,28395576,28397014,28405049,28410537,28414102,28424646,28425911,28427149,28427180,28428763,28431797,28432374,28432842,28433719,28433736,28448300,28449470,28452435,28458609,28462882,28463079,28467793,28468188,28470006,28470154,28470717,28472062,28482211,28485447,28497703,28497753,28504609,28505330,28505983,28506402,28506927,28525767,28540613,28540743,2854282', 'assoc_port': '28089590:28090227,28146552:28288678,28146554:28288788,28148277:28157059,28148279:28301541,28148283:28299133,28150096:28337004,28150112:28332042,28153517:28153561,28154448:28330829,28156460:28328561,28180156:28181489,28180177:28181405,28180178:28181450,28180206:28180791,28180207:28327718,28187382:28187517,28187383:28335160,28195055:28347318,28204165:28204230,28204166:28342773,28207350:28345237,28211945:28347381,28220922:28347468,28224647:28224847,28225682:28228215,28225691:28227778,28225702:28225858,28225703:28225842,28238295:28238415,28238299:28238376,28250001:28250143,28257885:28258022,28259203:28259593,28261836:28261931,28266489:28266940,28266490:28266578,28266491:28266527,28268245:28354016,28268494:28354111,28268495:28354162,28268496:28354208,28268498:28269036,28283585:28283738,28298578:28359713,28299784:28360098,28299811:28301024,28304075:28360420,28317456:28361828,28317487:28318439,28318847:28362166,28325348:28356523,28325351:28337810,28339120:28339128,28352787:28353167,28352789:28353010,28352792:2835280', 'assoc_mat': '28089590:etiquette:4207:28090227,28146552:etiquette:4207:28288678,28146554:etiquette:4207:28288788,28148277:etiquette:4207:28157059,28148279:etiquette:4207:28301541,28148283:etiquette:4207:28299133,28150096:etiquette:4207:28337004,28150112:etiquette:4207:28332042,28153517:etiquette:4207:28153561,28154448:etiquette:4207:28330829,28156460:etiquette:4207:28328561,28180156:etiquette:4207:28181489,28180177:etiquette:4207:28181405,28180178:etiquette:4207:28181450,28180206:etiquette:4207:28180791,28180207:etiquette:4207:28327718,28187382:etiquette:4207:28187517,28187383:etiquette:4207:28335160,28195055:etiquette:4207:28347318,28204165:etiquette:4207:28204230,28204166:etiquette:4207:28342773,28207350:etiquette:4207:28345237,28211945:etiquette:4207:28347381,28220922:etiquette:4207:28347468,28224647:etiquette:4207:28224847,28225682:etiquette:4207:28228215,28225691:etiquette:4207:28227778,28225702:etiquette:4207:28225858,28225703:etiquette:4207:28225842,28238295:etiquette:4207:28238415,28238299:etiquette:4207:28238376,2'}, {'unwanted_material': 'film_plastique', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.9336741976020435, 'nb_photo': 2087, 'list_port_cont': '28089740,28146788,28148391,28150444,28153699,28153881,28156568,28156654,28166945,28180253,28180446,28180533,28180977,28204455,28207480,28218815,28219178,28219266,28221152,28221307,28227718,28254425,28259345,28259508,28310041,28310510,28316212,28316952,28319035,28325705,28325966,28329050,28352859,28353486,28353557,28357774,28358649,28359499,28359560,28388535,28388600,28388704,28388780,28389043,28406637,28424911,28427209,28428660,28428709,28431730,28432406,28432456,28433671,28448060,28449362,28451362,28462787,28462821,28467801,28482169,28482297,28484715,28485425,28488749,28488911,28489200,28497724,28497822,28497862,28506825,28540364,28540525,28540640,28542001,28542152,28542269,28552808,28563717,28563787,28569590,28570519,28574021,28574434,28574908,28575537,28597188,28597344,28597507,28606005,28606056,28616638,28622356,28624637,28624793,28657664,28657740,28664810,28706261,28706831,28707010,28707137,28707235,28713004,28716037,28722342,28722535,28723787,28724929,28743901,28744175,28752420,28759185,28759225,2876691', 'assoc_port': '28089592:28089740,28146551:28146788,28146555:28166945,28148321:28148391,28150095:28150444,28153519:28153699,28153520:28153881,28156465:28156654,28156468:28156568,28180167:28180977,28180198:28180533,28180203:28180446,28180205:28180253,28204167:28204455,28207346:28207480,28218590:28227718,28218595:28219266,28218599:28219178,28218604:28218815,28220923:28221307,28220924:28221152,28254384:28254425,28259206:28259508,28259208:28259345,28268244:28316952,28271935:28316212,28304076:28310510,28304080:28310041,28318850:28329050,28318852:28319035,28325355:28325966,28325358:28325705,28352798:28352859,28353419:28353557,28353422:28353486,28357716:28357774,28358578:28358649,28359466:28359560,28359467:28359499,28388414:28389043,28388417:28388780,28388421:28388704,28388423:28388600,28388424:28388535,28406456:28406637,28424873:28424911,28427144:28427209,28428626:28428709,28428627:28428660,28431663:28431730,28432326:28432456,28432328:28432406,28433635:28433671,28447944:28448060,28449243:28449362,28451135:28451362,28462655:2846282', 'assoc_mat': '28089592:film_plastique:4461:28089740,28146551:film_plastique:4461:28146788,28146555:film_plastique:4461:28166945,28148321:film_plastique:4461:28148391,28150095:film_plastique:4461:28150444,28153519:film_plastique:4461:28153699,28153520:film_plastique:4461:28153881,28156465:film_plastique:4461:28156654,28156468:film_plastique:4461:28156568,28180167:film_plastique:4461:28180977,28180198:film_plastique:4461:28180533,28180203:film_plastique:4461:28180446,28180205:film_plastique:4461:28180253,28204167:film_plastique:4461:28204455,28207346:film_plastique:4461:28207480,28218590:film_plastique:4461:28227718,28218595:film_plastique:4461:28219266,28218599:film_plastique:4461:28219178,28218604:film_plastique:4461:28218815,28220923:film_plastique:4461:28221307,28220924:film_plastique:4461:28221152,28254384:film_plastique:4461:28254425,28259206:film_plastique:4461:28259508,28259208:film_plastique:4461:28259345,28268244:film_plastique:4461:28316952,28271935:film_plastique:4461:28316212,28304076:film_plastique:4461:2831051'}, {'unwanted_material': 'film_plastique', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.005058416005910822, 'nb_photo': 13020, 'list_port_cont': '28089196,28090067,28090225,28090484,28148170,28153557,28156687,28157052,28170228,28180234,28180795,28181220,28181353,28181413,28181459,28181486,28186747,28186834,28187519,28195152,28204220,28218963,28221200,28224853,28225833,28225850,28227770,28228005,28228201,28238365,28238378,28238419,28250152,28254934,28258025,28259321,28259590,28261897,28261929,28265572,28266525,28266575,28266936,28269035,28274028,28283733,28283829,28288482,28288684,28288787,28290822,28292308,28298660,28298695,28298779,28299142,28301023,28301543,28301685,28304219,28305956,28307592,28317919,28318145,28318419,28318443,28321255,28327725,28327897,28328315,28328454,28328574,28329661,28330822,28332048,28335149,28336080,28337002,28337805,28338273,28338989,28339126,28342763,28343009,28344632,28345031,28345223,28345864,28347031,28347325,28347385,28347393,28347407,28347429,28347477,28347575,28350131,28350318,28352367,28352804,28352831,28352904,28353009,28353044,28353166,28353469,28353659,28354017,28354056,28354119,28354163,28354198,28355297,2835538', 'assoc_port': '28088708:28089196,28089590:28090225,28089593:28090484,28089595:28090067,28089597:28170228,28146550:28288482,28146552:28288684,28146554:28288787,28146562:28148170,28148277:28157052,28148279:28301543,28148280:28301685,28148282:28298695,28148283:28299142,28148308:28298779,28150094:28307592,28150096:28337002,28150112:28332048,28153517:28153557,28153518:28338989,28154448:28330822,28156460:28328574,28156464:28156687,28156466:28321255,28163832:28338273,28180156:28181486,28180177:28181413,28180178:28181459,28180197:28186834,28180199:28181353,28180201:28181220,28180202:28186747,28180204:28180234,28180206:28180795,28180207:28327725,28186185:28327897,28187382:28187519,28187383:28335149,28195055:28347325,28195057:28345031,28195058:28344632,28195060:28195152,28204165:28204220,28204166:28342763,28204168:28343009,28207348:28345864,28207350:28345223,28211945:28347385,28211946:28347575,28211948:28347393,28218598:28347031,28218601:28218963,28220916:28347407,28220918:28347429,28220922:28347477,28220931:28221200,28224647:2822485', 'assoc_mat': '28088708:film_plastique:4207:28089196,28089590:film_plastique:4207:28090225,28089593:film_plastique:4207:28090484,28089595:film_plastique:4207:28090067,28089597:film_plastique:4207:28170228,28146550:film_plastique:4207:28288482,28146552:film_plastique:4207:28288684,28146554:film_plastique:4207:28288787,28146562:film_plastique:4207:28148170,28148277:film_plastique:4207:28157052,28148279:film_plastique:4207:28301543,28148280:film_plastique:4207:28301685,28148282:film_plastique:4207:28298695,28148283:film_plastique:4207:28299142,28148308:film_plastique:4207:28298779,28150094:film_plastique:4207:28307592,28150096:film_plastique:4207:28337002,28150112:film_plastique:4207:28332048,28153517:film_plastique:4207:28153557,28153518:film_plastique:4207:28338989,28154448:film_plastique:4207:28330822,28156460:film_plastique:4207:28328574,28156464:film_plastique:4207:28156687,28156466:film_plastique:4207:28321255,28163832:film_plastique:4207:28338273,28180156:film_plastique:4207:28181486,28180177:film_plastique:4207:2818141'}, {'unwanted_material': 'kraft', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0001649748814406841, 'nb_photo': 21, 'list_port_cont': '28259602,28299137,28327720,28353174,28356517,28470162,28472069,28506917,28540738,28542820,28570250,28576719,28605979,28625859,28723495,28768512,28813603', 'assoc_port': '28148283:28299137,28180207:28327720,28259203:28259602,28325348:28356517,28352787:28353174,28469941:28470162,28472051:28472069,28506596:28506917,28540256:28542820,28540302:28540738,28565315:28570250,28576680:28576719,28605914:28605979,28622088:28625859,28723349:28723495,28768492:28768512,28813574:28813603', 'assoc_mat': '28148283:kraft:4207:28299137,28180207:kraft:4207:28327720,28259203:kraft:4207:28259602,28325348:kraft:4207:28356517,28352787:kraft:4207:28353174,28469941:kraft:4207:28470162,28472051:kraft:4207:28472069,28506596:kraft:4207:28506917,28540256:kraft:4207:28542820,28540302:kraft:4207:28540738,28565315:kraft:4207:28570250,28576680:kraft:4207:28576719,28605914:kraft:4207:28605979,28622088:kraft:4207:28625859,28723349:kraft:4207:28723495,28768492:kraft:4207:28768512,28813574:kraft:4207:28813603'}, {'unwanted_material': 'metal', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0031611812824809933, 'nb_photo': 731, 'list_port_cont': '28148162,28153562,28157047,28180244,28181230,28181495,28187520,28195153,28218958,28221222,28224834,28225851,28227771,28228214,28238362,28238380,28238414,28258024,28259324,28259594,28266573,28266935,28269025,28274020,28283742,28283827,28288681,28298691,28299130,28301018,28304211,28318448,28327727,28328566,28329657,28330828,28335151,28336079,28336997,28337812,28338994,28339134,28342772,28344633,28345023,28345226,28347319,28347378,28347395,28347417,28347430,28347471,28347576,28352801,28352836,28353001,28353170,28353465,28354025,28355392,28356524,28356812,28356826,28356924,28357048,28357734,28359573,28359634,28359723,28360086,28360577,28361833,28362165,28362352,28363739,28364038,28364096,28382998,28383193,28389027,28389366,28395577,28410534,28414109,28424687,28425885,28425902,28427151,28428770,28429815,28431808,28432363,28432831,28433723,28433737,28448310,28450490,28452438,28452466,28462874,28463077,28467791,28468182,28470013,28470167,28472059,28482225,28484700,28485380,28485451,28497712,28497749,28504610,2850533', 'assoc_port': '28146552:28288681,28146562:28148162,28148277:28157047,28148282:28298691,28148283:28299130,28150096:28336997,28153517:28153562,28153518:28338994,28154448:28330828,28156460:28328566,28180156:28181495,28180201:28181230,28180204:28180244,28180207:28327727,28187382:28187520,28187383:28335151,28195055:28347319,28195057:28345023,28195058:28344633,28195060:28195153,28204166:28342772,28207350:28345226,28211945:28347378,28211946:28347576,28211948:28347395,28218601:28218958,28220916:28347417,28220918:28347430,28220922:28347471,28220931:28221222,28224647:28224834,28225682:28228214,28225691:28227771,28225702:28225851,28238295:28238414,28238297:28238362,28238299:28238380,28257885:28258024,28259203:28259594,28259205:28259324,28266489:28266935,28266490:28266573,28268245:28354025,28268498:28269025,28271939:28274020,28275225:28283827,28283585:28283742,28298576:28359634,28298578:28359723,28299784:28360086,28299811:28301018,28304077:28360577,28304082:28304211,28317456:28361833,28317487:28318448,28318847:28362165,28318851:2836235', 'assoc_mat': '28146552:metal:4207:28288681,28146562:metal:4207:28148162,28148277:metal:4207:28157047,28148282:metal:4207:28298691,28148283:metal:4207:28299130,28150096:metal:4207:28336997,28153517:metal:4207:28153562,28153518:metal:4207:28338994,28154448:metal:4207:28330828,28156460:metal:4207:28328566,28180156:metal:4207:28181495,28180201:metal:4207:28181230,28180204:metal:4207:28180244,28180207:metal:4207:28327727,28187382:metal:4207:28187520,28187383:metal:4207:28335151,28195055:metal:4207:28347319,28195057:metal:4207:28345023,28195058:metal:4207:28344633,28195060:metal:4207:28195153,28204166:metal:4207:28342772,28207350:metal:4207:28345226,28211945:metal:4207:28347378,28211946:metal:4207:28347576,28211948:metal:4207:28347395,28218601:metal:4207:28218958,28220916:metal:4207:28347417,28220918:metal:4207:28347430,28220922:metal:4207:28347471,28220931:metal:4207:28221222,28224647:metal:4207:28224834,28225682:metal:4207:28228214,28225691:metal:4207:28227771,28225702:metal:4207:28225851,28238295:metal:4207:28238414,28238297:'}, {'unwanted_material': 'metal', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.00033458533835039825, 'nb_photo': 108, 'list_port_cont': '28090157,28156755,28195374,28208082,28223995,28255085,28255352,28266220,28304457,28318609,28352417,28353853,28353959,28354629,28381421,28396196,28404058,28427265,28428004,28429180,28448040,28457900,28463271,28463340,28464072,28472105,28484848,28485529,28496199,28519233,28540480,28540754,28542124,28542513,28565829,28571769,28575592,28597533,28599122,28614012,28622349,28650872,28657643,28661070,28677956,28682398,28686008,28700946,28703021,28719564,28720024,28742625,28768305,28791266,28800236,28800648,28817352', 'assoc_port': '28089594:28090157,28156462:28156755,28195059:28195374,28204164:28208082,28220943:28223995,28254378:28255352,28254381:28255085,28265444:28266220,28304078:28304457,28317536:28318609,28348936:28352417,28352791:28353959,28352794:28353853,28354585:28354629,28381336:28381421,28395537:28396196,28403692:28404058,28427141:28427265,28427879:28428004,28428916:28429180,28447946:28448040,28457119:28457900,28463063:28464072,28463064:28463340,28463065:28463271,28472052:28472105,28484571:28484848,28485361:28485529,28495493:28496199,28518833:28519233,28540300:28540754,28540305:28540480,28541868:28542513,28541870:28542124,28565335:28565829,28571215:28571769,28575469:28575592,28596960:28599122,28596986:28597533,28612812:28614012,28622098:28622349,28650767:28650872,28657578:28661070,28657587:28657643,28676890:28682398,28677782:28677956,28685556:28686008,28700487:28700946,28700488:28703021,28718887:28720024,28718888:28719564,28741478:28742625,28766813:28768305,28789008:28791266,28798422:28800648,28798435:28800236,28817312:2881735', 'assoc_mat': '28089594:metal:3594:28090157,28156462:metal:3594:28156755,28195059:metal:3594:28195374,28204164:metal:3594:28208082,28220943:metal:3594:28223995,28254378:metal:3594:28255352,28254381:metal:3594:28255085,28265444:metal:3594:28266220,28304078:metal:3594:28304457,28317536:metal:3594:28318609,28348936:metal:3594:28352417,28352791:metal:3594:28353959,28352794:metal:3594:28353853,28354585:metal:3594:28354629,28381336:metal:3594:28381421,28395537:metal:3594:28396196,28403692:metal:3594:28404058,28427141:metal:3594:28427265,28427879:metal:3594:28428004,28428916:metal:3594:28429180,28447946:metal:3594:28448040,28457119:metal:3594:28457900,28463063:metal:3594:28464072,28463064:metal:3594:28463340,28463065:metal:3594:28463271,28472052:metal:3594:28472105,28484571:metal:3594:28484848,28485361:metal:3594:28485529,28495493:metal:3594:28496199,28518833:metal:3594:28519233,28540300:metal:3594:28540754,28540305:metal:3594:28540480,28541868:metal:3594:28542513,28541870:metal:3594:28542124,28565335:metal:3594:28565829,28571215:'}, {'unwanted_material': 'papier', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.06847760296521882, 'nb_photo': 6543, 'list_port_cont': '28089736,28146790,28148400,28150438,28153701,28153885,28156565,28156648,28166934,28180255,28180450,28180537,28180982,28204450,28207465,28218822,28219172,28219271,28221151,28221292,28227724,28254419,28259333,28259503,28310042,28310502,28316216,28316954,28319040,28325713,28325958,28329053,28352846,28353475,28353549,28357781,28358647,28359493,28359563,28388536,28388597,28388695,28388779,28389045,28406638,28424922,28427207,28428674,28428712,28431718,28432394,28432450,28433677,28448055,28449350,28451372,28462788,28462829,28467806,28482165,28482301,28484728,28485422,28488757,28488907,28489204,28497719,28497823,28497865,28506820,28540372,28540522,28540644,28541997,28542147,28542266,28552805,28563719,28563782,28569598,28570527,28574024,28574437,28574920,28575538,28597194,28597345,28597503,28605998,28606052,28616637,28622365,28624626,28624779,28657654,28657744,28664807,28706247,28706841,28707006,28707128,28707233,28712995,28716031,28722341,28722542,28723784,28724937,28743903,28744177,28752408,28759190,28759224,2876691', 'assoc_port': '28089592:28089736,28146551:28146790,28146555:28166934,28148321:28148400,28150095:28150438,28153519:28153701,28153520:28153885,28156465:28156648,28156468:28156565,28180167:28180982,28180198:28180537,28180203:28180450,28180205:28180255,28204167:28204450,28207346:28207465,28218590:28227724,28218595:28219271,28218599:28219172,28218604:28218822,28220923:28221292,28220924:28221151,28254384:28254419,28259206:28259503,28259208:28259333,28268244:28316954,28271935:28316216,28304076:28310502,28304080:28310042,28318850:28329053,28318852:28319040,28325355:28325958,28325358:28325713,28352798:28352846,28353419:28353549,28353422:28353475,28357716:28357781,28358578:28358647,28359466:28359563,28359467:28359493,28388414:28389045,28388417:28388779,28388421:28388695,28388423:28388597,28388424:28388536,28406456:28406638,28424873:28424922,28427144:28427207,28428626:28428712,28428627:28428674,28431663:28431718,28432326:28432450,28432328:28432394,28433635:28433677,28447944:28448055,28449243:28449350,28451135:28451372,28462655:2846282', 'assoc_mat': '28089592:papier:4461:28089736,28146551:papier:4461:28146790,28146555:papier:4461:28166934,28148321:papier:4461:28148400,28150095:papier:4461:28150438,28153519:papier:4461:28153701,28153520:papier:4461:28153885,28156465:papier:4461:28156648,28156468:papier:4461:28156565,28180167:papier:4461:28180982,28180198:papier:4461:28180537,28180203:papier:4461:28180450,28180205:papier:4461:28180255,28204167:papier:4461:28204450,28207346:papier:4461:28207465,28218590:papier:4461:28227724,28218595:papier:4461:28219271,28218599:papier:4461:28219172,28218604:papier:4461:28218822,28220923:papier:4461:28221292,28220924:papier:4461:28221151,28254384:papier:4461:28254419,28259206:papier:4461:28259503,28259208:papier:4461:28259333,28268244:papier:4461:28316954,28271935:papier:4461:28316216,28304076:papier:4461:28310502,28304080:papier:4461:28310042,28318850:papier:4461:28329053,28318852:papier:4461:28319040,28325355:papier:4461:28325958,28325358:papier:4461:28325713,28352798:papier:4461:28352846,28353419:papier:4461:28353549,2835'}, {'unwanted_material': 'papier', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0065056728183815115, 'nb_photo': 20452, 'list_port_cont': '28089208,28090055,28090221,28090486,28148166,28153552,28156692,28157054,28170218,28180232,28180794,28181219,28181351,28181412,28181457,28181496,28186741,28186819,28187526,28195151,28204233,28218960,28221223,28224850,28225835,28225862,28227766,28227995,28228204,28238375,28238391,28238406,28250150,28254935,28258016,28259326,28259596,28261896,28261934,28265514,28265563,28266529,28266571,28266930,28269031,28274015,28283735,28283824,28288486,28288677,28288778,28290829,28292316,28298665,28298684,28298789,28299131,28301033,28301550,28301687,28304223,28305945,28306309,28307578,28317929,28318144,28318423,28318442,28321254,28327722,28327896,28328313,28328455,28328576,28329667,28330835,28332036,28335147,28336091,28337006,28337806,28338274,28339001,28339133,28342769,28343003,28344646,28345026,28345227,28347019,28347323,28347377,28347396,28347406,28347435,28347449,28347476,28347570,28350134,28350322,28352372,28352807,28352822,28352919,28353000,28353043,28353160,28353458,28353658,28354022,28354057,28354110,28354159,2835420', 'assoc_port': '28088708:28089208,28089590:28090221,28089593:28090486,28089595:28090055,28089597:28170218,28146550:28288486,28146552:28288677,28146554:28288778,28146562:28148166,28148277:28157054,28148279:28301550,28148280:28301687,28148282:28298684,28148283:28299131,28148308:28298789,28150094:28307578,28150096:28337006,28150112:28332036,28153517:28153552,28153518:28339001,28154448:28330835,28156460:28328576,28156464:28156692,28156466:28321254,28163832:28338274,28180156:28181496,28180177:28181412,28180178:28181457,28180197:28186819,28180199:28181351,28180201:28181219,28180202:28186741,28180204:28180232,28180206:28180794,28180207:28327722,28186185:28327896,28187382:28187526,28187383:28335147,28195055:28347323,28195057:28345026,28195058:28344646,28195060:28195151,28204165:28204233,28204166:28342769,28204168:28343003,28207350:28345227,28211945:28347377,28211946:28347570,28211948:28347396,28218598:28347019,28218601:28218960,28220916:28347406,28220918:28347435,28220919:28347449,28220922:28347476,28220931:28221223,28224647:2822485', 'assoc_mat': '28088708:papier:4207:28089208,28089590:papier:4207:28090221,28089593:papier:4207:28090486,28089595:papier:4207:28090055,28089597:papier:4207:28170218,28146550:papier:4207:28288486,28146552:papier:4207:28288677,28146554:papier:4207:28288778,28146562:papier:4207:28148166,28148277:papier:4207:28157054,28148279:papier:4207:28301550,28148280:papier:4207:28301687,28148282:papier:4207:28298684,28148283:papier:4207:28299131,28148308:papier:4207:28298789,28150094:papier:4207:28307578,28150096:papier:4207:28337006,28150112:papier:4207:28332036,28153517:papier:4207:28153552,28153518:papier:4207:28339001,28154448:papier:4207:28330835,28156460:papier:4207:28328576,28156464:papier:4207:28156692,28156466:papier:4207:28321254,28163832:papier:4207:28338274,28180156:papier:4207:28181496,28180177:papier:4207:28181412,28180178:papier:4207:28181457,28180197:papier:4207:28186819,28180199:papier:4207:28181351,28180201:papier:4207:28181219,28180202:papier:4207:28186741,28180204:papier:4207:28180232,28180206:papier:4207:28180794,2818'}, {'unwanted_material': 'papier', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.005736430811779723, 'nb_photo': 2, 'list_port_cont': '28540468', 'assoc_port': '28540307:28540468', 'assoc_mat': '28540307:papier:3327:28540468'}, {'unwanted_material': 'papier', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0072657192207601605, 'nb_photo': 3275, 'list_port_cont': '28089853,28090152,28090382,28146657,28150560,28156754,28180296,28186434,28195379,28195886,28208088,28218841,28221541,28223992,28225870,28254715,28255090,28255344,28256401,28266216,28267525,28268355,28268669,28272170,28275372,28298721,28299078,28299382,28304455,28318242,28318600,28319470,28319938,28320441,28321010,28321389,28322765,28325744,28352418,28353021,28353309,28353523,28353852,28353954,28354631,28355244,28356782,28381423,28388649,28388999,28395828,28396197,28404052,28407141,28407709,28416312,28427266,28427960,28428009,28429018,28429186,28431208,28431771,28431904,28432439,28445028,28448037,28457324,28457898,28463139,28463272,28463344,28464073,28466029,28466778,28472097,28484851,28485257,28485525,28495699,28496204,28496545,28497004,28497815,28519238,28540478,28540762,28540836,28541482,28542119,28542514,28543116,28543346,28543769,28545334,28546030,28563826,28565453,28565826,28566243,28570941,28571770,28572342,28574958,28575591,28597912,28598164,28599124,28606086,28606277,28612977,28614014,28616103,2861671', 'assoc_port': '28089591:28090382,28089594:28090152,28089596:28089853,28146548:28146657,28150110:28150560,28156462:28156754,28180176:28186434,28180200:28180296,28195056:28195886,28195059:28195379,28204164:28208088,28218602:28218841,28220920:28221541,28220943:28223992,28225687:28225870,28254378:28255344,28254381:28255090,28254382:28256401,28254385:28254715,28265444:28266216,28265455:28267525,28268247:28268355,28268516:28268669,28271938:28272170,28275226:28275372,28298577:28299382,28298579:28299078,28298580:28298721,28304078:28304455,28317462:28321389,28317465:28321010,28317467:28320441,28317509:28319938,28317536:28318600,28317550:28318242,28318849:28319470,28318855:28322765,28325353:28325744,28348936:28352418,28352790:28353309,28352791:28353954,28352794:28353852,28352797:28353021,28353420:28353523,28354585:28354631,28355212:28355244,28356749:28356782,28381336:28381423,28388418:28388999,28388428:28388649,28395537:28396197,28395540:28395828,28403692:28404052,28406458:28407709,28406460:28407141,28415993:28416312,28427141:2842726', 'assoc_mat': '28089591:papier:3594:28090382,28089594:papier:3594:28090152,28089596:papier:3594:28089853,28146548:papier:3594:28146657,28150110:papier:3594:28150560,28156462:papier:3594:28156754,28180176:papier:3594:28186434,28180200:papier:3594:28180296,28195056:papier:3594:28195886,28195059:papier:3594:28195379,28204164:papier:3594:28208088,28218602:papier:3594:28218841,28220920:papier:3594:28221541,28220943:papier:3594:28223992,28225687:papier:3594:28225870,28254378:papier:3594:28255344,28254381:papier:3594:28255090,28254382:papier:3594:28256401,28254385:papier:3594:28254715,28265444:papier:3594:28266216,28265455:papier:3594:28267525,28268247:papier:3594:28268355,28268516:papier:3594:28268669,28271938:papier:3594:28272170,28275226:papier:3594:28275372,28298577:papier:3594:28299382,28298579:papier:3594:28299078,28298580:papier:3594:28298721,28304078:papier:3594:28304455,28317462:papier:3594:28321389,28317465:papier:3594:28321010,28317467:papier:3594:28320441,28317509:papier:3594:28319938,28317536:papier:3594:28318600,2831'}, {'unwanted_material': 'pehd', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00029480760441903653, 'nb_photo': 48, 'list_port_cont': '28187521,28224851,28227998,28266567,28301546,28318139,28328567,28335148,28337813,28342764,28343015,28350132,28353003,28353169,28355398,28359721,28433729,28448303,28450491,28497752,28546655,28555855,28571544,28576802,28606369,28607172,28685714,28726978,28732277,28758087,28765688,28806230,28817580,28817686', 'assoc_port': '28148279:28301546,28156460:28328567,28187382:28187521,28187383:28335148,28204166:28342764,28204168:28343015,28224647:28224851,28225686:28227998,28249999:28350132,28266490:28266567,28298578:28359721,28317507:28318139,28325351:28337813,28352787:28353169,28352789:28353003,28355213:28355398,28433628:28433729,28447945:28448303,28449229:28450491,28497678:28497752,28546234:28546655,28555645:28555855,28571216:28571544,28576678:28576802,28605908:28607172,28605911:28606369,28685559:28685714,28722257:28726978,28731815:28732277,28743777:28758087,28765413:28765688,28798448:28806230,28817304:28817580,28817308:28817686', 'assoc_mat': '28148279:pehd:4207:28301546,28156460:pehd:4207:28328567,28187382:pehd:4207:28187521,28187383:pehd:4207:28335148,28204166:pehd:4207:28342764,28204168:pehd:4207:28343015,28224647:pehd:4207:28224851,28225686:pehd:4207:28227998,28249999:pehd:4207:28350132,28266490:pehd:4207:28266567,28298578:pehd:4207:28359721,28317507:pehd:4207:28318139,28325351:pehd:4207:28337813,28352787:pehd:4207:28353169,28352789:pehd:4207:28353003,28355213:pehd:4207:28355398,28433628:pehd:4207:28433729,28447945:pehd:4207:28448303,28449229:pehd:4207:28450491,28497678:pehd:4207:28497752,28546234:pehd:4207:28546655,28555645:pehd:4207:28555855,28571216:pehd:4207:28571544,28576678:pehd:4207:28576802,28605908:pehd:4207:28607172,28605911:pehd:4207:28606369,28685559:pehd:4207:28685714,28722257:pehd:4207:28726978,28731815:pehd:4207:28732277,28743777:pehd:4207:28758087,28765413:pehd:4207:28765688,28798448:pehd:4207:28806230,28817304:pehd:4207:28817580,28817308:pehd:4207:28817686'}, {'unwanted_material': 'pehd', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003412552971291397, 'nb_photo': 18, 'list_port_cont': '28195373,28266218,28304458,28353951,28354635,28428011,28472101,28540483,28543770,28571779,28597538,28703026,28768303,28791267,28801042', 'assoc_port': '28195059:28195373,28265444:28266218,28304078:28304458,28352791:28353951,28354585:28354635,28427879:28428011,28472052:28472101,28540286:28543770,28540305:28540483,28571215:28571779,28596986:28597538,28700488:28703026,28766813:28768303,28789008:28791267,28798419:28801042', 'assoc_mat': '28195059:pehd:3594:28195373,28265444:pehd:3594:28266218,28304078:pehd:3594:28304458,28352791:pehd:3594:28353951,28354585:pehd:3594:28354635,28427879:pehd:3594:28428011,28472052:pehd:3594:28472101,28540286:pehd:3594:28543770,28540305:pehd:3594:28540483,28571215:pehd:3594:28571779,28596986:pehd:3594:28597538,28700488:pehd:3594:28703026,28766813:pehd:3594:28768303,28789008:pehd:3594:28791267,28798419:pehd:3594:28801042'}, {'unwanted_material': 'pet_clair', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0019883975327020503, 'nb_photo': 951, 'list_port_cont': '28090217,28090490,28148169,28153566,28157055,28170229,28180796,28181342,28181404,28181458,28187527,28204222,28221196,28224838,28228001,28228208,28238379,28238407,28250145,28254936,28258026,28259591,28261889,28265508,28265576,28266579,28266928,28269039,28274014,28283732,28290818,28298654,28299141,28301553,28304222,28317920,28318137,28318433,28327719,28327903,28328569,28329669,28330830,28335154,28336087,28337005,28337817,28339136,28342774,28343011,28344635,28347329,28347374,28347392,28347426,28352368,28352809,28353171,28353457,28353654,28354207,28355394,28356519,28356916,28357745,28359571,28359719,28360088,28360818,28362037,28362171,28362351,28363732,28364037,28364101,28364123,28383194,28386576,28388826,28389025,28389328,28389372,28395575,28405052,28409798,28410526,28414113,28424647,28425909,28427172,28428747,28428997,28429918,28431800,28431821,28432839,28433722,28433738,28437624,28448306,28450483,28452446,28458616,28462881,28468186,28470008,28470164,28470716,28472067,28482214,28484689,28485462,28497693,2849775', 'assoc_port': '28089590:28090217,28089593:28090490,28089597:28170229,28146562:28148169,28148277:28157055,28148279:28301553,28148283:28299141,28150096:28337005,28153517:28153566,28154448:28330830,28156460:28328569,28180177:28181404,28180178:28181458,28180199:28181342,28180206:28180796,28180207:28327719,28186185:28327903,28187382:28187527,28187383:28335154,28195055:28347329,28195058:28344635,28204165:28204222,28204166:28342774,28204168:28343011,28211945:28347374,28211948:28347392,28220918:28347426,28220931:28221196,28224647:28224838,28225682:28228208,28225686:28228001,28238295:28238407,28238299:28238379,28250001:28250145,28254380:28254936,28257885:28258026,28259203:28259591,28261834:28261889,28265470:28265576,28265471:28265508,28266489:28266928,28266490:28266579,28268496:28354207,28268498:28269039,28271937:28290818,28271939:28274014,28283585:28283732,28298578:28359719,28298584:28298654,28299784:28360088,28304079:28360818,28304082:28304222,28317463:28362037,28317487:28318433,28317507:28318137,28317521:28317920,28318847:2836217', 'assoc_mat': '28089590:pet_clair:4207:28090217,28089593:pet_clair:4207:28090490,28089597:pet_clair:4207:28170229,28146562:pet_clair:4207:28148169,28148277:pet_clair:4207:28157055,28148279:pet_clair:4207:28301553,28148283:pet_clair:4207:28299141,28150096:pet_clair:4207:28337005,28153517:pet_clair:4207:28153566,28154448:pet_clair:4207:28330830,28156460:pet_clair:4207:28328569,28180177:pet_clair:4207:28181404,28180178:pet_clair:4207:28181458,28180199:pet_clair:4207:28181342,28180206:pet_clair:4207:28180796,28180207:pet_clair:4207:28327719,28186185:pet_clair:4207:28327903,28187382:pet_clair:4207:28187527,28187383:pet_clair:4207:28335154,28195055:pet_clair:4207:28347329,28195058:pet_clair:4207:28344635,28204165:pet_clair:4207:28204222,28204166:pet_clair:4207:28342774,28204168:pet_clair:4207:28343011,28211945:pet_clair:4207:28347374,28211948:pet_clair:4207:28347392,28220918:pet_clair:4207:28347426,28220931:pet_clair:4207:28221196,28224647:pet_clair:4207:28224838,28225682:pet_clair:4207:28228208,28225686:pet_clair:4207:28228001,2'}, {'unwanted_material': 'pet_clair', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.8702991828304787, 'nb_photo': 85, 'list_port_cont': '28540466', 'assoc_port': '28540307:28540466', 'assoc_mat': '28540307:pet_clair:3327:28540466'}, {'unwanted_material': 'pet_clair', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.07762241589606983, 'nb_photo': 2677, 'list_port_cont': '28089854,28090160,28090381,28146663,28150562,28156758,28180288,28186425,28195372,28195891,28208079,28218840,28221542,28224000,28225872,28254709,28255089,28255346,28256402,28259461,28266215,28267519,28268350,28268675,28272167,28275366,28298717,28299073,28299387,28304454,28318237,28318608,28319472,28319937,28320443,28321003,28321388,28322773,28325748,28352421,28353017,28353314,28353528,28353856,28353950,28354639,28355241,28356788,28381424,28388653,28389003,28395832,28396202,28404056,28407143,28407703,28416321,28427274,28427955,28428010,28429012,28429176,28431205,28431778,28431898,28432436,28445035,28448036,28457325,28457899,28463142,28463280,28463337,28464075,28466026,28466774,28472098,28484850,28485263,28485527,28495703,28496198,28496554,28497005,28497816,28519241,28540484,28540753,28540832,28541488,28542122,28542516,28543122,28543351,28543764,28545337,28546027,28563821,28565451,28565831,28566254,28570945,28571776,28572339,28574960,28575596,28597537,28597915,28598173,28599114,28606079,28606278,28612979,2861400', 'assoc_port': '28089591:28090381,28089594:28090160,28089596:28089854,28146548:28146663,28150110:28150562,28156462:28156758,28180176:28186425,28180200:28180288,28195056:28195891,28195059:28195372,28204164:28208079,28218602:28218840,28220920:28221542,28220943:28224000,28225687:28225872,28254378:28255346,28254381:28255089,28254382:28256402,28254385:28254709,28259204:28259461,28265444:28266215,28265455:28267519,28268247:28268350,28268516:28268675,28271938:28272167,28275226:28275366,28298577:28299387,28298579:28299073,28298580:28298717,28304078:28304454,28317462:28321388,28317465:28321003,28317467:28320443,28317509:28319937,28317536:28318608,28317550:28318237,28318849:28319472,28318855:28322773,28325353:28325748,28348936:28352421,28352790:28353314,28352791:28353950,28352794:28353856,28352797:28353017,28353420:28353528,28354585:28354639,28355212:28355241,28356749:28356788,28381336:28381424,28388418:28389003,28388428:28388653,28395537:28396202,28395540:28395832,28403692:28404056,28406458:28407703,28406460:28407143,28415993:2841632', 'assoc_mat': '28089591:pet_clair:3594:28090381,28089594:pet_clair:3594:28090160,28089596:pet_clair:3594:28089854,28146548:pet_clair:3594:28146663,28150110:pet_clair:3594:28150562,28156462:pet_clair:3594:28156758,28180176:pet_clair:3594:28186425,28180200:pet_clair:3594:28180288,28195056:pet_clair:3594:28195891,28195059:pet_clair:3594:28195372,28204164:pet_clair:3594:28208079,28218602:pet_clair:3594:28218840,28220920:pet_clair:3594:28221542,28220943:pet_clair:3594:28224000,28225687:pet_clair:3594:28225872,28254378:pet_clair:3594:28255346,28254381:pet_clair:3594:28255089,28254382:pet_clair:3594:28256402,28254385:pet_clair:3594:28254709,28259204:pet_clair:3594:28259461,28265444:pet_clair:3594:28266215,28265455:pet_clair:3594:28267519,28268247:pet_clair:3594:28268350,28268516:pet_clair:3594:28268675,28271938:pet_clair:3594:28272167,28275226:pet_clair:3594:28275366,28298577:pet_clair:3594:28299387,28298579:pet_clair:3594:28299073,28298580:pet_clair:3594:28298717,28304078:pet_clair:3594:28304454,28317462:pet_clair:3594:28321388,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.00021990845607222246, 'nb_photo': 87, 'list_port_cont': '28090493,28181347,28181452,28187523,28254937,28258023,28259603,28261928,28269027,28283731,28290831,28299132,28317926,28335150,28339124,28342765,28343000,28347427,28354167,28356528,28356813,28360091,28360422,28386583,28389026,28425900,28431803,28433714,28433742,28437610,28448312,28462877,28467789,28495578,28497748,28504326,28504603,28505971,28546648,28547446,28555852,28575017,28576943,28598088,28606360,28614566,28616620,28684439,28703649,28718960,28721843,28722018,28757709,28765696,28768510,28789111,28793267,28805542,28805922,28806549,28810314,28813601', 'assoc_port': '28089593:28090493,28148283:28299132,28180178:28181452,28180199:28181347,28187382:28187523,28187383:28335150,28204166:28342765,28204168:28343000,28220918:28347427,28254380:28254937,28257885:28258023,28259203:28259603,28261836:28261928,28268495:28354167,28268498:28269027,28271937:28290831,28283585:28283731,28299784:28360091,28304075:28360422,28317521:28317926,28325348:28356528,28339120:28339124,28356748:28356813,28385092:28386583,28388426:28389026,28425861:28425900,28431668:28431803,28433628:28433742,28433632:28433714,28437592:28437610,28447945:28448312,28462654:28462877,28467748:28467789,28495451:28504326,28495454:28504603,28495508:28495578,28497669:28505971,28497678:28497748,28541864:28547446,28546234:28546648,28555645:28555852,28574865:28575017,28576675:28576943,28596967:28598088,28605911:28606360,28612828:28614566,28616550:28616620,28676873:28684439,28700485:28703649,28718886:28721843,28718891:28722018,28718896:28718960,28743767:28757709,28765413:28765696,28768492:28768510,28789009:28793267,28789016:2878911', 'assoc_mat': '28089593:pet_fonce:4207:28090493,28148283:pet_fonce:4207:28299132,28180178:pet_fonce:4207:28181452,28180199:pet_fonce:4207:28181347,28187382:pet_fonce:4207:28187523,28187383:pet_fonce:4207:28335150,28204166:pet_fonce:4207:28342765,28204168:pet_fonce:4207:28343000,28220918:pet_fonce:4207:28347427,28254380:pet_fonce:4207:28254937,28257885:pet_fonce:4207:28258023,28259203:pet_fonce:4207:28259603,28261836:pet_fonce:4207:28261928,28268495:pet_fonce:4207:28354167,28268498:pet_fonce:4207:28269027,28271937:pet_fonce:4207:28290831,28283585:pet_fonce:4207:28283731,28299784:pet_fonce:4207:28360091,28304075:pet_fonce:4207:28360422,28317521:pet_fonce:4207:28317926,28325348:pet_fonce:4207:28356528,28339120:pet_fonce:4207:28339124,28356748:pet_fonce:4207:28356813,28385092:pet_fonce:4207:28386583,28388426:pet_fonce:4207:28389026,28425861:pet_fonce:4207:28425900,28431668:pet_fonce:4207:28431803,28433628:pet_fonce:4207:28433742,28433632:pet_fonce:4207:28433714,28437592:pet_fonce:4207:28437610,28447945:pet_fonce:4207:28448312,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'pet_clair', 'pht_type': 3327, 'ratio': 0.014294082572562015, 'nb_photo': 2, 'list_port_cont': '28540463', 'assoc_port': '28540307:28540463', 'assoc_mat': '28540307:pet_fonce:3327:28540463'}, {'unwanted_material': 'pet_fonce', 'main_material': 'refus', 'pht_type': 3594, 'ratio': 0.0003313185439799291, 'nb_photo': 48, 'list_port_cont': '28208085,28223996,28266214,28319477,28325754,28353311,28356791,28396198,28427273,28431770,28431897,28457902,28463275,28472102,28484843,28485266,28540760,28543765,28571771,28597908,28614017,28661071,28677954,28700398,28700947,28703020,28720027,28744409,28759214,28790486,28800649,28801041', 'assoc_port': '28204164:28208085,28220943:28223996,28265444:28266214,28318849:28319477,28325353:28325754,28352790:28353311,28356749:28356791,28395537:28396198,28427141:28427273,28431664:28431897,28431669:28431770,28457119:28457902,28463065:28463275,28472052:28472102,28484569:28485266,28484571:28484843,28540286:28543765,28540300:28540760,28571215:28571771,28596970:28597908,28612812:28614017,28657578:28661071,28677782:28677954,28699663:28700398,28700487:28700947,28700488:28703020,28718887:28720027,28743775:28744409,28759074:28759214,28789015:28790486,28798419:28801041,28798422:28800649', 'assoc_mat': '28204164:pet_fonce:3594:28208085,28220943:pet_fonce:3594:28223996,28265444:pet_fonce:3594:28266214,28318849:pet_fonce:3594:28319477,28325353:pet_fonce:3594:28325754,28352790:pet_fonce:3594:28353311,28356749:pet_fonce:3594:28356791,28395537:pet_fonce:3594:28396198,28427141:pet_fonce:3594:28427273,28431664:pet_fonce:3594:28431897,28431669:pet_fonce:3594:28431770,28457119:pet_fonce:3594:28457902,28463065:pet_fonce:3594:28463275,28472052:pet_fonce:3594:28472102,28484569:pet_fonce:3594:28485266,28484571:pet_fonce:3594:28484843,28540286:pet_fonce:3594:28543765,28540300:pet_fonce:3594:28540760,28571215:pet_fonce:3594:28571771,28596970:pet_fonce:3594:28597908,28612812:pet_fonce:3594:28614017,28657578:pet_fonce:3594:28661071,28677782:pet_fonce:3594:28677954,28699663:pet_fonce:3594:28700398,28700487:pet_fonce:3594:28700947,28700488:pet_fonce:3594:28703020,28718887:pet_fonce:3594:28720027,28743775:pet_fonce:3594:28744409,28759074:pet_fonce:3594:28759214,28789015:pet_fonce:3594:28790486,28798419:pet_fonce:3594:28801041,2'}, {'unwanted_material': 'pet_opaque', 'main_material': 'film_pedb', 'pht_type': 4461, 'ratio': 0.0050734853131264345, 'nb_photo': 2, 'list_port_cont': '28353476,28406633', 'assoc_port': '28353422:28353476,28406456:28406633', 'assoc_mat': '28353422:pet_opaque:4461:28353476,28406456:pet_opaque:4461:28406633'}, {'unwanted_material': 'pet_opaque', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 0.0017315271405296557, 'nb_photo': 314, 'list_port_cont': '28089204,28090081,28148159,28181463,28187516,28218967,28221204,28224852,28228205,28238381,28250146,28258021,28259598,28261937,28266570,28269032,28283745,28288676,28290821,28298680,28298786,28299140,28318141,28318420,28327898,28328459,28328570,28330831,28335153,28337814,28338995,28342760,28344644,28345230,28347372,28347441,28350324,28352837,28353161,28353456,28354157,28355386,28356532,28357059,28357738,28359567,28359642,28359726,28359885,28360408,28361827,28363743,28364047,28382997,28388813,28389369,28395585,28404011,28410530,28414114,28424685,28425890,28425898,28427177,28428771,28429817,28431795,28432372,28433715,28433744,28448311,28449464,28452440,28452479,28452489,28458606,28462869,28467792,28470014,28470729,28472061,28482224,28485377,28495546,28497757,28500637,28504599,28505980,28506873,28540611,28542816,28543468,28543880,28546645,28547017,28547622,28547814,28564185,28570241,28570818,28571521,28571537,28574902,28574987,28575748,28576442,28576728,28576800,28576940,28581346,28605978,28606372,28607164,2861455', 'assoc_port': '28088708:28089204,28089595:28090081,28146552:28288676,28146562:28148159,28148282:28298680,28148283:28299140,28148308:28298786,28153518:28338995,28154448:28330831,28156460:28328570,28180178:28181463,28186185:28327898,28187382:28187516,28187383:28335153,28195058:28344644,28204166:28342760,28207350:28345230,28211945:28347372,28218601:28218967,28220918:28347441,28220931:28221204,28224647:28224852,28225682:28228205,28238299:28238381,28250000:28350324,28250001:28250146,28257885:28258021,28259203:28259598,28261836:28261937,28266490:28266570,28268495:28354157,28268498:28269032,28271937:28290821,28283585:28283745,28298576:28359642,28298578:28359726,28298582:28359885,28304075:28360408,28317456:28361827,28317471:28318420,28317507:28318141,28325348:28356532,28325351:28337814,28325357:28328459,28352787:28353161,28352796:28352837,28353423:28353456,28355213:28355386,28356745:28357059,28357715:28357738,28359465:28359567,28363709:28363743,28363980:28364047,28381333:28382997,28388415:28389369,28388427:28388813,28395542:2839558', 'assoc_mat': '28088708:pet_opaque:4207:28089204,28089595:pet_opaque:4207:28090081,28146552:pet_opaque:4207:28288676,28146562:pet_opaque:4207:28148159,28148282:pet_opaque:4207:28298680,28148283:pet_opaque:4207:28299140,28148308:pet_opaque:4207:28298786,28153518:pet_opaque:4207:28338995,28154448:pet_opaque:4207:28330831,28156460:pet_opaque:4207:28328570,28180178:pet_opaque:4207:28181463,28186185:pet_opaque:4207:28327898,28187382:pet_opaque:4207:28187516,28187383:pet_opaque:4207:28335153,28195058:pet_opaque:4207:28344644,28204166:pet_opaque:4207:28342760,28207350:pet_opaque:4207:28345230,28211945:pet_opaque:4207:28347372,28218601:pet_opaque:4207:28218967,28220918:pet_opaque:4207:28347441,28220931:pet_opaque:4207:28221204,28224647:pet_opaque:4207:28224852,28225682:pet_opaque:4207:28228205,28238299:pet_opaque:4207:28238381,28250000:pet_opaque:4207:28350324,28250001:pet_opaque:4207:28250146,28257885:pet_opaque:4207:28258021,28259203:pet_opaque:4207:28259598,28261836:pet_opaque:4207:28261937,28266490:pet_opaque:4207:28266570,2826'}, {'unwanted_material': 'plastique', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.04643993676496215, 'nb_photo': 3, 'list_port_cont': '28150227,28447994', 'assoc_port': '28150125:28150227,28447947:28447994', 'assoc_mat': '28150125:plastique:3726:28150227,28447947:plastique:3726:28447994'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'jrm', 'pht_type': 3726, 'ratio': 0.003628554788819732, 'nb_photo': 1, 'list_port_cont': '28150228', 'assoc_port': '28150125:28150228', 'assoc_mat': '28150125:Teint_Dans_La_Masse:3726:28150228'}, {'unwanted_material': 'textiles_sanitaires', 'main_material': 'pcnc', 'pht_type': 4207, 'ratio': 8.318546425201849e-05, 'nb_photo': 41, 'list_port_cont': '28148164,28181462,28228207,28238382,28335157,28353459,28354117,28357732,28360089,28363740,28431812,28432364,28433730,28482213,28497710,28504602,28505982,28525774,28547811,28607176,28657614,28677330,28684443,28685707,28700382,28700552,28706654,28726294,28732273,28757867,28764629,28798759,28805079,28806081,28817572', 'assoc_port': '28146562:28148164,28180178:28181462,28187383:28335157,28225682:28228207,28238299:28238382,28268494:28354117,28299784:28360089,28353423:28353459,28357715:28357732,28363709:28363740,28431667:28431812,28432324:28432364,28433628:28433730,28482028:28482213,28495454:28504602,28497669:28505982,28497680:28497710,28518808:28525774,28547792:28547811,28605908:28607176,28657588:28657614,28666744:28677330,28676873:28684443,28685559:28685707,28699664:28700382,28700518:28700552,28703321:28706654,28722252:28726294,28731815:28732273,28743769:28757867,28764623:28764629,28798445:28806081,28798476:28798759,28805051:28805079,28817304:28817572', 'assoc_mat': '28146562:textiles_sanitaires:4207:28148164,28180178:textiles_sanitaires:4207:28181462,28187383:textiles_sanitaires:4207:28335157,28225682:textiles_sanitaires:4207:28228207,28238299:textiles_sanitaires:4207:28238382,28268494:textiles_sanitaires:4207:28354117,28299784:textiles_sanitaires:4207:28360089,28353423:textiles_sanitaires:4207:28353459,28357715:textiles_sanitaires:4207:28357732,28363709:textiles_sanitaires:4207:28363740,28431667:textiles_sanitaires:4207:28431812,28432324:textiles_sanitaires:4207:28432364,28433628:textiles_sanitaires:4207:28433730,28482028:textiles_sanitaires:4207:28482213,28495454:textiles_sanitaires:4207:28504602,28497669:textiles_sanitaires:4207:28505982,28497680:textiles_sanitaires:4207:28497710,28518808:textiles_sanitaires:4207:28525774,28547792:textiles_sanitaires:4207:28547811,28605908:textiles_sanitaires:4207:28607176,28657588:textiles_sanitaires:4207:28657614,28666744:textiles_sanitaires:4207:28677330,28676873:textiles_sanitaires:4207:28684443,28685559:textiles_sanitaires:4207:2'}), 'main_stat': {'nb_photos': 34016}}, 'hostname': (('jetson-5',),), 'impurety_average_per_hashtag': [(('refus', '2025-11', 0.09319346527949272),), (('pcnc', '2025-11', 0.019892228040303026),), (('film_pedb', '2025-11', 0.06530052907418749),), (('jrm', '2025-11', 0.21977885245164472),), (('pet_clair', '2025-11', 0.12744508323893175),)]} filepath : /data_4/data_log/job/memo/sevran/sla_mensuel_Sevran_mois_11_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'pet_clair': {'autre': ['autre', '0.86%', 4], 'carton': ['carton', '9.89%', 2], 'papier': ['papier', '0.57%', 2], 'pet_clair': ['pet_clair', '87.03%', 85], 'pet_fonce': ['pet_fonce', '1.43%', 2]}, 'refus': {'autre': ['autre', '0.13%', 267], 'carton': ['carton', '0.65%', 560], 'metal': ['metal', '0.03%', 108], 'papier': ['papier', '0.73%', 3275], 'pehd': ['pehd', '0.03%', 18], 'pet_clair': ['pet_clair', '7.76%', 2677], 'pet_fonce': ['pet_fonce', '0.03%', 48]}, 'jrm': {'autre_refus': ['autre_refus', '0.94%', 1], 'Carton_brun': ['Carton_brun', '15.38%', 4], 'plastique': ['plastique', '4.64%', 3], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '0.36%', 1]}, 'film_pedb': {'barquette_opaque': ['barquette_opaque', '0.45%', 15], 'carton': ['carton', '0.47%', 138], 'etiquette': ['etiquette', '0.04%', 1], 'film_plastique': ['film_plastique', '93.37%', 2087], 'papier': ['papier', '6.85%', 6543], 'pet_opaque': ['pet_opaque', '0.51%', 2]}, 'pcnc': {'barquette_opaque': ['barquette_opaque', '0.1%', 2353], 'carton': ['carton', '98.41%', 4187], 'etiquette': ['etiquette', '0.03%', 939], 'film_plastique': ['film_plastique', '0.51%', 13020], 'kraft': ['kraft', '0.02%', 21], 'metal': ['metal', '0.32%', 731], 'papier': ['papier', '0.65%', 20452], 'pehd': ['pehd', '0.03%', 48], 'pet_clair': ['pet_clair', '0.2%', 951], 'pet_fonce': ['pet_fonce', '0.02%', 87], 'pet_opaque': ['pet_opaque', '0.17%', 314], 'textiles_sanitaires': ['textiles_sanitaires', '0.01%', 41]}} before plot_matierial_repartition before organize_and_plot_coverage_data Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 Warning a wrong coverage has been found : 0.0 TODO VR to ADNNANE : a mon avis il faut refactorer la préparation des données, je ne comprends pas non plus ce -0.0 et puis il y a un bug avec la taille differente (reproduit en commentant cette ligne ou : --raspi=20077 --use_sqlite --date=2022-09 -v --job=sla_mensuel) Erreur dans le script sla mensuel mise en forme 943: mean requires at least one data point shold exit but treated as warning to keep behavior le fichier se trouve ici : /data_4/data_log/job/memo/sevran 3.17user 3.45system 0:08.18elapsed 81%CPU (0avgtext+0avgdata 177832maxresident)k 2480inputs+1496outputs (51major+40222minor)pagefaults 0swaps