python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30073 --dashboard_places=arc_en_ciel_jrm --rootfolder_sla=/data_2/data_log/job/memo/arc_en_ciel_jrm -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30073, Date : 2025-02 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 10 month : 02 mtr_id : 979 dashboard_places : arc_en_ciel_jrm date : 2025-02 year : 2025 raspi : 30073 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm' and date like '%2025-02%') and created_at like '%2025-02%'))); nb_day : (5, 28) after unwanted_material_data nb_day : (5, 28) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30073%' AND ms.result_str like '%2025/02%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 2131, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21062 seconds', 'coverage_times_pause': '0 days 21369 seconds', 'nb_photos_decision': 2117, 'nb_gray_level_ok': 2117, 'nb_dedup_ok': 40, 'nb_two_criteria_ok': 40, 'nb_forced_upload': 19, 'end_of_day_photos_duplicated': 2072, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 58, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 8, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 8, 'last_update': '2025/02/16', 'portfolio_id': 20578783, 'last_run_id': 1614368, 'total_number_of_photos': 58}} No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84744 seconds', 'coverage_times_pause': '0 days 85972 seconds', 'nb_photos_decision': 8487, 'nb_gray_level_ok': 8487, 'nb_dedup_ok': 4132, 'nb_two_criteria_ok': 4132, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 4355, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4218, 'ratio_coverage': 0.9808446857023808}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 4171, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 45, 'nb_selected_images': 4216, 'last_update': '2025/02/15', 'portfolio_id': 20528746, 'last_run_id': 1613713, 'total_number_of_photos': 4265}} No error ? {'log_dict': {'total_nb_images': 8557, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84513 seconds', 'coverage_times_pause': '0 days 85810 seconds', 'nb_photos_decision': 8485, 'nb_gray_level_ok': 8485, 'nb_dedup_ok': 2982, 'nb_two_criteria_ok': 2982, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 5498, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3055, 'ratio_coverage': 0.9781710436463384}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3018, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3018, 'last_update': '2025/02/14', 'portfolio_id': 20493659, 'last_run_id': 1610648, 'total_number_of_photos': 3073}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85796 seconds', 'nb_photos_decision': 8474, 'nb_gray_level_ok': 8474, 'nb_dedup_ok': 1869, 'nb_two_criteria_ok': 1869, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 6605, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1950, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 36, 'nb_images_finished': 1902, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1902, 'last_update': '2025/02/13', 'portfolio_id': 20464234, 'last_run_id': 1607627, 'total_number_of_photos': 2047}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84304 seconds', 'coverage_times_pause': '0 days 85682 seconds', 'nb_photos_decision': 8480, 'nb_gray_level_ok': 8480, 'nb_dedup_ok': 3065, 'nb_two_criteria_ok': 3065, 'nb_forced_upload': 64, 'end_of_day_photos_duplicated': 5415, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3127, 'ratio_coverage': 0.9757520341670621}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3126, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3126, 'last_update': '2025/02/12', 'portfolio_id': 20423330, 'last_run_id': 1606848, 'total_number_of_photos': 3206}} No error ? {'log_dict': {'total_nb_images': 6779, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 67030 seconds', 'coverage_times_pause': '0 days 67977 seconds', 'nb_photos_decision': 6714, 'nb_gray_level_ok': 6714, 'nb_dedup_ok': 2864, 'nb_two_criteria_ok': 2864, 'nb_forced_upload': 65, 'end_of_day_photos_duplicated': 3850, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2928, 'ratio_coverage': 0.9799850875012792}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2880, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2880, 'last_update': '2025/02/11', 'portfolio_id': 20385772, 'last_run_id': 1601764, 'total_number_of_photos': 2936}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8574, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84744 seconds', 'coverage_times_pause': '0 days 85972 seconds', 'nb_photos_decision': 8487, 'nb_gray_level_ok': 8487, 'nb_dedup_ok': 4132, 'nb_two_criteria_ok': 4132, 'nb_forced_upload': 87, 'end_of_day_photos_duplicated': 4355, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4218, 'ratio_coverage': 0.9808446857023808}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 4171, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 45, 'nb_selected_images': 4216, 'last_update': '2025/02/15', 'portfolio_id': 20528746, 'last_run_id': 1613557, 'total_number_of_photos': 4265}} No error ? {'log_dict': {'total_nb_images': 8557, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84513 seconds', 'coverage_times_pause': '0 days 85810 seconds', 'nb_photos_decision': 8485, 'nb_gray_level_ok': 8485, 'nb_dedup_ok': 2982, 'nb_two_criteria_ok': 2982, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 5498, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3055, 'ratio_coverage': 0.9781710436463384}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3018, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3018, 'last_update': '2025/02/14', 'portfolio_id': 20493659, 'last_run_id': 1610648, 'total_number_of_photos': 3073}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85796 seconds', 'nb_photos_decision': 8474, 'nb_gray_level_ok': 8474, 'nb_dedup_ok': 1869, 'nb_two_criteria_ok': 1869, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 6605, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1950, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 36, 'nb_images_finished': 1902, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1902, 'last_update': '2025/02/13', 'portfolio_id': 20464234, 'last_run_id': 1607627, 'total_number_of_photos': 2047}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84304 seconds', 'coverage_times_pause': '0 days 85682 seconds', 'nb_photos_decision': 8480, 'nb_gray_level_ok': 8480, 'nb_dedup_ok': 3065, 'nb_two_criteria_ok': 3065, 'nb_forced_upload': 64, 'end_of_day_photos_duplicated': 5415, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3127, 'ratio_coverage': 0.9757520341670621}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3126, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3126, 'last_update': '2025/02/12', 'portfolio_id': 20423330, 'last_run_id': 1606848, 'total_number_of_photos': 3206}} No error ? {'log_dict': {'total_nb_images': 6779, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 67030 seconds', 'coverage_times_pause': '0 days 67977 seconds', 'nb_photos_decision': 6714, 'nb_gray_level_ok': 6714, 'nb_dedup_ok': 2864, 'nb_two_criteria_ok': 2864, 'nb_forced_upload': 65, 'end_of_day_photos_duplicated': 3850, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2928, 'ratio_coverage': 0.9799850875012792}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2880, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2880, 'last_update': '2025/02/11', 'portfolio_id': 20385772, 'last_run_id': 1601764, 'total_number_of_photos': 2936}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597438, 'total_number_of_photos': 44}} No error ? {'log_dict': {'total_nb_images': 8557, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84513 seconds', 'coverage_times_pause': '0 days 85810 seconds', 'nb_photos_decision': 8485, 'nb_gray_level_ok': 8485, 'nb_dedup_ok': 2982, 'nb_two_criteria_ok': 2982, 'nb_forced_upload': 77, 'end_of_day_photos_duplicated': 5498, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3055, 'ratio_coverage': 0.9781710436463384}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3018, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3018, 'last_update': '2025/02/14', 'portfolio_id': 20493659, 'last_run_id': 1610556, 'total_number_of_photos': 3073}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85796 seconds', 'nb_photos_decision': 8474, 'nb_gray_level_ok': 8474, 'nb_dedup_ok': 1869, 'nb_two_criteria_ok': 1869, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 6605, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1950, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 36, 'nb_images_finished': 1902, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1902, 'last_update': '2025/02/13', 'portfolio_id': 20464234, 'last_run_id': 1607627, 'total_number_of_photos': 2047}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84304 seconds', 'coverage_times_pause': '0 days 85682 seconds', 'nb_photos_decision': 8480, 'nb_gray_level_ok': 8480, 'nb_dedup_ok': 3065, 'nb_two_criteria_ok': 3065, 'nb_forced_upload': 64, 'end_of_day_photos_duplicated': 5415, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3127, 'ratio_coverage': 0.9757520341670621}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3126, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3126, 'last_update': '2025/02/12', 'portfolio_id': 20423330, 'last_run_id': 1606848, 'total_number_of_photos': 3206}} No error ? {'log_dict': {'total_nb_images': 6779, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 67030 seconds', 'coverage_times_pause': '0 days 67977 seconds', 'nb_photos_decision': 6714, 'nb_gray_level_ok': 6714, 'nb_dedup_ok': 2864, 'nb_two_criteria_ok': 2864, 'nb_forced_upload': 65, 'end_of_day_photos_duplicated': 3850, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2928, 'ratio_coverage': 0.9799850875012792}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2880, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2880, 'last_update': '2025/02/11', 'portfolio_id': 20385772, 'last_run_id': 1601764, 'total_number_of_photos': 2936}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597438, 'total_number_of_photos': 44}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/12', 'portfolio_id': 20315060, 'last_run_id': 1597405, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84445 seconds', 'coverage_times_pause': '0 days 85796 seconds', 'nb_photos_decision': 8474, 'nb_gray_level_ok': 8474, 'nb_dedup_ok': 1869, 'nb_two_criteria_ok': 1869, 'nb_forced_upload': 82, 'end_of_day_photos_duplicated': 6605, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 1950, 'ratio_coverage': 0.9773839974999711}, 'dashboard_dict': {'nb_ptf_finished': 36, 'nb_images_finished': 1902, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1902, 'last_update': '2025/02/13', 'portfolio_id': 20464234, 'last_run_id': 1607531, 'total_number_of_photos': 2047}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84304 seconds', 'coverage_times_pause': '0 days 85682 seconds', 'nb_photos_decision': 8480, 'nb_gray_level_ok': 8480, 'nb_dedup_ok': 3065, 'nb_two_criteria_ok': 3065, 'nb_forced_upload': 64, 'end_of_day_photos_duplicated': 5415, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3127, 'ratio_coverage': 0.9757520341670621}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3126, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3126, 'last_update': '2025/02/12', 'portfolio_id': 20423330, 'last_run_id': 1606848, 'total_number_of_photos': 3206}} No error ? {'log_dict': {'total_nb_images': 6779, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 67030 seconds', 'coverage_times_pause': '0 days 67977 seconds', 'nb_photos_decision': 6714, 'nb_gray_level_ok': 6714, 'nb_dedup_ok': 2864, 'nb_two_criteria_ok': 2864, 'nb_forced_upload': 65, 'end_of_day_photos_duplicated': 3850, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2928, 'ratio_coverage': 0.9799850875012792}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2880, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2880, 'last_update': '2025/02/11', 'portfolio_id': 20385772, 'last_run_id': 1601764, 'total_number_of_photos': 2936}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597438, 'total_number_of_photos': 44}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/12', 'portfolio_id': 20315060, 'last_run_id': 1597405, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84460 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 3647, 'nb_two_criteria_ok': 3647, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4751, 'end_of_day_photos_nothing_done': 354, 'end_of_day_photos_uploaded': 3446, 'ratio_coverage': 0.9775576106204933}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2954, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 778, 'nb_selected_images': 3732, 'last_update': '2025/02/10', 'portfolio_id': 20278395, 'last_run_id': 1598105, 'total_number_of_photos': 3773}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84304 seconds', 'coverage_times_pause': '0 days 85682 seconds', 'nb_photos_decision': 8480, 'nb_gray_level_ok': 8480, 'nb_dedup_ok': 3065, 'nb_two_criteria_ok': 3065, 'nb_forced_upload': 64, 'end_of_day_photos_duplicated': 5415, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 3127, 'ratio_coverage': 0.9757520341670621}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3126, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3126, 'last_update': '2025/02/12', 'portfolio_id': 20423330, 'last_run_id': 1604641, 'total_number_of_photos': 3206}} No error ? {'log_dict': {'total_nb_images': 6779, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 67030 seconds', 'coverage_times_pause': '0 days 67977 seconds', 'nb_photos_decision': 6714, 'nb_gray_level_ok': 6714, 'nb_dedup_ok': 2864, 'nb_two_criteria_ok': 2864, 'nb_forced_upload': 65, 'end_of_day_photos_duplicated': 3850, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 2928, 'ratio_coverage': 0.9799850875012792}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 2880, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2880, 'last_update': '2025/02/11', 'portfolio_id': 20385772, 'last_run_id': 1601764, 'total_number_of_photos': 2936}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597438, 'total_number_of_photos': 44}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/10', 'portfolio_id': 20315060, 'last_run_id': 1597405, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84460 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 3647, 'nb_two_criteria_ok': 3647, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4751, 'end_of_day_photos_nothing_done': 354, 'end_of_day_photos_uploaded': 3446, 'ratio_coverage': 0.9775576106204933}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2954, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 778, 'nb_selected_images': 3732, 'last_update': '2025/02/10', 'portfolio_id': 20278395, 'last_run_id': 1598105, 'total_number_of_photos': 3773}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 3304, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 1001, 'nb_selected_images': 4305, 'last_update': '2025/02/10', 'portfolio_id': 20234215, 'last_run_id': 1597709, 'total_number_of_photos': 4327}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597438, 'total_number_of_photos': 44}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/09', 'portfolio_id': 20315060, 'last_run_id': 1597405, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84460 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 3647, 'nb_two_criteria_ok': 3647, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4751, 'end_of_day_photos_nothing_done': 354, 'end_of_day_photos_uploaded': 3446, 'ratio_coverage': 0.9775576106204933}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2954, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 778, 'nb_selected_images': 3732, 'last_update': '2025/02/10', 'portfolio_id': 20278395, 'last_run_id': 1598105, 'total_number_of_photos': 3773}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 3304, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 17, 'nb_images_started': 1001, 'nb_selected_images': 4305, 'last_update': '2025/02/09', 'portfolio_id': 20234215, 'last_run_id': 1597709, 'total_number_of_photos': 4327}} No error ? {'log_dict': {'total_nb_images': 8598, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84879 seconds', 'coverage_times_pause': '0 days 86214 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 2496, 'nb_two_criteria_ok': 2496, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5660, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 2578, 'ratio_coverage': 0.9824072037870809}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2445, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 276, 'nb_selected_images': 2721, 'last_update': '2025/02/08', 'portfolio_id': 20195867, 'last_run_id': 1596238, 'total_number_of_photos': 2835}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66794 seconds', 'coverage_times_pause': '0 days 67856 seconds', 'nb_photos_decision': 6347, 'nb_gray_level_ok': 6347, 'nb_dedup_ok': 1860, 'nb_two_criteria_ok': 1860, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 4487, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 1920, 'ratio_coverage': 0.9765347446600097}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1759, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 120, 'nb_selected_images': 1879, 'last_update': '2025/02/07', 'portfolio_id': 20166663, 'last_run_id': 1594344, 'total_number_of_photos': 1932}} No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 17584 seconds', 'coverage_times_pause': '0 days 17828 seconds', 'nb_photos_decision': 1770, 'nb_gray_level_ok': 1770, 'nb_dedup_ok': 31, 'nb_two_criteria_ok': 31, 'nb_forced_upload': 13, 'end_of_day_photos_duplicated': 1734, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 43, 'ratio_coverage': 0.9769431635090838}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/09', 'portfolio_id': 20353393, 'last_run_id': 1597418, 'total_number_of_photos': 43}} No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/09', 'portfolio_id': 20315060, 'last_run_id': 1597405, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84460 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 3647, 'nb_two_criteria_ok': 3647, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4751, 'end_of_day_photos_nothing_done': 354, 'end_of_day_photos_uploaded': 3446, 'ratio_coverage': 0.9775576106204933}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2939, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 793, 'nb_selected_images': 3732, 'last_update': '2025/02/07', 'portfolio_id': 20278395, 'last_run_id': 1592737, 'total_number_of_photos': 3773}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 3232, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1073, 'nb_selected_images': 4305, 'last_update': '2025/02/06', 'portfolio_id': 20234215, 'last_run_id': 1589821, 'total_number_of_photos': 4327}} No error ? {'log_dict': {'total_nb_images': 8598, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84879 seconds', 'coverage_times_pause': '0 days 86214 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 2496, 'nb_two_criteria_ok': 2496, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5660, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 2578, 'ratio_coverage': 0.9824072037870809}, 'dashboard_dict': {'nb_ptf_finished': 43, 'nb_images_finished': 2445, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 276, 'nb_selected_images': 2721, 'last_update': '2025/02/08', 'portfolio_id': 20195867, 'last_run_id': 1596238, 'total_number_of_photos': 2835}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66794 seconds', 'coverage_times_pause': '0 days 67856 seconds', 'nb_photos_decision': 6347, 'nb_gray_level_ok': 6347, 'nb_dedup_ok': 1860, 'nb_two_criteria_ok': 1860, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 4487, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 1920, 'ratio_coverage': 0.9765347446600097}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1759, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 120, 'nb_selected_images': 1879, 'last_update': '2025/02/07', 'portfolio_id': 20166663, 'last_run_id': 1594344, 'total_number_of_photos': 1932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8556, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84558 seconds', 'coverage_times_pause': '0 days 85798 seconds', 'nb_photos_decision': 8819, 'nb_gray_level_ok': 8819, 'nb_dedup_ok': 3249, 'nb_two_criteria_ok': 3249, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5385, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3170, 'ratio_coverage': 0.9786918830079052}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 2941, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 197, 'nb_selected_images': 3138, 'last_update': '2025/02/08', 'portfolio_id': 20315060, 'last_run_id': 1595956, 'total_number_of_photos': 3204}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84460 seconds', 'coverage_times_pause': '0 days 85744 seconds', 'nb_photos_decision': 8484, 'nb_gray_level_ok': 8484, 'nb_dedup_ok': 3647, 'nb_two_criteria_ok': 3647, 'nb_forced_upload': 72, 'end_of_day_photos_duplicated': 4751, 'end_of_day_photos_nothing_done': 354, 'end_of_day_photos_uploaded': 3446, 'ratio_coverage': 0.9775576106204933}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 2939, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 793, 'nb_selected_images': 3732, 'last_update': '2025/02/07', 'portfolio_id': 20278395, 'last_run_id': 1592737, 'total_number_of_photos': 3773}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 3232, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1073, 'nb_selected_images': 4305, 'last_update': '2025/02/06', 'portfolio_id': 20234215, 'last_run_id': 1589821, 'total_number_of_photos': 4327}} No error ? {'log_dict': {'total_nb_images': 8598, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84879 seconds', 'coverage_times_pause': '0 days 86214 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 2496, 'nb_two_criteria_ok': 2496, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5660, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 2578, 'ratio_coverage': 0.9824072037870809}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/04', 'portfolio_id': 20195867, 'last_run_id': 1585763, 'total_number_of_photos': 2835}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66794 seconds', 'coverage_times_pause': '0 days 67856 seconds', 'nb_photos_decision': 6347, 'nb_gray_level_ok': 6347, 'nb_dedup_ok': 1860, 'nb_two_criteria_ok': 1860, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 4487, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 1920, 'ratio_coverage': 0.9765347446600097}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1759, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 120, 'nb_selected_images': 1879, 'last_update': '2025/02/07', 'portfolio_id': 20166663, 'last_run_id': 1594344, 'total_number_of_photos': 1932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 3232, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1073, 'nb_selected_images': 4305, 'last_update': '2025/02/06', 'portfolio_id': 20234215, 'last_run_id': 1589821, 'total_number_of_photos': 4327}} No error ? {'log_dict': {'total_nb_images': 8598, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84879 seconds', 'coverage_times_pause': '0 days 86214 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 2496, 'nb_two_criteria_ok': 2496, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5660, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 2578, 'ratio_coverage': 0.9824072037870809}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/04', 'portfolio_id': 20195867, 'last_run_id': 1585763, 'total_number_of_photos': 2835}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66794 seconds', 'coverage_times_pause': '0 days 67856 seconds', 'nb_photos_decision': 6347, 'nb_gray_level_ok': 6347, 'nb_dedup_ok': 1860, 'nb_two_criteria_ok': 1860, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 4487, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 1920, 'ratio_coverage': 0.9765347446600097}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1759, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 120, 'nb_selected_images': 1879, 'last_update': '2025/02/04', 'portfolio_id': 20166663, 'last_run_id': 1583258, 'total_number_of_photos': 1932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8561, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84535 seconds', 'coverage_times_pause': '0 days 85853 seconds', 'nb_photos_decision': 8477, 'nb_gray_level_ok': 8477, 'nb_dedup_ok': 4150, 'nb_two_criteria_ok': 4150, 'nb_forced_upload': 85, 'end_of_day_photos_duplicated': 4207, 'end_of_day_photos_nothing_done': 359, 'end_of_day_photos_uploaded': 3995, 'ratio_coverage': 0.9784256762231044}, 'dashboard_dict': {'nb_ptf_finished': 60, 'nb_images_finished': 3232, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 18, 'nb_images_started': 1073, 'nb_selected_images': 4305, 'last_update': '2025/02/06', 'portfolio_id': 20234215, 'last_run_id': 1589821, 'total_number_of_photos': 4327}} No error ? {'log_dict': {'total_nb_images': 8598, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84879 seconds', 'coverage_times_pause': '0 days 86214 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 2496, 'nb_two_criteria_ok': 2496, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 5660, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 2578, 'ratio_coverage': 0.9824072037870809}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/04', 'portfolio_id': 20195867, 'last_run_id': 1585763, 'total_number_of_photos': 2835}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66794 seconds', 'coverage_times_pause': '0 days 67856 seconds', 'nb_photos_decision': 6347, 'nb_gray_level_ok': 6347, 'nb_dedup_ok': 1860, 'nb_two_criteria_ok': 1860, 'nb_forced_upload': 61, 'end_of_day_photos_duplicated': 4487, 'end_of_day_photos_nothing_done': 360, 'end_of_day_photos_uploaded': 1920, 'ratio_coverage': 0.9765347446600097}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 1759, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 2, 'nb_images_started': 120, 'nb_selected_images': 1879, 'last_update': '2025/02/04', 'portfolio_id': 20166663, 'last_run_id': 1583258, 'total_number_of_photos': 1932}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579616, 'total_number_of_photos': 940}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1778, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17570 seconds', 'coverage_times_pause': '0 days 17831 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 1094, 'nb_two_criteria_ok': 1094, 'nb_forced_upload': 15, 'end_of_day_photos_duplicated': 868, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 909, 'ratio_coverage': 0.9761653425190289}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 790, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 146, 'nb_selected_images': 936, 'last_update': '2025/02/02', 'portfolio_id': 20128731, 'last_run_id': 1579591, 'total_number_of_photos': 939}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-02-15 00:00:00 Found day : 2025-02-14 00:00:00 Found day : 2025-02-13 00:00:00 Found day : 2025-02-12 00:00:00 Found day : 2025-02-11 00:00:00 Found day : 2025-02-10 00:00:00 Found day : 2025-02-08 00:00:00 Found day : 2025-02-07 00:00:00 Found day : 2025-02-06 00:00:00 Found day : 2025-02-05 00:00:00 Found day : 2025-02-04 00:00:00 Found day : 2025-02-03 00:00:00 Found day : 2025-02-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-02-17 00:00:00,2025-02-18 00:00:00,2025-02-19 00:00:00,2025-02-20 00:00:00,2025-02-21 00:00:00,2025-02-22 00:00:00,2025-02-24 00:00:00,2025-02-25 00:00:00,2025-02-26 00:00:00,2025-02-27 00:00:00,2025-02-28 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 10 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 10 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 10 and mp.name like '%022025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-02-01 : dt_date_just_month_year : 2025-02-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-02-01" AND ded.date <= "2025-02-28" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 4302, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1579616,1594344,1596238,1597709,1598105,1597405,1597438,1601764,1606848,1607627,1610648,1613713,1614373) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.009889602103730105, 'nb_photo': 6496, 'list_port_cont': '20129233,20129325,20129417,20129540,20129632,20130348,20131116,20131746,20132411,20132816,20133417,20134040,20134645,20146910,20146928,20146960,20146986,20166837,20167034,20169710,20169986,20170643,20170941,20171402,20172085,20172682,20172839,20173632,20174029,20174904,20175403,20177902,20179111,20179158,20179470,20179612,20180441,20181091,20181932,20182633,20183000,20183597,20183991,20184581,20185195,20185696,20187377,20187636,20188041,20188777,20189294,20189944,20190731,20191214,20191408,20191833,20200623,20201203,20203022,20203370,20203740,20204444,20205062,20205934,20206417,20207223,20210408,20210626,20210898,20211100,20211689,20212407,20213238,20213963,20214627,20215231,20215795,20216334,20217021,20217812,20218549,20218987,20220451,20220855,20221526,20222020,20222824,20223572,20224508,20225225,20225771,20227003,20228361,20228654,20229118,20229634,20230405,20231042,20234533,20234764,20234839,20235158,20235941,20236753,20237233,20238046,20238751,20239159,20239997,20240213,20241051,20241198,20241811,2024258', 'assoc_port': '20129197:20129233,20129199:20129325,20129398:20129417,20129522:20129540,20129564:20129632,20130338:20130348,20131031:20131116,20131722:20131746,20132396:20132411,20132801:20132816,20133387:20133417,20134034:20134040,20134638:20134645,20146861:20146986,20146862:20146960,20146863:20146928,20146864:20146910,20166823:20166837,20167022:20167034,20169696:20169710,20169975:20169986,20170583:20170643,20170900:20170941,20171366:20171402,20172070:20172085,20172623:20172682,20172805:20172839,20173625:20173632,20173987:20174029,20174900:20174904,20175385:20175403,20177856:20177902,20179072:20179111,20179073:20179158,20179367:20179470,20179533:20179612,20180407:20180441,20181040:20181091,20181913:20181932,20182591:20182633,20182990:20183000,20183534:20183597,20183944:20183991,20184567:20184581,20185163:20185195,20185669:20185696,20187367:20187377,20187589:20187636,20187986:20188041,20188631:20188777,20189285:20189294,20189909:20189944,20190694:20190731,20191207:20191214,20191390:20191408,20191824:20191833,20200617:2020062', 'assoc_mat': '20129197:autre_refus:3726:20129233,20129199:autre_refus:3726:20129325,20129398:autre_refus:3726:20129417,20129522:autre_refus:3726:20129540,20129564:autre_refus:3726:20129632,20130338:autre_refus:3726:20130348,20131031:autre_refus:3726:20131116,20131722:autre_refus:3726:20131746,20132396:autre_refus:3726:20132411,20132801:autre_refus:3726:20132816,20133387:autre_refus:3726:20133417,20134034:autre_refus:3726:20134040,20134638:autre_refus:3726:20134645,20146861:autre_refus:3726:20146986,20146862:autre_refus:3726:20146960,20146863:autre_refus:3726:20146928,20146864:autre_refus:3726:20146910,20166823:autre_refus:3726:20166837,20167022:autre_refus:3726:20167034,20169696:autre_refus:3726:20169710,20169975:autre_refus:3726:20169986,20170583:autre_refus:3726:20170643,20170900:autre_refus:3726:20170941,20171366:autre_refus:3726:20171402,20172070:autre_refus:3726:20172085,20172623:autre_refus:3726:20172682,20172805:autre_refus:3726:20172839,20173625:autre_refus:3726:20173632,20173987:autre_refus:3726:20174029,20174900:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004074725237424609, 'nb_photo': 7123, 'list_port_cont': '20129237,20129320,20129418,20129535,20129633,20130343,20131111,20131751,20132406,20132811,20133414,20134041,20134652,20146909,20146938,20146956,20146981,20166829,20167032,20169704,20169984,20170638,20170942,20171403,20172840,20173638,20174023,20174908,20175404,20177910,20179100,20179154,20179617,20180451,20181084,20181928,20182642,20183010,20183585,20183983,20184587,20185193,20185698,20187375,20188043,20188785,20189303,20189946,20190725,20191403,20191836,20200626,20200939,20201198,20203013,20203365,20203738,20204448,20205059,20205937,20206406,20206723,20207228,20210415,20210622,20211099,20211680,20212408,20213243,20213960,20214628,20215232,20215801,20216333,20217019,20217807,20218547,20218984,20220448,20220857,20221519,20222027,20222820,20223574,20224499,20225235,20225773,20227008,20228362,20228651,20229125,20229635,20230406,20231039,20234537,20234834,20235159,20235934,20236742,20237236,20238036,20238760,20239156,20239998,20240205,20241053,20241201,20241812,20242572,20243040,20243327,20244113,20244407,2024497', 'assoc_port': '20129197:20129237,20129199:20129320,20129398:20129418,20129522:20129535,20129564:20129633,20130338:20130343,20131031:20131111,20131722:20131751,20132396:20132406,20132801:20132811,20133387:20133414,20134034:20134041,20134638:20134652,20146861:20146981,20146862:20146956,20146863:20146938,20146864:20146909,20166823:20166829,20167022:20167032,20169696:20169704,20169975:20169984,20170583:20170638,20170900:20170942,20171366:20171403,20172805:20172840,20173625:20173638,20173987:20174023,20174900:20174908,20175385:20175404,20177856:20177910,20179072:20179100,20179073:20179154,20179533:20179617,20180407:20180451,20181040:20181084,20181913:20181928,20182591:20182642,20182990:20183010,20183534:20183585,20183944:20183983,20184567:20184587,20185163:20185193,20185669:20185698,20187367:20187375,20187986:20188043,20188631:20188785,20189285:20189303,20189909:20189946,20190694:20190725,20191390:20191403,20191824:20191836,20200617:20200626,20200932:20200939,20201187:20201198,20203010:20203013,20203352:20203365,20203720:2020373', 'assoc_mat': '20129197:cartonnette:3726:20129237,20129199:cartonnette:3726:20129320,20129398:cartonnette:3726:20129418,20129522:cartonnette:3726:20129535,20129564:cartonnette:3726:20129633,20130338:cartonnette:3726:20130343,20131031:cartonnette:3726:20131111,20131722:cartonnette:3726:20131751,20132396:cartonnette:3726:20132406,20132801:cartonnette:3726:20132811,20133387:cartonnette:3726:20133414,20134034:cartonnette:3726:20134041,20134638:cartonnette:3726:20134652,20146861:cartonnette:3726:20146981,20146862:cartonnette:3726:20146956,20146863:cartonnette:3726:20146938,20146864:cartonnette:3726:20146909,20166823:cartonnette:3726:20166829,20167022:cartonnette:3726:20167032,20169696:cartonnette:3726:20169704,20169975:cartonnette:3726:20169984,20170583:cartonnette:3726:20170638,20170900:cartonnette:3726:20170942,20171366:cartonnette:3726:20171403,20172805:cartonnette:3726:20172840,20173625:cartonnette:3726:20173638,20173987:cartonnette:3726:20174023,20174900:cartonnette:3726:20174908,20175385:cartonnette:3726:20175404,20177856:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.010060158183354003, 'nb_photo': 8319, 'list_port_cont': '20129231,20129319,20129411,20129534,20129637,20130346,20131110,20131743,20132408,20132812,20133408,20134046,20134653,20146906,20146933,20146957,20146978,20166831,20167024,20169708,20169981,20170640,20170939,20172075,20172680,20172828,20173628,20174020,20174914,20175395,20177900,20179107,20179151,20179465,20179606,20180447,20181087,20181924,20182641,20183007,20183584,20183994,20184579,20185191,20185694,20187383,20188038,20188787,20189296,20189950,20190724,20191404,20191838,20201205,20203021,20203367,20203736,20204449,20205057,20205936,20206408,20206724,20207231,20210414,20210628,20210891,20211109,20211678,20212409,20213240,20213967,20214630,20215228,20215793,20216335,20217025,20217805,20218544,20218982,20220447,20220850,20221524,20222018,20222825,20223578,20224500,20225230,20225769,20226959,20226999,20228364,20228648,20229121,20229641,20230404,20231034,20234530,20234767,20234832,20235169,20235931,20236751,20237241,20238041,20238758,20239153,20240002,20240210,20241056,20241200,20241803,20242579,20243045,2024333', 'assoc_port': '20129197:20129231,20129199:20129319,20129398:20129411,20129522:20129534,20129564:20129637,20130338:20130346,20131031:20131110,20131722:20131743,20132396:20132408,20132801:20132812,20133387:20133408,20134034:20134046,20134638:20134653,20146861:20146978,20146862:20146957,20146863:20146933,20146864:20146906,20166823:20166831,20167022:20167024,20169696:20169708,20169975:20169981,20170583:20170640,20170900:20170939,20172070:20172075,20172623:20172680,20172805:20172828,20173625:20173628,20173987:20174020,20174900:20174914,20175385:20175395,20177856:20177900,20179072:20179107,20179073:20179151,20179367:20179465,20179533:20179606,20180407:20180447,20181040:20181087,20181913:20181924,20182591:20182641,20182990:20183007,20183534:20183584,20183944:20183994,20184567:20184579,20185163:20185191,20185669:20185694,20187367:20187383,20187986:20188038,20188631:20188787,20189285:20189296,20189909:20189950,20190694:20190724,20191390:20191404,20191824:20191838,20201187:20201205,20203010:20203021,20203352:20203367,20203720:2020373', 'assoc_mat': '20129197:Carton_brun:3726:20129231,20129199:Carton_brun:3726:20129319,20129398:Carton_brun:3726:20129411,20129522:Carton_brun:3726:20129534,20129564:Carton_brun:3726:20129637,20130338:Carton_brun:3726:20130346,20131031:Carton_brun:3726:20131110,20131722:Carton_brun:3726:20131743,20132396:Carton_brun:3726:20132408,20132801:Carton_brun:3726:20132812,20133387:Carton_brun:3726:20133408,20134034:Carton_brun:3726:20134046,20134638:Carton_brun:3726:20134653,20146861:Carton_brun:3726:20146978,20146862:Carton_brun:3726:20146957,20146863:Carton_brun:3726:20146933,20146864:Carton_brun:3726:20146906,20166823:Carton_brun:3726:20166831,20167022:Carton_brun:3726:20167024,20169696:Carton_brun:3726:20169708,20169975:Carton_brun:3726:20169981,20170583:Carton_brun:3726:20170640,20170900:Carton_brun:3726:20170939,20172070:Carton_brun:3726:20172075,20172623:Carton_brun:3726:20172680,20172805:Carton_brun:3726:20172828,20173625:Carton_brun:3726:20173628,20173987:Carton_brun:3726:20174020,20174900:Carton_brun:3726:20174914,20175385:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007624032661778287, 'nb_photo': 7755, 'list_port_cont': '20129239,20129317,20129410,20129538,20129636,20130350,20131112,20131744,20132404,20132809,20133410,20134043,20134649,20146903,20146936,20146953,20146975,20166828,20167025,20169705,20169989,20170642,20170943,20171394,20172084,20172679,20172836,20173636,20174028,20174905,20175405,20177904,20179110,20179159,20179463,20179610,20180448,20181093,20181925,20182634,20183009,20183589,20183985,20184580,20185187,20185697,20187380,20187637,20188032,20188776,20189297,20189942,20190721,20191215,20191405,20191841,20200629,20200949,20201201,20203018,20203363,20203730,20204453,20205053,20205942,20206409,20207233,20210632,20211098,20211684,20212406,20213234,20213961,20214624,20215233,20215796,20216344,20217020,20217803,20218539,20218983,20220446,20220851,20221516,20222026,20222822,20223571,20224501,20225227,20225778,20226953,20227009,20228370,20228652,20229124,20229631,20230413,20231035,20234532,20234770,20234837,20235168,20235942,20236746,20237238,20238045,20238754,20239158,20240000,20240202,20241050,20241202,20241808,2024258', 'assoc_port': '20129197:20129239,20129199:20129317,20129398:20129410,20129522:20129538,20129564:20129636,20130338:20130350,20131031:20131112,20131722:20131744,20132396:20132404,20132801:20132809,20133387:20133410,20134034:20134043,20134638:20134649,20146861:20146975,20146862:20146953,20146863:20146936,20146864:20146903,20166823:20166828,20167022:20167025,20169696:20169705,20169975:20169989,20170583:20170642,20170900:20170943,20171366:20171394,20172070:20172084,20172623:20172679,20172805:20172836,20173625:20173636,20173987:20174028,20174900:20174905,20175385:20175405,20177856:20177904,20179072:20179110,20179073:20179159,20179367:20179463,20179533:20179610,20180407:20180448,20181040:20181093,20181913:20181925,20182591:20182634,20182990:20183009,20183534:20183589,20183944:20183985,20184567:20184580,20185163:20185187,20185669:20185697,20187367:20187380,20187589:20187637,20187986:20188032,20188631:20188776,20189285:20189297,20189909:20189942,20190694:20190721,20191207:20191215,20191390:20191405,20191824:20191841,20200617:2020062', 'assoc_mat': '20129197:Carton_gris:3726:20129239,20129199:Carton_gris:3726:20129317,20129398:Carton_gris:3726:20129410,20129522:Carton_gris:3726:20129538,20129564:Carton_gris:3726:20129636,20130338:Carton_gris:3726:20130350,20131031:Carton_gris:3726:20131112,20131722:Carton_gris:3726:20131744,20132396:Carton_gris:3726:20132404,20132801:Carton_gris:3726:20132809,20133387:Carton_gris:3726:20133410,20134034:Carton_gris:3726:20134043,20134638:Carton_gris:3726:20134649,20146861:Carton_gris:3726:20146975,20146862:Carton_gris:3726:20146953,20146863:Carton_gris:3726:20146936,20146864:Carton_gris:3726:20146903,20166823:Carton_gris:3726:20166828,20167022:Carton_gris:3726:20167025,20169696:Carton_gris:3726:20169705,20169975:Carton_gris:3726:20169989,20170583:Carton_gris:3726:20170642,20170900:Carton_gris:3726:20170943,20171366:Carton_gris:3726:20171394,20172070:Carton_gris:3726:20172084,20172623:Carton_gris:3726:20172679,20172805:Carton_gris:3726:20172836,20173625:Carton_gris:3726:20173636,20173987:Carton_gris:3726:20174028,20174900:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0019079627108361987, 'nb_photo': 1453, 'list_port_cont': '20129322,20129408,20129537,20129639,20130349,20131114,20131747,20132807,20133406,20134042,20146905,20167027,20169978,20170639,20170936,20172675,20172831,20174915,20175397,20179109,20179155,20180449,20181089,20181926,20182632,20183988,20184576,20185693,20187379,20188037,20189305,20191407,20203731,20205939,20206410,20211103,20213244,20214625,20215800,20216340,20217018,20218545,20218989,20220456,20220853,20222025,20222817,20223568,20224504,20225226,20225776,20227004,20228363,20229126,20229640,20230407,20231040,20234771,20234831,20235940,20236750,20237234,20238039,20238756,20239161,20240209,20241054,20241199,20241810,20242573,20243043,20244109,20244401,20245388,20246033,20246875,20247638,20249944,20250375,20251314,20252414,20253187,20255276,20258043,20258659,20259968,20260686,20261462,20262251,20262971,20264305,20264921,20265544,20266219,20268729,20269394,20270701,20271138,20271632,20273568,20273749,20274066,20274983,20275491,20279100,20279226,20279459,20280269,20281127,20281915,20282573,20283044,20283666,2028458', 'assoc_port': '20129199:20129322,20129398:20129408,20129522:20129537,20129564:20129639,20130338:20130349,20131031:20131114,20131722:20131747,20132801:20132807,20133387:20133406,20134034:20134042,20146864:20146905,20167022:20167027,20169975:20169978,20170583:20170639,20170900:20170936,20172623:20172675,20172805:20172831,20174900:20174915,20175385:20175397,20179072:20179109,20179073:20179155,20180407:20180449,20181040:20181089,20181913:20181926,20182591:20182632,20183944:20183988,20184567:20184576,20185669:20185693,20187367:20187379,20187986:20188037,20189285:20189305,20191390:20191407,20203720:20203731,20205929:20205939,20206399:20206410,20211089:20211103,20213225:20213244,20214615:20214625,20215739:20215800,20216292:20216340,20217004:20217018,20218534:20218545,20218946:20218989,20220417:20220456,20220809:20220853,20222000:20222025,20222746:20222817,20223512:20223568,20224457:20224504,20225220:20225226,20225760:20225776,20226990:20227004,20228358:20228363,20229074:20229126,20229623:20229640,20230358:20230407,20231025:2023104', 'assoc_mat': '20129199:kraft:3726:20129322,20129398:kraft:3726:20129408,20129522:kraft:3726:20129537,20129564:kraft:3726:20129639,20130338:kraft:3726:20130349,20131031:kraft:3726:20131114,20131722:kraft:3726:20131747,20132801:kraft:3726:20132807,20133387:kraft:3726:20133406,20134034:kraft:3726:20134042,20146864:kraft:3726:20146905,20167022:kraft:3726:20167027,20169975:kraft:3726:20169978,20170583:kraft:3726:20170639,20170900:kraft:3726:20170936,20172623:kraft:3726:20172675,20172805:kraft:3726:20172831,20174900:kraft:3726:20174915,20175385:kraft:3726:20175397,20179072:kraft:3726:20179109,20179073:kraft:3726:20179155,20180407:kraft:3726:20180449,20181040:kraft:3726:20181089,20181913:kraft:3726:20181926,20182591:kraft:3726:20182632,20183944:kraft:3726:20183988,20184567:kraft:3726:20184576,20185669:kraft:3726:20185693,20187367:kraft:3726:20187379,20187986:kraft:3726:20188037,20189285:kraft:3726:20189305,20191390:kraft:3726:20191407,20203720:kraft:3726:20203731,20205929:kraft:3726:20205939,20206399:kraft:3726:20206410,20211089:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005456109868244429, 'nb_photo': 274, 'list_port_cont': '20129539,20129631,20131106,20131752,20132410,20132813,20133415,20134047,20134651,20146962,20167030,20170635,20175394,20179101,20179156,20180443,20184582,20188033,20201204,20205058,20207226,20210409,20218980,20220858,20228656,20230414,20241195,20241809,20243336,20244117,20246030,20250376,20254457,20259965,20261461,20266220,20271634,20273575,20274061,20274509,20274979,20275489,20279218,20279461,20281906,20283040,20284590,20286061,20286547,20286875,20288126,20288178,20289033,20289798,20290358,20303646,20305987,20306726,20310368,20316951,20316982,20317001,20317306,20317322,20317347,20317446,20318021,20325085,20326225,20327957,20329949,20336537,20338220,20338573,20346622,20347739,20359651,20359681,20387168,20388372,20390031,20392809,20393768,20396905,20397425,20399520,20401837,20403835,20404853,20408266,20408794,20410296,20411323,20411943,20414015,20415824,20417164,20417768,20427760,20428333,20429510,20431167,20432571,20438200,20440262,20444627,20445467,20448180,20450435,20452764,20454669,20455328,20456107,2045654', 'assoc_port': '20129522:20129539,20129564:20129631,20131031:20131106,20131722:20131752,20132396:20132410,20132801:20132813,20133387:20133415,20134034:20134047,20134638:20134651,20146862:20146962,20167022:20167030,20170583:20170635,20175385:20175394,20179072:20179101,20179073:20179156,20180407:20180443,20184567:20184582,20187986:20188033,20201187:20201204,20204996:20205058,20207132:20207226,20210404:20210409,20218946:20218980,20220809:20220858,20228641:20228656,20230358:20230414,20241183:20241195,20241795:20241809,20243319:20243336,20244101:20244117,20245995:20246030,20250370:20250376,20254446:20254457,20259950:20259965,20261452:20261461,20266192:20266220,20271621:20271634,20273558:20273575,20274041:20274061,20274469:20274509,20274918:20274979,20275438:20275489,20279159:20279218,20279384:20279461,20281877:20281906,20283028:20283040,20284556:20284590,20286053:20286061,20286533:20286547,20286862:20286875,20287909:20288126,20288163:20288178,20289032:20289033,20289745:20289798,20290351:20290358,20303638:20303646,20305947:2030598', 'assoc_mat': '20129522:metal:3726:20129539,20129564:metal:3726:20129631,20131031:metal:3726:20131106,20131722:metal:3726:20131752,20132396:metal:3726:20132410,20132801:metal:3726:20132813,20133387:metal:3726:20133415,20134034:metal:3726:20134047,20134638:metal:3726:20134651,20146862:metal:3726:20146962,20167022:metal:3726:20167030,20170583:metal:3726:20170635,20175385:metal:3726:20175394,20179072:metal:3726:20179101,20179073:metal:3726:20179156,20180407:metal:3726:20180443,20184567:metal:3726:20184582,20187986:metal:3726:20188033,20201187:metal:3726:20201204,20204996:metal:3726:20205058,20207132:metal:3726:20207226,20210404:metal:3726:20210409,20218946:metal:3726:20218980,20220809:metal:3726:20220858,20228641:metal:3726:20228656,20230358:metal:3726:20230414,20241183:metal:3726:20241195,20241795:metal:3726:20241809,20243319:metal:3726:20243336,20244101:metal:3726:20244117,20245995:metal:3726:20246030,20250370:metal:3726:20250376,20254446:metal:3726:20254457,20259950:metal:3726:20259965,20261452:metal:3726:20261461,20266192:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004476188932191343, 'nb_photo': 5410, 'list_port_cont': '20129240,20129412,20129541,20129642,20130341,20131108,20131750,20132403,20132806,20133411,20134044,20134648,20146912,20146935,20146951,20146984,20166827,20167031,20169699,20169985,20170636,20170945,20171396,20172083,20172685,20173635,20174027,20174909,20175396,20177791,20177903,20179105,20179157,20179611,20180446,20181094,20181931,20182643,20182999,20183986,20184577,20185192,20185695,20187376,20188039,20189300,20189951,20191398,20191843,20200940,20201207,20203017,20203366,20203729,20204450,20205060,20205941,20206415,20206720,20207227,20210416,20210627,20210890,20211104,20211679,20212411,20213239,20213962,20214629,20215230,20215792,20216338,20217016,20217810,20218548,20218988,20220455,20220852,20221515,20222024,20222823,20223569,20224503,20225232,20225774,20227007,20228360,20228655,20229117,20229638,20230410,20231038,20234765,20234829,20235166,20235937,20236748,20237242,20238043,20238753,20239152,20239996,20240212,20241061,20241196,20241802,20242576,20243042,20243325,20244114,20244396,20244971,20245391,2024603', 'assoc_port': '20129197:20129240,20129398:20129412,20129522:20129541,20129564:20129642,20130338:20130341,20131031:20131108,20131722:20131750,20132396:20132403,20132801:20132806,20133387:20133411,20134034:20134044,20134638:20134648,20146861:20146984,20146862:20146951,20146863:20146935,20146864:20146912,20166823:20166827,20167022:20167031,20169696:20169699,20169975:20169985,20170583:20170636,20170900:20170945,20171366:20171396,20172070:20172083,20172623:20172685,20173625:20173635,20173987:20174027,20174900:20174909,20175385:20175396,20177789:20177791,20177856:20177903,20179072:20179105,20179073:20179157,20179533:20179611,20180407:20180446,20181040:20181094,20181913:20181931,20182591:20182643,20182990:20182999,20183944:20183986,20184567:20184577,20185163:20185192,20185669:20185695,20187367:20187376,20187986:20188039,20189285:20189300,20189909:20189951,20191390:20191398,20191824:20191843,20200932:20200940,20201187:20201207,20203010:20203017,20203352:20203366,20203720:20203729,20204389:20204450,20204996:20205060,20205929:2020594', 'assoc_mat': '20129197:plastique:3726:20129240,20129398:plastique:3726:20129412,20129522:plastique:3726:20129541,20129564:plastique:3726:20129642,20130338:plastique:3726:20130341,20131031:plastique:3726:20131108,20131722:plastique:3726:20131750,20132396:plastique:3726:20132403,20132801:plastique:3726:20132806,20133387:plastique:3726:20133411,20134034:plastique:3726:20134044,20134638:plastique:3726:20134648,20146861:plastique:3726:20146984,20146862:plastique:3726:20146951,20146863:plastique:3726:20146935,20146864:plastique:3726:20146912,20166823:plastique:3726:20166827,20167022:plastique:3726:20167031,20169696:plastique:3726:20169699,20169975:plastique:3726:20169985,20170583:plastique:3726:20170636,20170900:plastique:3726:20170945,20171366:plastique:3726:20171396,20172070:plastique:3726:20172083,20172623:plastique:3726:20172685,20173625:plastique:3726:20173635,20173987:plastique:3726:20174027,20174900:plastique:3726:20174909,20175385:plastique:3726:20175396,20177789:plastique:3726:20177791,20177856:plastique:3726:20177903,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01102586919804137, 'nb_photo': 12322, 'list_port_cont': '20129232,20129315,20129414,20129532,20129640,20130344,20131107,20131754,20132401,20132814,20133407,20134049,20134642,20146913,20146937,20146954,20146983,20166826,20167026,20169700,20169982,20170632,20170947,20171405,20172082,20172683,20172837,20173630,20174019,20174913,20175399,20177899,20179103,20179149,20179469,20179613,20180445,20181088,20181927,20182637,20183003,20183583,20183993,20184586,20185185,20185699,20187384,20187643,20188035,20188779,20189295,20189941,20190726,20191219,20191406,20191840,20200632,20200938,20201197,20203016,20203364,20203735,20204447,20205054,20205938,20206411,20206722,20207225,20210412,20210633,20211107,20211681,20212415,20213241,20213966,20214632,20215236,20215797,20216342,20217023,20217804,20218546,20218979,20220454,20220856,20221525,20222016,20222821,20223576,20224510,20225229,20225779,20227001,20228366,20228649,20229115,20229633,20230403,20231045,20234538,20234774,20234835,20235162,20235932,20236749,20237243,20238038,20238759,20239157,20239999,20240204,20241057,20241193,2024180', 'assoc_port': '20129197:20129232,20129199:20129315,20129398:20129414,20129522:20129532,20129564:20129640,20130338:20130344,20131031:20131107,20131722:20131754,20132396:20132401,20132801:20132814,20133387:20133407,20134034:20134049,20134638:20134642,20146861:20146983,20146862:20146954,20146863:20146937,20146864:20146913,20166823:20166826,20167022:20167026,20169696:20169700,20169975:20169982,20170583:20170632,20170900:20170947,20171366:20171405,20172070:20172082,20172623:20172683,20172805:20172837,20173625:20173630,20173987:20174019,20174900:20174913,20175385:20175399,20177856:20177899,20179072:20179103,20179073:20179149,20179367:20179469,20179533:20179613,20180407:20180445,20181040:20181088,20181913:20181927,20182591:20182637,20182990:20183003,20183534:20183583,20183944:20183993,20184567:20184586,20185163:20185185,20185669:20185699,20187367:20187384,20187589:20187643,20187986:20188035,20188631:20188779,20189285:20189295,20189909:20189941,20190694:20190726,20191207:20191219,20191390:20191406,20191824:20191840,20200617:2020063', 'assoc_mat': '20129197:Teint_Dans_La_Masse:3726:20129232,20129199:Teint_Dans_La_Masse:3726:20129315,20129398:Teint_Dans_La_Masse:3726:20129414,20129522:Teint_Dans_La_Masse:3726:20129532,20129564:Teint_Dans_La_Masse:3726:20129640,20130338:Teint_Dans_La_Masse:3726:20130344,20131031:Teint_Dans_La_Masse:3726:20131107,20131722:Teint_Dans_La_Masse:3726:20131754,20132396:Teint_Dans_La_Masse:3726:20132401,20132801:Teint_Dans_La_Masse:3726:20132814,20133387:Teint_Dans_La_Masse:3726:20133407,20134034:Teint_Dans_La_Masse:3726:20134049,20134638:Teint_Dans_La_Masse:3726:20134642,20146861:Teint_Dans_La_Masse:3726:20146983,20146862:Teint_Dans_La_Masse:3726:20146954,20146863:Teint_Dans_La_Masse:3726:20146937,20146864:Teint_Dans_La_Masse:3726:20146913,20166823:Teint_Dans_La_Masse:3726:20166826,20167022:Teint_Dans_La_Masse:3726:20167026,20169696:Teint_Dans_La_Masse:3726:20169700,20169975:Teint_Dans_La_Masse:3726:20169982,20170583:Teint_Dans_La_Masse:3726:20170632,20170900:Teint_Dans_La_Masse:3726:20170947,20171366:Teint_Dans_La_Masse:3726:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1579616,1594344,1596238,1597709,1598105,1597405,1597438,1601764,1606848,1607627,1610648,1613713,1614373)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=10 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((31861,),), 'unwanted_material_monthly_percentage': ((0.04461923073365088,),), 'material_repartition': (('JRM', 31816),), 'material_dict': {'JRM': 31816}, 'coverage_data': (('2025/02/15/', 1.0), ('2025/02/14/', 0.980845), ('2025/02/13/', 0.978171), ('2025/02/12/', 0.977384), ('2025/02/11/', 0.975752), ('2025/02/10/', 0.979985), ('2025/02/08/', 0.976943), ('2025/02/07/', 0.978692), ('2025/02/06/', 0.977558), ('2025/02/05/', 0.978426), ('2025/02/04/', 0.982407), ('2025/02/03/', 0.976535), ('2025/02/01/', 0.976165)), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.046073295025725325, 936), (datetime.date(2025, 2, 3), 0.04188400502693926, 1879), (datetime.date(2025, 2, 4), 0.05032253364568518, 2721), (datetime.date(2025, 2, 5), 0.0450536506870862, 4305), (datetime.date(2025, 2, 6), 0.04810758916433063, 3732), (datetime.date(2025, 2, 7), 0.04032549757592583, 3138), (datetime.date(2025, 2, 10), 0.04264288444460699, 2880), (datetime.date(2025, 2, 11), 0.0434777077437464, 3126), (datetime.date(2025, 2, 12), 0.045197054721884795, 1902), (datetime.date(2025, 2, 13), 0.04452372227991554, 3018), (datetime.date(2025, 2, 14), 0.0433430713821731, 4171), (datetime.date(2025, 2, 15), 0.07624579995942025, 8)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 2, 1), 0.046073295025725325, 936), (datetime.date(2025, 2, 3), 0.04188400502693926, 1879), (datetime.date(2025, 2, 4), 0.05032253364568518, 2721), (datetime.date(2025, 2, 5), 0.0450536506870862, 4305), (datetime.date(2025, 2, 6), 0.04810758916433063, 3732), (datetime.date(2025, 2, 7), 0.04032549757592583, 3138), (datetime.date(2025, 2, 10), 0.04264288444460699, 2880), (datetime.date(2025, 2, 11), 0.0434777077437464, 3126), (datetime.date(2025, 2, 12), 0.045197054721884795, 1902), (datetime.date(2025, 2, 13), 0.04452372227991554, 3018), (datetime.date(2025, 2, 14), 0.0433430713821731, 4171), (datetime.date(2025, 2, 15), 0.07624579995942025, 8))}, 'quality_array': [['-5.256759297484918', '01022025'], ['-5.155345699846091', '03022025'], ['-5.0198400444036215', '04022025'], ['-5.069625258955462', '05022025'], ['-5.12093186939568', '06022025'], ['-5.213893887325532', '07022025'], ['-5.128850573600423', '10022025'], ['-5.123167611433335', '11022025'], ['-4.974464073804046', '12022025'], ['-5.08417047319431', '13022025'], ['-5.127278728619328', '14022025'], ['-4.761820223213201', '15022025']], 'number_of_batch': ((580,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.009889602103730105, 'nb_photo': 6496, 'list_port_cont': '20129233,20129325,20129417,20129540,20129632,20130348,20131116,20131746,20132411,20132816,20133417,20134040,20134645,20146910,20146928,20146960,20146986,20166837,20167034,20169710,20169986,20170643,20170941,20171402,20172085,20172682,20172839,20173632,20174029,20174904,20175403,20177902,20179111,20179158,20179470,20179612,20180441,20181091,20181932,20182633,20183000,20183597,20183991,20184581,20185195,20185696,20187377,20187636,20188041,20188777,20189294,20189944,20190731,20191214,20191408,20191833,20200623,20201203,20203022,20203370,20203740,20204444,20205062,20205934,20206417,20207223,20210408,20210626,20210898,20211100,20211689,20212407,20213238,20213963,20214627,20215231,20215795,20216334,20217021,20217812,20218549,20218987,20220451,20220855,20221526,20222020,20222824,20223572,20224508,20225225,20225771,20227003,20228361,20228654,20229118,20229634,20230405,20231042,20234533,20234764,20234839,20235158,20235941,20236753,20237233,20238046,20238751,20239159,20239997,20240213,20241051,20241198,20241811,2024258', 'assoc_port': '20129197:20129233,20129199:20129325,20129398:20129417,20129522:20129540,20129564:20129632,20130338:20130348,20131031:20131116,20131722:20131746,20132396:20132411,20132801:20132816,20133387:20133417,20134034:20134040,20134638:20134645,20146861:20146986,20146862:20146960,20146863:20146928,20146864:20146910,20166823:20166837,20167022:20167034,20169696:20169710,20169975:20169986,20170583:20170643,20170900:20170941,20171366:20171402,20172070:20172085,20172623:20172682,20172805:20172839,20173625:20173632,20173987:20174029,20174900:20174904,20175385:20175403,20177856:20177902,20179072:20179111,20179073:20179158,20179367:20179470,20179533:20179612,20180407:20180441,20181040:20181091,20181913:20181932,20182591:20182633,20182990:20183000,20183534:20183597,20183944:20183991,20184567:20184581,20185163:20185195,20185669:20185696,20187367:20187377,20187589:20187636,20187986:20188041,20188631:20188777,20189285:20189294,20189909:20189944,20190694:20190731,20191207:20191214,20191390:20191408,20191824:20191833,20200617:2020062', 'assoc_mat': '20129197:autre_refus:3726:20129233,20129199:autre_refus:3726:20129325,20129398:autre_refus:3726:20129417,20129522:autre_refus:3726:20129540,20129564:autre_refus:3726:20129632,20130338:autre_refus:3726:20130348,20131031:autre_refus:3726:20131116,20131722:autre_refus:3726:20131746,20132396:autre_refus:3726:20132411,20132801:autre_refus:3726:20132816,20133387:autre_refus:3726:20133417,20134034:autre_refus:3726:20134040,20134638:autre_refus:3726:20134645,20146861:autre_refus:3726:20146986,20146862:autre_refus:3726:20146960,20146863:autre_refus:3726:20146928,20146864:autre_refus:3726:20146910,20166823:autre_refus:3726:20166837,20167022:autre_refus:3726:20167034,20169696:autre_refus:3726:20169710,20169975:autre_refus:3726:20169986,20170583:autre_refus:3726:20170643,20170900:autre_refus:3726:20170941,20171366:autre_refus:3726:20171402,20172070:autre_refus:3726:20172085,20172623:autre_refus:3726:20172682,20172805:autre_refus:3726:20172839,20173625:autre_refus:3726:20173632,20173987:autre_refus:3726:20174029,20174900:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004074725237424609, 'nb_photo': 7123, 'list_port_cont': '20129237,20129320,20129418,20129535,20129633,20130343,20131111,20131751,20132406,20132811,20133414,20134041,20134652,20146909,20146938,20146956,20146981,20166829,20167032,20169704,20169984,20170638,20170942,20171403,20172840,20173638,20174023,20174908,20175404,20177910,20179100,20179154,20179617,20180451,20181084,20181928,20182642,20183010,20183585,20183983,20184587,20185193,20185698,20187375,20188043,20188785,20189303,20189946,20190725,20191403,20191836,20200626,20200939,20201198,20203013,20203365,20203738,20204448,20205059,20205937,20206406,20206723,20207228,20210415,20210622,20211099,20211680,20212408,20213243,20213960,20214628,20215232,20215801,20216333,20217019,20217807,20218547,20218984,20220448,20220857,20221519,20222027,20222820,20223574,20224499,20225235,20225773,20227008,20228362,20228651,20229125,20229635,20230406,20231039,20234537,20234834,20235159,20235934,20236742,20237236,20238036,20238760,20239156,20239998,20240205,20241053,20241201,20241812,20242572,20243040,20243327,20244113,20244407,2024497', 'assoc_port': '20129197:20129237,20129199:20129320,20129398:20129418,20129522:20129535,20129564:20129633,20130338:20130343,20131031:20131111,20131722:20131751,20132396:20132406,20132801:20132811,20133387:20133414,20134034:20134041,20134638:20134652,20146861:20146981,20146862:20146956,20146863:20146938,20146864:20146909,20166823:20166829,20167022:20167032,20169696:20169704,20169975:20169984,20170583:20170638,20170900:20170942,20171366:20171403,20172805:20172840,20173625:20173638,20173987:20174023,20174900:20174908,20175385:20175404,20177856:20177910,20179072:20179100,20179073:20179154,20179533:20179617,20180407:20180451,20181040:20181084,20181913:20181928,20182591:20182642,20182990:20183010,20183534:20183585,20183944:20183983,20184567:20184587,20185163:20185193,20185669:20185698,20187367:20187375,20187986:20188043,20188631:20188785,20189285:20189303,20189909:20189946,20190694:20190725,20191390:20191403,20191824:20191836,20200617:20200626,20200932:20200939,20201187:20201198,20203010:20203013,20203352:20203365,20203720:2020373', 'assoc_mat': '20129197:cartonnette:3726:20129237,20129199:cartonnette:3726:20129320,20129398:cartonnette:3726:20129418,20129522:cartonnette:3726:20129535,20129564:cartonnette:3726:20129633,20130338:cartonnette:3726:20130343,20131031:cartonnette:3726:20131111,20131722:cartonnette:3726:20131751,20132396:cartonnette:3726:20132406,20132801:cartonnette:3726:20132811,20133387:cartonnette:3726:20133414,20134034:cartonnette:3726:20134041,20134638:cartonnette:3726:20134652,20146861:cartonnette:3726:20146981,20146862:cartonnette:3726:20146956,20146863:cartonnette:3726:20146938,20146864:cartonnette:3726:20146909,20166823:cartonnette:3726:20166829,20167022:cartonnette:3726:20167032,20169696:cartonnette:3726:20169704,20169975:cartonnette:3726:20169984,20170583:cartonnette:3726:20170638,20170900:cartonnette:3726:20170942,20171366:cartonnette:3726:20171403,20172805:cartonnette:3726:20172840,20173625:cartonnette:3726:20173638,20173987:cartonnette:3726:20174023,20174900:cartonnette:3726:20174908,20175385:cartonnette:3726:20175404,20177856:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.010060158183354003, 'nb_photo': 8319, 'list_port_cont': '20129231,20129319,20129411,20129534,20129637,20130346,20131110,20131743,20132408,20132812,20133408,20134046,20134653,20146906,20146933,20146957,20146978,20166831,20167024,20169708,20169981,20170640,20170939,20172075,20172680,20172828,20173628,20174020,20174914,20175395,20177900,20179107,20179151,20179465,20179606,20180447,20181087,20181924,20182641,20183007,20183584,20183994,20184579,20185191,20185694,20187383,20188038,20188787,20189296,20189950,20190724,20191404,20191838,20201205,20203021,20203367,20203736,20204449,20205057,20205936,20206408,20206724,20207231,20210414,20210628,20210891,20211109,20211678,20212409,20213240,20213967,20214630,20215228,20215793,20216335,20217025,20217805,20218544,20218982,20220447,20220850,20221524,20222018,20222825,20223578,20224500,20225230,20225769,20226959,20226999,20228364,20228648,20229121,20229641,20230404,20231034,20234530,20234767,20234832,20235169,20235931,20236751,20237241,20238041,20238758,20239153,20240002,20240210,20241056,20241200,20241803,20242579,20243045,2024333', 'assoc_port': '20129197:20129231,20129199:20129319,20129398:20129411,20129522:20129534,20129564:20129637,20130338:20130346,20131031:20131110,20131722:20131743,20132396:20132408,20132801:20132812,20133387:20133408,20134034:20134046,20134638:20134653,20146861:20146978,20146862:20146957,20146863:20146933,20146864:20146906,20166823:20166831,20167022:20167024,20169696:20169708,20169975:20169981,20170583:20170640,20170900:20170939,20172070:20172075,20172623:20172680,20172805:20172828,20173625:20173628,20173987:20174020,20174900:20174914,20175385:20175395,20177856:20177900,20179072:20179107,20179073:20179151,20179367:20179465,20179533:20179606,20180407:20180447,20181040:20181087,20181913:20181924,20182591:20182641,20182990:20183007,20183534:20183584,20183944:20183994,20184567:20184579,20185163:20185191,20185669:20185694,20187367:20187383,20187986:20188038,20188631:20188787,20189285:20189296,20189909:20189950,20190694:20190724,20191390:20191404,20191824:20191838,20201187:20201205,20203010:20203021,20203352:20203367,20203720:2020373', 'assoc_mat': '20129197:Carton_brun:3726:20129231,20129199:Carton_brun:3726:20129319,20129398:Carton_brun:3726:20129411,20129522:Carton_brun:3726:20129534,20129564:Carton_brun:3726:20129637,20130338:Carton_brun:3726:20130346,20131031:Carton_brun:3726:20131110,20131722:Carton_brun:3726:20131743,20132396:Carton_brun:3726:20132408,20132801:Carton_brun:3726:20132812,20133387:Carton_brun:3726:20133408,20134034:Carton_brun:3726:20134046,20134638:Carton_brun:3726:20134653,20146861:Carton_brun:3726:20146978,20146862:Carton_brun:3726:20146957,20146863:Carton_brun:3726:20146933,20146864:Carton_brun:3726:20146906,20166823:Carton_brun:3726:20166831,20167022:Carton_brun:3726:20167024,20169696:Carton_brun:3726:20169708,20169975:Carton_brun:3726:20169981,20170583:Carton_brun:3726:20170640,20170900:Carton_brun:3726:20170939,20172070:Carton_brun:3726:20172075,20172623:Carton_brun:3726:20172680,20172805:Carton_brun:3726:20172828,20173625:Carton_brun:3726:20173628,20173987:Carton_brun:3726:20174020,20174900:Carton_brun:3726:20174914,20175385:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007624032661778287, 'nb_photo': 7755, 'list_port_cont': '20129239,20129317,20129410,20129538,20129636,20130350,20131112,20131744,20132404,20132809,20133410,20134043,20134649,20146903,20146936,20146953,20146975,20166828,20167025,20169705,20169989,20170642,20170943,20171394,20172084,20172679,20172836,20173636,20174028,20174905,20175405,20177904,20179110,20179159,20179463,20179610,20180448,20181093,20181925,20182634,20183009,20183589,20183985,20184580,20185187,20185697,20187380,20187637,20188032,20188776,20189297,20189942,20190721,20191215,20191405,20191841,20200629,20200949,20201201,20203018,20203363,20203730,20204453,20205053,20205942,20206409,20207233,20210632,20211098,20211684,20212406,20213234,20213961,20214624,20215233,20215796,20216344,20217020,20217803,20218539,20218983,20220446,20220851,20221516,20222026,20222822,20223571,20224501,20225227,20225778,20226953,20227009,20228370,20228652,20229124,20229631,20230413,20231035,20234532,20234770,20234837,20235168,20235942,20236746,20237238,20238045,20238754,20239158,20240000,20240202,20241050,20241202,20241808,2024258', 'assoc_port': '20129197:20129239,20129199:20129317,20129398:20129410,20129522:20129538,20129564:20129636,20130338:20130350,20131031:20131112,20131722:20131744,20132396:20132404,20132801:20132809,20133387:20133410,20134034:20134043,20134638:20134649,20146861:20146975,20146862:20146953,20146863:20146936,20146864:20146903,20166823:20166828,20167022:20167025,20169696:20169705,20169975:20169989,20170583:20170642,20170900:20170943,20171366:20171394,20172070:20172084,20172623:20172679,20172805:20172836,20173625:20173636,20173987:20174028,20174900:20174905,20175385:20175405,20177856:20177904,20179072:20179110,20179073:20179159,20179367:20179463,20179533:20179610,20180407:20180448,20181040:20181093,20181913:20181925,20182591:20182634,20182990:20183009,20183534:20183589,20183944:20183985,20184567:20184580,20185163:20185187,20185669:20185697,20187367:20187380,20187589:20187637,20187986:20188032,20188631:20188776,20189285:20189297,20189909:20189942,20190694:20190721,20191207:20191215,20191390:20191405,20191824:20191841,20200617:2020062', 'assoc_mat': '20129197:Carton_gris:3726:20129239,20129199:Carton_gris:3726:20129317,20129398:Carton_gris:3726:20129410,20129522:Carton_gris:3726:20129538,20129564:Carton_gris:3726:20129636,20130338:Carton_gris:3726:20130350,20131031:Carton_gris:3726:20131112,20131722:Carton_gris:3726:20131744,20132396:Carton_gris:3726:20132404,20132801:Carton_gris:3726:20132809,20133387:Carton_gris:3726:20133410,20134034:Carton_gris:3726:20134043,20134638:Carton_gris:3726:20134649,20146861:Carton_gris:3726:20146975,20146862:Carton_gris:3726:20146953,20146863:Carton_gris:3726:20146936,20146864:Carton_gris:3726:20146903,20166823:Carton_gris:3726:20166828,20167022:Carton_gris:3726:20167025,20169696:Carton_gris:3726:20169705,20169975:Carton_gris:3726:20169989,20170583:Carton_gris:3726:20170642,20170900:Carton_gris:3726:20170943,20171366:Carton_gris:3726:20171394,20172070:Carton_gris:3726:20172084,20172623:Carton_gris:3726:20172679,20172805:Carton_gris:3726:20172836,20173625:Carton_gris:3726:20173636,20173987:Carton_gris:3726:20174028,20174900:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0019079627108361987, 'nb_photo': 1453, 'list_port_cont': '20129322,20129408,20129537,20129639,20130349,20131114,20131747,20132807,20133406,20134042,20146905,20167027,20169978,20170639,20170936,20172675,20172831,20174915,20175397,20179109,20179155,20180449,20181089,20181926,20182632,20183988,20184576,20185693,20187379,20188037,20189305,20191407,20203731,20205939,20206410,20211103,20213244,20214625,20215800,20216340,20217018,20218545,20218989,20220456,20220853,20222025,20222817,20223568,20224504,20225226,20225776,20227004,20228363,20229126,20229640,20230407,20231040,20234771,20234831,20235940,20236750,20237234,20238039,20238756,20239161,20240209,20241054,20241199,20241810,20242573,20243043,20244109,20244401,20245388,20246033,20246875,20247638,20249944,20250375,20251314,20252414,20253187,20255276,20258043,20258659,20259968,20260686,20261462,20262251,20262971,20264305,20264921,20265544,20266219,20268729,20269394,20270701,20271138,20271632,20273568,20273749,20274066,20274983,20275491,20279100,20279226,20279459,20280269,20281127,20281915,20282573,20283044,20283666,2028458', 'assoc_port': '20129199:20129322,20129398:20129408,20129522:20129537,20129564:20129639,20130338:20130349,20131031:20131114,20131722:20131747,20132801:20132807,20133387:20133406,20134034:20134042,20146864:20146905,20167022:20167027,20169975:20169978,20170583:20170639,20170900:20170936,20172623:20172675,20172805:20172831,20174900:20174915,20175385:20175397,20179072:20179109,20179073:20179155,20180407:20180449,20181040:20181089,20181913:20181926,20182591:20182632,20183944:20183988,20184567:20184576,20185669:20185693,20187367:20187379,20187986:20188037,20189285:20189305,20191390:20191407,20203720:20203731,20205929:20205939,20206399:20206410,20211089:20211103,20213225:20213244,20214615:20214625,20215739:20215800,20216292:20216340,20217004:20217018,20218534:20218545,20218946:20218989,20220417:20220456,20220809:20220853,20222000:20222025,20222746:20222817,20223512:20223568,20224457:20224504,20225220:20225226,20225760:20225776,20226990:20227004,20228358:20228363,20229074:20229126,20229623:20229640,20230358:20230407,20231025:2023104', 'assoc_mat': '20129199:kraft:3726:20129322,20129398:kraft:3726:20129408,20129522:kraft:3726:20129537,20129564:kraft:3726:20129639,20130338:kraft:3726:20130349,20131031:kraft:3726:20131114,20131722:kraft:3726:20131747,20132801:kraft:3726:20132807,20133387:kraft:3726:20133406,20134034:kraft:3726:20134042,20146864:kraft:3726:20146905,20167022:kraft:3726:20167027,20169975:kraft:3726:20169978,20170583:kraft:3726:20170639,20170900:kraft:3726:20170936,20172623:kraft:3726:20172675,20172805:kraft:3726:20172831,20174900:kraft:3726:20174915,20175385:kraft:3726:20175397,20179072:kraft:3726:20179109,20179073:kraft:3726:20179155,20180407:kraft:3726:20180449,20181040:kraft:3726:20181089,20181913:kraft:3726:20181926,20182591:kraft:3726:20182632,20183944:kraft:3726:20183988,20184567:kraft:3726:20184576,20185669:kraft:3726:20185693,20187367:kraft:3726:20187379,20187986:kraft:3726:20188037,20189285:kraft:3726:20189305,20191390:kraft:3726:20191407,20203720:kraft:3726:20203731,20205929:kraft:3726:20205939,20206399:kraft:3726:20206410,20211089:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005456109868244429, 'nb_photo': 274, 'list_port_cont': '20129539,20129631,20131106,20131752,20132410,20132813,20133415,20134047,20134651,20146962,20167030,20170635,20175394,20179101,20179156,20180443,20184582,20188033,20201204,20205058,20207226,20210409,20218980,20220858,20228656,20230414,20241195,20241809,20243336,20244117,20246030,20250376,20254457,20259965,20261461,20266220,20271634,20273575,20274061,20274509,20274979,20275489,20279218,20279461,20281906,20283040,20284590,20286061,20286547,20286875,20288126,20288178,20289033,20289798,20290358,20303646,20305987,20306726,20310368,20316951,20316982,20317001,20317306,20317322,20317347,20317446,20318021,20325085,20326225,20327957,20329949,20336537,20338220,20338573,20346622,20347739,20359651,20359681,20387168,20388372,20390031,20392809,20393768,20396905,20397425,20399520,20401837,20403835,20404853,20408266,20408794,20410296,20411323,20411943,20414015,20415824,20417164,20417768,20427760,20428333,20429510,20431167,20432571,20438200,20440262,20444627,20445467,20448180,20450435,20452764,20454669,20455328,20456107,2045654', 'assoc_port': '20129522:20129539,20129564:20129631,20131031:20131106,20131722:20131752,20132396:20132410,20132801:20132813,20133387:20133415,20134034:20134047,20134638:20134651,20146862:20146962,20167022:20167030,20170583:20170635,20175385:20175394,20179072:20179101,20179073:20179156,20180407:20180443,20184567:20184582,20187986:20188033,20201187:20201204,20204996:20205058,20207132:20207226,20210404:20210409,20218946:20218980,20220809:20220858,20228641:20228656,20230358:20230414,20241183:20241195,20241795:20241809,20243319:20243336,20244101:20244117,20245995:20246030,20250370:20250376,20254446:20254457,20259950:20259965,20261452:20261461,20266192:20266220,20271621:20271634,20273558:20273575,20274041:20274061,20274469:20274509,20274918:20274979,20275438:20275489,20279159:20279218,20279384:20279461,20281877:20281906,20283028:20283040,20284556:20284590,20286053:20286061,20286533:20286547,20286862:20286875,20287909:20288126,20288163:20288178,20289032:20289033,20289745:20289798,20290351:20290358,20303638:20303646,20305947:2030598', 'assoc_mat': '20129522:metal:3726:20129539,20129564:metal:3726:20129631,20131031:metal:3726:20131106,20131722:metal:3726:20131752,20132396:metal:3726:20132410,20132801:metal:3726:20132813,20133387:metal:3726:20133415,20134034:metal:3726:20134047,20134638:metal:3726:20134651,20146862:metal:3726:20146962,20167022:metal:3726:20167030,20170583:metal:3726:20170635,20175385:metal:3726:20175394,20179072:metal:3726:20179101,20179073:metal:3726:20179156,20180407:metal:3726:20180443,20184567:metal:3726:20184582,20187986:metal:3726:20188033,20201187:metal:3726:20201204,20204996:metal:3726:20205058,20207132:metal:3726:20207226,20210404:metal:3726:20210409,20218946:metal:3726:20218980,20220809:metal:3726:20220858,20228641:metal:3726:20228656,20230358:metal:3726:20230414,20241183:metal:3726:20241195,20241795:metal:3726:20241809,20243319:metal:3726:20243336,20244101:metal:3726:20244117,20245995:metal:3726:20246030,20250370:metal:3726:20250376,20254446:metal:3726:20254457,20259950:metal:3726:20259965,20261452:metal:3726:20261461,20266192:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004476188932191343, 'nb_photo': 5410, 'list_port_cont': '20129240,20129412,20129541,20129642,20130341,20131108,20131750,20132403,20132806,20133411,20134044,20134648,20146912,20146935,20146951,20146984,20166827,20167031,20169699,20169985,20170636,20170945,20171396,20172083,20172685,20173635,20174027,20174909,20175396,20177791,20177903,20179105,20179157,20179611,20180446,20181094,20181931,20182643,20182999,20183986,20184577,20185192,20185695,20187376,20188039,20189300,20189951,20191398,20191843,20200940,20201207,20203017,20203366,20203729,20204450,20205060,20205941,20206415,20206720,20207227,20210416,20210627,20210890,20211104,20211679,20212411,20213239,20213962,20214629,20215230,20215792,20216338,20217016,20217810,20218548,20218988,20220455,20220852,20221515,20222024,20222823,20223569,20224503,20225232,20225774,20227007,20228360,20228655,20229117,20229638,20230410,20231038,20234765,20234829,20235166,20235937,20236748,20237242,20238043,20238753,20239152,20239996,20240212,20241061,20241196,20241802,20242576,20243042,20243325,20244114,20244396,20244971,20245391,2024603', 'assoc_port': '20129197:20129240,20129398:20129412,20129522:20129541,20129564:20129642,20130338:20130341,20131031:20131108,20131722:20131750,20132396:20132403,20132801:20132806,20133387:20133411,20134034:20134044,20134638:20134648,20146861:20146984,20146862:20146951,20146863:20146935,20146864:20146912,20166823:20166827,20167022:20167031,20169696:20169699,20169975:20169985,20170583:20170636,20170900:20170945,20171366:20171396,20172070:20172083,20172623:20172685,20173625:20173635,20173987:20174027,20174900:20174909,20175385:20175396,20177789:20177791,20177856:20177903,20179072:20179105,20179073:20179157,20179533:20179611,20180407:20180446,20181040:20181094,20181913:20181931,20182591:20182643,20182990:20182999,20183944:20183986,20184567:20184577,20185163:20185192,20185669:20185695,20187367:20187376,20187986:20188039,20189285:20189300,20189909:20189951,20191390:20191398,20191824:20191843,20200932:20200940,20201187:20201207,20203010:20203017,20203352:20203366,20203720:20203729,20204389:20204450,20204996:20205060,20205929:2020594', 'assoc_mat': '20129197:plastique:3726:20129240,20129398:plastique:3726:20129412,20129522:plastique:3726:20129541,20129564:plastique:3726:20129642,20130338:plastique:3726:20130341,20131031:plastique:3726:20131108,20131722:plastique:3726:20131750,20132396:plastique:3726:20132403,20132801:plastique:3726:20132806,20133387:plastique:3726:20133411,20134034:plastique:3726:20134044,20134638:plastique:3726:20134648,20146861:plastique:3726:20146984,20146862:plastique:3726:20146951,20146863:plastique:3726:20146935,20146864:plastique:3726:20146912,20166823:plastique:3726:20166827,20167022:plastique:3726:20167031,20169696:plastique:3726:20169699,20169975:plastique:3726:20169985,20170583:plastique:3726:20170636,20170900:plastique:3726:20170945,20171366:plastique:3726:20171396,20172070:plastique:3726:20172083,20172623:plastique:3726:20172685,20173625:plastique:3726:20173635,20173987:plastique:3726:20174027,20174900:plastique:3726:20174909,20175385:plastique:3726:20175396,20177789:plastique:3726:20177791,20177856:plastique:3726:20177903,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01102586919804137, 'nb_photo': 12322, 'list_port_cont': '20129232,20129315,20129414,20129532,20129640,20130344,20131107,20131754,20132401,20132814,20133407,20134049,20134642,20146913,20146937,20146954,20146983,20166826,20167026,20169700,20169982,20170632,20170947,20171405,20172082,20172683,20172837,20173630,20174019,20174913,20175399,20177899,20179103,20179149,20179469,20179613,20180445,20181088,20181927,20182637,20183003,20183583,20183993,20184586,20185185,20185699,20187384,20187643,20188035,20188779,20189295,20189941,20190726,20191219,20191406,20191840,20200632,20200938,20201197,20203016,20203364,20203735,20204447,20205054,20205938,20206411,20206722,20207225,20210412,20210633,20211107,20211681,20212415,20213241,20213966,20214632,20215236,20215797,20216342,20217023,20217804,20218546,20218979,20220454,20220856,20221525,20222016,20222821,20223576,20224510,20225229,20225779,20227001,20228366,20228649,20229115,20229633,20230403,20231045,20234538,20234774,20234835,20235162,20235932,20236749,20237243,20238038,20238759,20239157,20239999,20240204,20241057,20241193,2024180', 'assoc_port': '20129197:20129232,20129199:20129315,20129398:20129414,20129522:20129532,20129564:20129640,20130338:20130344,20131031:20131107,20131722:20131754,20132396:20132401,20132801:20132814,20133387:20133407,20134034:20134049,20134638:20134642,20146861:20146983,20146862:20146954,20146863:20146937,20146864:20146913,20166823:20166826,20167022:20167026,20169696:20169700,20169975:20169982,20170583:20170632,20170900:20170947,20171366:20171405,20172070:20172082,20172623:20172683,20172805:20172837,20173625:20173630,20173987:20174019,20174900:20174913,20175385:20175399,20177856:20177899,20179072:20179103,20179073:20179149,20179367:20179469,20179533:20179613,20180407:20180445,20181040:20181088,20181913:20181927,20182591:20182637,20182990:20183003,20183534:20183583,20183944:20183993,20184567:20184586,20185163:20185185,20185669:20185699,20187367:20187384,20187589:20187643,20187986:20188035,20188631:20188779,20189285:20189295,20189909:20189941,20190694:20190726,20191207:20191219,20191390:20191406,20191824:20191840,20200617:2020063', 'assoc_mat': '20129197:Teint_Dans_La_Masse:3726:20129232,20129199:Teint_Dans_La_Masse:3726:20129315,20129398:Teint_Dans_La_Masse:3726:20129414,20129522:Teint_Dans_La_Masse:3726:20129532,20129564:Teint_Dans_La_Masse:3726:20129640,20130338:Teint_Dans_La_Masse:3726:20130344,20131031:Teint_Dans_La_Masse:3726:20131107,20131722:Teint_Dans_La_Masse:3726:20131754,20132396:Teint_Dans_La_Masse:3726:20132401,20132801:Teint_Dans_La_Masse:3726:20132814,20133387:Teint_Dans_La_Masse:3726:20133407,20134034:Teint_Dans_La_Masse:3726:20134049,20134638:Teint_Dans_La_Masse:3726:20134642,20146861:Teint_Dans_La_Masse:3726:20146983,20146862:Teint_Dans_La_Masse:3726:20146954,20146863:Teint_Dans_La_Masse:3726:20146937,20146864:Teint_Dans_La_Masse:3726:20146913,20166823:Teint_Dans_La_Masse:3726:20166826,20167022:Teint_Dans_La_Masse:3726:20167026,20169696:Teint_Dans_La_Masse:3726:20169700,20169975:Teint_Dans_La_Masse:3726:20169982,20170583:Teint_Dans_La_Masse:3726:20170632,20170900:Teint_Dans_La_Masse:3726:20170947,20171366:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 31861}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-02', 0.04461923073365088),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((31861,),), 'unwanted_material_monthly_percentage': ((0.04461923073365088,),), 'material_repartition': (('JRM', 31816),), 'material_dict': {'JRM': 31816}, 'coverage_data': (('2025/02/15/', 1.0), ('2025/02/14/', 0.980845), ('2025/02/13/', 0.978171), ('2025/02/12/', 0.977384), ('2025/02/11/', 0.975752), ('2025/02/10/', 0.979985), ('2025/02/08/', 0.976943), ('2025/02/07/', 0.978692), ('2025/02/06/', 0.977558), ('2025/02/05/', 0.978426), ('2025/02/04/', 0.982407), ('2025/02/03/', 0.976535), ('2025/02/01/', 0.976165)), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.046073295025725325, 936), (datetime.date(2025, 2, 3), 0.04188400502693926, 1879), (datetime.date(2025, 2, 4), 0.05032253364568518, 2721), (datetime.date(2025, 2, 5), 0.0450536506870862, 4305), (datetime.date(2025, 2, 6), 0.04810758916433063, 3732), (datetime.date(2025, 2, 7), 0.04032549757592583, 3138), (datetime.date(2025, 2, 10), 0.04264288444460699, 2880), (datetime.date(2025, 2, 11), 0.0434777077437464, 3126), (datetime.date(2025, 2, 12), 0.045197054721884795, 1902), (datetime.date(2025, 2, 13), 0.04452372227991554, 3018), (datetime.date(2025, 2, 14), 0.0433430713821731, 4171), (datetime.date(2025, 2, 15), 0.07624579995942025, 8)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 2, 1), 0.046073295025725325, 936), (datetime.date(2025, 2, 3), 0.04188400502693926, 1879), (datetime.date(2025, 2, 4), 0.05032253364568518, 2721), (datetime.date(2025, 2, 5), 0.0450536506870862, 4305), (datetime.date(2025, 2, 6), 0.04810758916433063, 3732), (datetime.date(2025, 2, 7), 0.04032549757592583, 3138), (datetime.date(2025, 2, 10), 0.04264288444460699, 2880), (datetime.date(2025, 2, 11), 0.0434777077437464, 3126), (datetime.date(2025, 2, 12), 0.045197054721884795, 1902), (datetime.date(2025, 2, 13), 0.04452372227991554, 3018), (datetime.date(2025, 2, 14), 0.0433430713821731, 4171), (datetime.date(2025, 2, 15), 0.07624579995942025, 8))}, 'quality_array': [['-5.256759297484918', '01022025'], ['-5.155345699846091', '03022025'], ['-5.0198400444036215', '04022025'], ['-5.069625258955462', '05022025'], ['-5.12093186939568', '06022025'], ['-5.213893887325532', '07022025'], ['-5.128850573600423', '10022025'], ['-5.123167611433335', '11022025'], ['-4.974464073804046', '12022025'], ['-5.08417047319431', '13022025'], ['-5.127278728619328', '14022025'], ['-4.761820223213201', '15022025']], 'number_of_batch': ((580,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.009889602103730105, 'nb_photo': 6496, 'list_port_cont': '20129233,20129325,20129417,20129540,20129632,20130348,20131116,20131746,20132411,20132816,20133417,20134040,20134645,20146910,20146928,20146960,20146986,20166837,20167034,20169710,20169986,20170643,20170941,20171402,20172085,20172682,20172839,20173632,20174029,20174904,20175403,20177902,20179111,20179158,20179470,20179612,20180441,20181091,20181932,20182633,20183000,20183597,20183991,20184581,20185195,20185696,20187377,20187636,20188041,20188777,20189294,20189944,20190731,20191214,20191408,20191833,20200623,20201203,20203022,20203370,20203740,20204444,20205062,20205934,20206417,20207223,20210408,20210626,20210898,20211100,20211689,20212407,20213238,20213963,20214627,20215231,20215795,20216334,20217021,20217812,20218549,20218987,20220451,20220855,20221526,20222020,20222824,20223572,20224508,20225225,20225771,20227003,20228361,20228654,20229118,20229634,20230405,20231042,20234533,20234764,20234839,20235158,20235941,20236753,20237233,20238046,20238751,20239159,20239997,20240213,20241051,20241198,20241811,2024258', 'assoc_port': '20129197:20129233,20129199:20129325,20129398:20129417,20129522:20129540,20129564:20129632,20130338:20130348,20131031:20131116,20131722:20131746,20132396:20132411,20132801:20132816,20133387:20133417,20134034:20134040,20134638:20134645,20146861:20146986,20146862:20146960,20146863:20146928,20146864:20146910,20166823:20166837,20167022:20167034,20169696:20169710,20169975:20169986,20170583:20170643,20170900:20170941,20171366:20171402,20172070:20172085,20172623:20172682,20172805:20172839,20173625:20173632,20173987:20174029,20174900:20174904,20175385:20175403,20177856:20177902,20179072:20179111,20179073:20179158,20179367:20179470,20179533:20179612,20180407:20180441,20181040:20181091,20181913:20181932,20182591:20182633,20182990:20183000,20183534:20183597,20183944:20183991,20184567:20184581,20185163:20185195,20185669:20185696,20187367:20187377,20187589:20187636,20187986:20188041,20188631:20188777,20189285:20189294,20189909:20189944,20190694:20190731,20191207:20191214,20191390:20191408,20191824:20191833,20200617:2020062', 'assoc_mat': '20129197:autre_refus:3726:20129233,20129199:autre_refus:3726:20129325,20129398:autre_refus:3726:20129417,20129522:autre_refus:3726:20129540,20129564:autre_refus:3726:20129632,20130338:autre_refus:3726:20130348,20131031:autre_refus:3726:20131116,20131722:autre_refus:3726:20131746,20132396:autre_refus:3726:20132411,20132801:autre_refus:3726:20132816,20133387:autre_refus:3726:20133417,20134034:autre_refus:3726:20134040,20134638:autre_refus:3726:20134645,20146861:autre_refus:3726:20146986,20146862:autre_refus:3726:20146960,20146863:autre_refus:3726:20146928,20146864:autre_refus:3726:20146910,20166823:autre_refus:3726:20166837,20167022:autre_refus:3726:20167034,20169696:autre_refus:3726:20169710,20169975:autre_refus:3726:20169986,20170583:autre_refus:3726:20170643,20170900:autre_refus:3726:20170941,20171366:autre_refus:3726:20171402,20172070:autre_refus:3726:20172085,20172623:autre_refus:3726:20172682,20172805:autre_refus:3726:20172839,20173625:autre_refus:3726:20173632,20173987:autre_refus:3726:20174029,20174900:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004074725237424609, 'nb_photo': 7123, 'list_port_cont': '20129237,20129320,20129418,20129535,20129633,20130343,20131111,20131751,20132406,20132811,20133414,20134041,20134652,20146909,20146938,20146956,20146981,20166829,20167032,20169704,20169984,20170638,20170942,20171403,20172840,20173638,20174023,20174908,20175404,20177910,20179100,20179154,20179617,20180451,20181084,20181928,20182642,20183010,20183585,20183983,20184587,20185193,20185698,20187375,20188043,20188785,20189303,20189946,20190725,20191403,20191836,20200626,20200939,20201198,20203013,20203365,20203738,20204448,20205059,20205937,20206406,20206723,20207228,20210415,20210622,20211099,20211680,20212408,20213243,20213960,20214628,20215232,20215801,20216333,20217019,20217807,20218547,20218984,20220448,20220857,20221519,20222027,20222820,20223574,20224499,20225235,20225773,20227008,20228362,20228651,20229125,20229635,20230406,20231039,20234537,20234834,20235159,20235934,20236742,20237236,20238036,20238760,20239156,20239998,20240205,20241053,20241201,20241812,20242572,20243040,20243327,20244113,20244407,2024497', 'assoc_port': '20129197:20129237,20129199:20129320,20129398:20129418,20129522:20129535,20129564:20129633,20130338:20130343,20131031:20131111,20131722:20131751,20132396:20132406,20132801:20132811,20133387:20133414,20134034:20134041,20134638:20134652,20146861:20146981,20146862:20146956,20146863:20146938,20146864:20146909,20166823:20166829,20167022:20167032,20169696:20169704,20169975:20169984,20170583:20170638,20170900:20170942,20171366:20171403,20172805:20172840,20173625:20173638,20173987:20174023,20174900:20174908,20175385:20175404,20177856:20177910,20179072:20179100,20179073:20179154,20179533:20179617,20180407:20180451,20181040:20181084,20181913:20181928,20182591:20182642,20182990:20183010,20183534:20183585,20183944:20183983,20184567:20184587,20185163:20185193,20185669:20185698,20187367:20187375,20187986:20188043,20188631:20188785,20189285:20189303,20189909:20189946,20190694:20190725,20191390:20191403,20191824:20191836,20200617:20200626,20200932:20200939,20201187:20201198,20203010:20203013,20203352:20203365,20203720:2020373', 'assoc_mat': '20129197:cartonnette:3726:20129237,20129199:cartonnette:3726:20129320,20129398:cartonnette:3726:20129418,20129522:cartonnette:3726:20129535,20129564:cartonnette:3726:20129633,20130338:cartonnette:3726:20130343,20131031:cartonnette:3726:20131111,20131722:cartonnette:3726:20131751,20132396:cartonnette:3726:20132406,20132801:cartonnette:3726:20132811,20133387:cartonnette:3726:20133414,20134034:cartonnette:3726:20134041,20134638:cartonnette:3726:20134652,20146861:cartonnette:3726:20146981,20146862:cartonnette:3726:20146956,20146863:cartonnette:3726:20146938,20146864:cartonnette:3726:20146909,20166823:cartonnette:3726:20166829,20167022:cartonnette:3726:20167032,20169696:cartonnette:3726:20169704,20169975:cartonnette:3726:20169984,20170583:cartonnette:3726:20170638,20170900:cartonnette:3726:20170942,20171366:cartonnette:3726:20171403,20172805:cartonnette:3726:20172840,20173625:cartonnette:3726:20173638,20173987:cartonnette:3726:20174023,20174900:cartonnette:3726:20174908,20175385:cartonnette:3726:20175404,20177856:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.010060158183354003, 'nb_photo': 8319, 'list_port_cont': '20129231,20129319,20129411,20129534,20129637,20130346,20131110,20131743,20132408,20132812,20133408,20134046,20134653,20146906,20146933,20146957,20146978,20166831,20167024,20169708,20169981,20170640,20170939,20172075,20172680,20172828,20173628,20174020,20174914,20175395,20177900,20179107,20179151,20179465,20179606,20180447,20181087,20181924,20182641,20183007,20183584,20183994,20184579,20185191,20185694,20187383,20188038,20188787,20189296,20189950,20190724,20191404,20191838,20201205,20203021,20203367,20203736,20204449,20205057,20205936,20206408,20206724,20207231,20210414,20210628,20210891,20211109,20211678,20212409,20213240,20213967,20214630,20215228,20215793,20216335,20217025,20217805,20218544,20218982,20220447,20220850,20221524,20222018,20222825,20223578,20224500,20225230,20225769,20226959,20226999,20228364,20228648,20229121,20229641,20230404,20231034,20234530,20234767,20234832,20235169,20235931,20236751,20237241,20238041,20238758,20239153,20240002,20240210,20241056,20241200,20241803,20242579,20243045,2024333', 'assoc_port': '20129197:20129231,20129199:20129319,20129398:20129411,20129522:20129534,20129564:20129637,20130338:20130346,20131031:20131110,20131722:20131743,20132396:20132408,20132801:20132812,20133387:20133408,20134034:20134046,20134638:20134653,20146861:20146978,20146862:20146957,20146863:20146933,20146864:20146906,20166823:20166831,20167022:20167024,20169696:20169708,20169975:20169981,20170583:20170640,20170900:20170939,20172070:20172075,20172623:20172680,20172805:20172828,20173625:20173628,20173987:20174020,20174900:20174914,20175385:20175395,20177856:20177900,20179072:20179107,20179073:20179151,20179367:20179465,20179533:20179606,20180407:20180447,20181040:20181087,20181913:20181924,20182591:20182641,20182990:20183007,20183534:20183584,20183944:20183994,20184567:20184579,20185163:20185191,20185669:20185694,20187367:20187383,20187986:20188038,20188631:20188787,20189285:20189296,20189909:20189950,20190694:20190724,20191390:20191404,20191824:20191838,20201187:20201205,20203010:20203021,20203352:20203367,20203720:2020373', 'assoc_mat': '20129197:Carton_brun:3726:20129231,20129199:Carton_brun:3726:20129319,20129398:Carton_brun:3726:20129411,20129522:Carton_brun:3726:20129534,20129564:Carton_brun:3726:20129637,20130338:Carton_brun:3726:20130346,20131031:Carton_brun:3726:20131110,20131722:Carton_brun:3726:20131743,20132396:Carton_brun:3726:20132408,20132801:Carton_brun:3726:20132812,20133387:Carton_brun:3726:20133408,20134034:Carton_brun:3726:20134046,20134638:Carton_brun:3726:20134653,20146861:Carton_brun:3726:20146978,20146862:Carton_brun:3726:20146957,20146863:Carton_brun:3726:20146933,20146864:Carton_brun:3726:20146906,20166823:Carton_brun:3726:20166831,20167022:Carton_brun:3726:20167024,20169696:Carton_brun:3726:20169708,20169975:Carton_brun:3726:20169981,20170583:Carton_brun:3726:20170640,20170900:Carton_brun:3726:20170939,20172070:Carton_brun:3726:20172075,20172623:Carton_brun:3726:20172680,20172805:Carton_brun:3726:20172828,20173625:Carton_brun:3726:20173628,20173987:Carton_brun:3726:20174020,20174900:Carton_brun:3726:20174914,20175385:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007624032661778287, 'nb_photo': 7755, 'list_port_cont': '20129239,20129317,20129410,20129538,20129636,20130350,20131112,20131744,20132404,20132809,20133410,20134043,20134649,20146903,20146936,20146953,20146975,20166828,20167025,20169705,20169989,20170642,20170943,20171394,20172084,20172679,20172836,20173636,20174028,20174905,20175405,20177904,20179110,20179159,20179463,20179610,20180448,20181093,20181925,20182634,20183009,20183589,20183985,20184580,20185187,20185697,20187380,20187637,20188032,20188776,20189297,20189942,20190721,20191215,20191405,20191841,20200629,20200949,20201201,20203018,20203363,20203730,20204453,20205053,20205942,20206409,20207233,20210632,20211098,20211684,20212406,20213234,20213961,20214624,20215233,20215796,20216344,20217020,20217803,20218539,20218983,20220446,20220851,20221516,20222026,20222822,20223571,20224501,20225227,20225778,20226953,20227009,20228370,20228652,20229124,20229631,20230413,20231035,20234532,20234770,20234837,20235168,20235942,20236746,20237238,20238045,20238754,20239158,20240000,20240202,20241050,20241202,20241808,2024258', 'assoc_port': '20129197:20129239,20129199:20129317,20129398:20129410,20129522:20129538,20129564:20129636,20130338:20130350,20131031:20131112,20131722:20131744,20132396:20132404,20132801:20132809,20133387:20133410,20134034:20134043,20134638:20134649,20146861:20146975,20146862:20146953,20146863:20146936,20146864:20146903,20166823:20166828,20167022:20167025,20169696:20169705,20169975:20169989,20170583:20170642,20170900:20170943,20171366:20171394,20172070:20172084,20172623:20172679,20172805:20172836,20173625:20173636,20173987:20174028,20174900:20174905,20175385:20175405,20177856:20177904,20179072:20179110,20179073:20179159,20179367:20179463,20179533:20179610,20180407:20180448,20181040:20181093,20181913:20181925,20182591:20182634,20182990:20183009,20183534:20183589,20183944:20183985,20184567:20184580,20185163:20185187,20185669:20185697,20187367:20187380,20187589:20187637,20187986:20188032,20188631:20188776,20189285:20189297,20189909:20189942,20190694:20190721,20191207:20191215,20191390:20191405,20191824:20191841,20200617:2020062', 'assoc_mat': '20129197:Carton_gris:3726:20129239,20129199:Carton_gris:3726:20129317,20129398:Carton_gris:3726:20129410,20129522:Carton_gris:3726:20129538,20129564:Carton_gris:3726:20129636,20130338:Carton_gris:3726:20130350,20131031:Carton_gris:3726:20131112,20131722:Carton_gris:3726:20131744,20132396:Carton_gris:3726:20132404,20132801:Carton_gris:3726:20132809,20133387:Carton_gris:3726:20133410,20134034:Carton_gris:3726:20134043,20134638:Carton_gris:3726:20134649,20146861:Carton_gris:3726:20146975,20146862:Carton_gris:3726:20146953,20146863:Carton_gris:3726:20146936,20146864:Carton_gris:3726:20146903,20166823:Carton_gris:3726:20166828,20167022:Carton_gris:3726:20167025,20169696:Carton_gris:3726:20169705,20169975:Carton_gris:3726:20169989,20170583:Carton_gris:3726:20170642,20170900:Carton_gris:3726:20170943,20171366:Carton_gris:3726:20171394,20172070:Carton_gris:3726:20172084,20172623:Carton_gris:3726:20172679,20172805:Carton_gris:3726:20172836,20173625:Carton_gris:3726:20173636,20173987:Carton_gris:3726:20174028,20174900:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0019079627108361987, 'nb_photo': 1453, 'list_port_cont': '20129322,20129408,20129537,20129639,20130349,20131114,20131747,20132807,20133406,20134042,20146905,20167027,20169978,20170639,20170936,20172675,20172831,20174915,20175397,20179109,20179155,20180449,20181089,20181926,20182632,20183988,20184576,20185693,20187379,20188037,20189305,20191407,20203731,20205939,20206410,20211103,20213244,20214625,20215800,20216340,20217018,20218545,20218989,20220456,20220853,20222025,20222817,20223568,20224504,20225226,20225776,20227004,20228363,20229126,20229640,20230407,20231040,20234771,20234831,20235940,20236750,20237234,20238039,20238756,20239161,20240209,20241054,20241199,20241810,20242573,20243043,20244109,20244401,20245388,20246033,20246875,20247638,20249944,20250375,20251314,20252414,20253187,20255276,20258043,20258659,20259968,20260686,20261462,20262251,20262971,20264305,20264921,20265544,20266219,20268729,20269394,20270701,20271138,20271632,20273568,20273749,20274066,20274983,20275491,20279100,20279226,20279459,20280269,20281127,20281915,20282573,20283044,20283666,2028458', 'assoc_port': '20129199:20129322,20129398:20129408,20129522:20129537,20129564:20129639,20130338:20130349,20131031:20131114,20131722:20131747,20132801:20132807,20133387:20133406,20134034:20134042,20146864:20146905,20167022:20167027,20169975:20169978,20170583:20170639,20170900:20170936,20172623:20172675,20172805:20172831,20174900:20174915,20175385:20175397,20179072:20179109,20179073:20179155,20180407:20180449,20181040:20181089,20181913:20181926,20182591:20182632,20183944:20183988,20184567:20184576,20185669:20185693,20187367:20187379,20187986:20188037,20189285:20189305,20191390:20191407,20203720:20203731,20205929:20205939,20206399:20206410,20211089:20211103,20213225:20213244,20214615:20214625,20215739:20215800,20216292:20216340,20217004:20217018,20218534:20218545,20218946:20218989,20220417:20220456,20220809:20220853,20222000:20222025,20222746:20222817,20223512:20223568,20224457:20224504,20225220:20225226,20225760:20225776,20226990:20227004,20228358:20228363,20229074:20229126,20229623:20229640,20230358:20230407,20231025:2023104', 'assoc_mat': '20129199:kraft:3726:20129322,20129398:kraft:3726:20129408,20129522:kraft:3726:20129537,20129564:kraft:3726:20129639,20130338:kraft:3726:20130349,20131031:kraft:3726:20131114,20131722:kraft:3726:20131747,20132801:kraft:3726:20132807,20133387:kraft:3726:20133406,20134034:kraft:3726:20134042,20146864:kraft:3726:20146905,20167022:kraft:3726:20167027,20169975:kraft:3726:20169978,20170583:kraft:3726:20170639,20170900:kraft:3726:20170936,20172623:kraft:3726:20172675,20172805:kraft:3726:20172831,20174900:kraft:3726:20174915,20175385:kraft:3726:20175397,20179072:kraft:3726:20179109,20179073:kraft:3726:20179155,20180407:kraft:3726:20180449,20181040:kraft:3726:20181089,20181913:kraft:3726:20181926,20182591:kraft:3726:20182632,20183944:kraft:3726:20183988,20184567:kraft:3726:20184576,20185669:kraft:3726:20185693,20187367:kraft:3726:20187379,20187986:kraft:3726:20188037,20189285:kraft:3726:20189305,20191390:kraft:3726:20191407,20203720:kraft:3726:20203731,20205929:kraft:3726:20205939,20206399:kraft:3726:20206410,20211089:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0005456109868244429, 'nb_photo': 274, 'list_port_cont': '20129539,20129631,20131106,20131752,20132410,20132813,20133415,20134047,20134651,20146962,20167030,20170635,20175394,20179101,20179156,20180443,20184582,20188033,20201204,20205058,20207226,20210409,20218980,20220858,20228656,20230414,20241195,20241809,20243336,20244117,20246030,20250376,20254457,20259965,20261461,20266220,20271634,20273575,20274061,20274509,20274979,20275489,20279218,20279461,20281906,20283040,20284590,20286061,20286547,20286875,20288126,20288178,20289033,20289798,20290358,20303646,20305987,20306726,20310368,20316951,20316982,20317001,20317306,20317322,20317347,20317446,20318021,20325085,20326225,20327957,20329949,20336537,20338220,20338573,20346622,20347739,20359651,20359681,20387168,20388372,20390031,20392809,20393768,20396905,20397425,20399520,20401837,20403835,20404853,20408266,20408794,20410296,20411323,20411943,20414015,20415824,20417164,20417768,20427760,20428333,20429510,20431167,20432571,20438200,20440262,20444627,20445467,20448180,20450435,20452764,20454669,20455328,20456107,2045654', 'assoc_port': '20129522:20129539,20129564:20129631,20131031:20131106,20131722:20131752,20132396:20132410,20132801:20132813,20133387:20133415,20134034:20134047,20134638:20134651,20146862:20146962,20167022:20167030,20170583:20170635,20175385:20175394,20179072:20179101,20179073:20179156,20180407:20180443,20184567:20184582,20187986:20188033,20201187:20201204,20204996:20205058,20207132:20207226,20210404:20210409,20218946:20218980,20220809:20220858,20228641:20228656,20230358:20230414,20241183:20241195,20241795:20241809,20243319:20243336,20244101:20244117,20245995:20246030,20250370:20250376,20254446:20254457,20259950:20259965,20261452:20261461,20266192:20266220,20271621:20271634,20273558:20273575,20274041:20274061,20274469:20274509,20274918:20274979,20275438:20275489,20279159:20279218,20279384:20279461,20281877:20281906,20283028:20283040,20284556:20284590,20286053:20286061,20286533:20286547,20286862:20286875,20287909:20288126,20288163:20288178,20289032:20289033,20289745:20289798,20290351:20290358,20303638:20303646,20305947:2030598', 'assoc_mat': '20129522:metal:3726:20129539,20129564:metal:3726:20129631,20131031:metal:3726:20131106,20131722:metal:3726:20131752,20132396:metal:3726:20132410,20132801:metal:3726:20132813,20133387:metal:3726:20133415,20134034:metal:3726:20134047,20134638:metal:3726:20134651,20146862:metal:3726:20146962,20167022:metal:3726:20167030,20170583:metal:3726:20170635,20175385:metal:3726:20175394,20179072:metal:3726:20179101,20179073:metal:3726:20179156,20180407:metal:3726:20180443,20184567:metal:3726:20184582,20187986:metal:3726:20188033,20201187:metal:3726:20201204,20204996:metal:3726:20205058,20207132:metal:3726:20207226,20210404:metal:3726:20210409,20218946:metal:3726:20218980,20220809:metal:3726:20220858,20228641:metal:3726:20228656,20230358:metal:3726:20230414,20241183:metal:3726:20241195,20241795:metal:3726:20241809,20243319:metal:3726:20243336,20244101:metal:3726:20244117,20245995:metal:3726:20246030,20250370:metal:3726:20250376,20254446:metal:3726:20254457,20259950:metal:3726:20259965,20261452:metal:3726:20261461,20266192:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004476188932191343, 'nb_photo': 5410, 'list_port_cont': '20129240,20129412,20129541,20129642,20130341,20131108,20131750,20132403,20132806,20133411,20134044,20134648,20146912,20146935,20146951,20146984,20166827,20167031,20169699,20169985,20170636,20170945,20171396,20172083,20172685,20173635,20174027,20174909,20175396,20177791,20177903,20179105,20179157,20179611,20180446,20181094,20181931,20182643,20182999,20183986,20184577,20185192,20185695,20187376,20188039,20189300,20189951,20191398,20191843,20200940,20201207,20203017,20203366,20203729,20204450,20205060,20205941,20206415,20206720,20207227,20210416,20210627,20210890,20211104,20211679,20212411,20213239,20213962,20214629,20215230,20215792,20216338,20217016,20217810,20218548,20218988,20220455,20220852,20221515,20222024,20222823,20223569,20224503,20225232,20225774,20227007,20228360,20228655,20229117,20229638,20230410,20231038,20234765,20234829,20235166,20235937,20236748,20237242,20238043,20238753,20239152,20239996,20240212,20241061,20241196,20241802,20242576,20243042,20243325,20244114,20244396,20244971,20245391,2024603', 'assoc_port': '20129197:20129240,20129398:20129412,20129522:20129541,20129564:20129642,20130338:20130341,20131031:20131108,20131722:20131750,20132396:20132403,20132801:20132806,20133387:20133411,20134034:20134044,20134638:20134648,20146861:20146984,20146862:20146951,20146863:20146935,20146864:20146912,20166823:20166827,20167022:20167031,20169696:20169699,20169975:20169985,20170583:20170636,20170900:20170945,20171366:20171396,20172070:20172083,20172623:20172685,20173625:20173635,20173987:20174027,20174900:20174909,20175385:20175396,20177789:20177791,20177856:20177903,20179072:20179105,20179073:20179157,20179533:20179611,20180407:20180446,20181040:20181094,20181913:20181931,20182591:20182643,20182990:20182999,20183944:20183986,20184567:20184577,20185163:20185192,20185669:20185695,20187367:20187376,20187986:20188039,20189285:20189300,20189909:20189951,20191390:20191398,20191824:20191843,20200932:20200940,20201187:20201207,20203010:20203017,20203352:20203366,20203720:20203729,20204389:20204450,20204996:20205060,20205929:2020594', 'assoc_mat': '20129197:plastique:3726:20129240,20129398:plastique:3726:20129412,20129522:plastique:3726:20129541,20129564:plastique:3726:20129642,20130338:plastique:3726:20130341,20131031:plastique:3726:20131108,20131722:plastique:3726:20131750,20132396:plastique:3726:20132403,20132801:plastique:3726:20132806,20133387:plastique:3726:20133411,20134034:plastique:3726:20134044,20134638:plastique:3726:20134648,20146861:plastique:3726:20146984,20146862:plastique:3726:20146951,20146863:plastique:3726:20146935,20146864:plastique:3726:20146912,20166823:plastique:3726:20166827,20167022:plastique:3726:20167031,20169696:plastique:3726:20169699,20169975:plastique:3726:20169985,20170583:plastique:3726:20170636,20170900:plastique:3726:20170945,20171366:plastique:3726:20171396,20172070:plastique:3726:20172083,20172623:plastique:3726:20172685,20173625:plastique:3726:20173635,20173987:plastique:3726:20174027,20174900:plastique:3726:20174909,20175385:plastique:3726:20175396,20177789:plastique:3726:20177791,20177856:plastique:3726:20177903,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01102586919804137, 'nb_photo': 12322, 'list_port_cont': '20129232,20129315,20129414,20129532,20129640,20130344,20131107,20131754,20132401,20132814,20133407,20134049,20134642,20146913,20146937,20146954,20146983,20166826,20167026,20169700,20169982,20170632,20170947,20171405,20172082,20172683,20172837,20173630,20174019,20174913,20175399,20177899,20179103,20179149,20179469,20179613,20180445,20181088,20181927,20182637,20183003,20183583,20183993,20184586,20185185,20185699,20187384,20187643,20188035,20188779,20189295,20189941,20190726,20191219,20191406,20191840,20200632,20200938,20201197,20203016,20203364,20203735,20204447,20205054,20205938,20206411,20206722,20207225,20210412,20210633,20211107,20211681,20212415,20213241,20213966,20214632,20215236,20215797,20216342,20217023,20217804,20218546,20218979,20220454,20220856,20221525,20222016,20222821,20223576,20224510,20225229,20225779,20227001,20228366,20228649,20229115,20229633,20230403,20231045,20234538,20234774,20234835,20235162,20235932,20236749,20237243,20238038,20238759,20239157,20239999,20240204,20241057,20241193,2024180', 'assoc_port': '20129197:20129232,20129199:20129315,20129398:20129414,20129522:20129532,20129564:20129640,20130338:20130344,20131031:20131107,20131722:20131754,20132396:20132401,20132801:20132814,20133387:20133407,20134034:20134049,20134638:20134642,20146861:20146983,20146862:20146954,20146863:20146937,20146864:20146913,20166823:20166826,20167022:20167026,20169696:20169700,20169975:20169982,20170583:20170632,20170900:20170947,20171366:20171405,20172070:20172082,20172623:20172683,20172805:20172837,20173625:20173630,20173987:20174019,20174900:20174913,20175385:20175399,20177856:20177899,20179072:20179103,20179073:20179149,20179367:20179469,20179533:20179613,20180407:20180445,20181040:20181088,20181913:20181927,20182591:20182637,20182990:20183003,20183534:20183583,20183944:20183993,20184567:20184586,20185163:20185185,20185669:20185699,20187367:20187384,20187589:20187643,20187986:20188035,20188631:20188779,20189285:20189295,20189909:20189941,20190694:20190726,20191207:20191219,20191390:20191406,20191824:20191840,20200617:2020063', 'assoc_mat': '20129197:Teint_Dans_La_Masse:3726:20129232,20129199:Teint_Dans_La_Masse:3726:20129315,20129398:Teint_Dans_La_Masse:3726:20129414,20129522:Teint_Dans_La_Masse:3726:20129532,20129564:Teint_Dans_La_Masse:3726:20129640,20130338:Teint_Dans_La_Masse:3726:20130344,20131031:Teint_Dans_La_Masse:3726:20131107,20131722:Teint_Dans_La_Masse:3726:20131754,20132396:Teint_Dans_La_Masse:3726:20132401,20132801:Teint_Dans_La_Masse:3726:20132814,20133387:Teint_Dans_La_Masse:3726:20133407,20134034:Teint_Dans_La_Masse:3726:20134049,20134638:Teint_Dans_La_Masse:3726:20134642,20146861:Teint_Dans_La_Masse:3726:20146983,20146862:Teint_Dans_La_Masse:3726:20146954,20146863:Teint_Dans_La_Masse:3726:20146937,20146864:Teint_Dans_La_Masse:3726:20146913,20166823:Teint_Dans_La_Masse:3726:20166826,20167022:Teint_Dans_La_Masse:3726:20167026,20169696:Teint_Dans_La_Masse:3726:20169700,20169975:Teint_Dans_La_Masse:3726:20169982,20170583:Teint_Dans_La_Masse:3726:20170632,20170900:Teint_Dans_La_Masse:3726:20170947,20171366:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 31861}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-02', 0.04461923073365088),)]} filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_02_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '0.99%', 6496], 'cartonnette': ['cartonnette', '0.41%', 7123], 'Carton_brun': ['Carton_brun', '1.01%', 8319], 'Carton_gris': ['Carton_gris', '0.76%', 7755], 'kraft': ['kraft', '0.19%', 1453], 'metal': ['metal', '0.05%', 274], 'plastique': ['plastique', '0.45%', 5410], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '1.1%', 12322]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_02_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/arc_en_ciel_jrm 2.57user 2.91system 0:08.91elapsed 61%CPU (0avgtext+0avgdata 196036maxresident)k 25648inputs+432outputs (86major+67841minor)pagefaults 0swaps