python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30073 --dashboard_places=arc_en_ciel_jrm --rootfolder_sla=/data_4/data_log/job/memo/arc_en_ciel_jrm -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30073, Date : 2025-07 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (1, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (1, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 10 month : 07 mtr_id : 979 dashboard_places : arc_en_ciel_jrm date : 2025-07 year : 2025 raspi : 30073 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm' and date like '%2025-07%') and created_at like '%2025-07%'))); nb_day : (1, 31) after unwanted_material_data nb_day : (1, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30073%' AND ms.result_str like '%2025/07%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 137 seconds', 'coverage_pause': '0 days 84309 seconds', 'coverage_times_pause': '0 days 85642 seconds', 'nb_photos_decision': 4178, 'nb_gray_level_ok': 4178, 'nb_dedup_ok': 337, 'nb_two_criteria_ok': 337, 'nb_forced_upload': 46, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_duplicated': 3836, 'end_of_day_photos_nothing_done': 443, 'end_of_day_photos_uploaded': 4256, 'ratio_coverage': 0.9758099052072362}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 4202, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4202, 'last_update': '2025/07/02', 'portfolio_id': 24449702, 'last_run_id': 1950451, 'total_number_of_photos': 4705}} No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 137 seconds', 'coverage_pause': '0 days 84309 seconds', 'coverage_times_pause': '0 days 85642 seconds', 'nb_photos_decision': 4178, 'nb_gray_level_ok': 4178, 'nb_dedup_ok': 337, 'nb_two_criteria_ok': 337, 'nb_forced_upload': 46, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_duplicated': 3836, 'end_of_day_photos_nothing_done': 443, 'end_of_day_photos_uploaded': 4256, 'ratio_coverage': 0.9758099052072362}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 4202, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4202, 'last_update': '2025/07/02', 'portfolio_id': 24449702, 'last_run_id': 1950451, 'total_number_of_photos': 4705}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 137 seconds', 'coverage_pause': '0 days 84309 seconds', 'coverage_times_pause': '0 days 85642 seconds', 'nb_photos_decision': 4178, 'nb_gray_level_ok': 4178, 'nb_dedup_ok': 337, 'nb_two_criteria_ok': 337, 'nb_forced_upload': 46, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_duplicated': 3836, 'end_of_day_photos_nothing_done': 443, 'end_of_day_photos_uploaded': 4256, 'ratio_coverage': 0.9758099052072362}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 4202, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4202, 'last_update': '2025/07/02', 'portfolio_id': 24449702, 'last_run_id': 1950451, 'total_number_of_photos': 4705}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 137 seconds', 'coverage_pause': '0 days 84309 seconds', 'coverage_times_pause': '0 days 85642 seconds', 'nb_photos_decision': 4178, 'nb_gray_level_ok': 4178, 'nb_dedup_ok': 337, 'nb_two_criteria_ok': 337, 'nb_forced_upload': 46, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_duplicated': 3836, 'end_of_day_photos_nothing_done': 443, 'end_of_day_photos_uploaded': 4256, 'ratio_coverage': 0.9758099052072362}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 4202, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4202, 'last_update': '2025/07/02', 'portfolio_id': 24449702, 'last_run_id': 1950451, 'total_number_of_photos': 4705}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 137 seconds', 'coverage_pause': '0 days 84309 seconds', 'coverage_times_pause': '0 days 85642 seconds', 'nb_photos_decision': 4178, 'nb_gray_level_ok': 4178, 'nb_dedup_ok': 337, 'nb_two_criteria_ok': 337, 'nb_forced_upload': 46, 'end_of_day_photos_no_longer_on_disk': 4, 'end_of_day_photos_duplicated': 3836, 'end_of_day_photos_nothing_done': 443, 'end_of_day_photos_uploaded': 4256, 'ratio_coverage': 0.9758099052072362}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 4202, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4202, 'last_update': '2025/07/02', 'portfolio_id': 24449702, 'last_run_id': 1950451, 'total_number_of_photos': 4705}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-07-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-07-02 00:00:00,2025-07-03 00:00:00,2025-07-04 00:00:00,2025-07-05 00:00:00,2025-07-07 00:00:00,2025-07-08 00:00:00,2025-07-09 00:00:00,2025-07-10 00:00:00,2025-07-11 00:00:00,2025-07-12 00:00:00,2025-07-14 00:00:00,2025-07-15 00:00:00,2025-07-16 00:00:00,2025-07-17 00:00:00,2025-07-18 00:00:00,2025-07-19 00:00:00,2025-07-21 00:00:00,2025-07-22 00:00:00,2025-07-23 00:00:00,2025-07-24 00:00:00,2025-07-25 00:00:00,2025-07-26 00:00:00,2025-07-28 00:00:00,2025-07-29 00:00:00,2025-07-30 00:00:00,2025-07-31 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 10 and month(ded.date) = 07 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 10 and month(ded.date) = 07 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 10 and mp.name like '%072025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-07-01 : dt_date_just_month_year : 2025-07-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-07-01" AND ded.date <= "2025-07-31" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 4302, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1950451,1956312,1958228,1962711,1964203,1968835,1969557,1973830,1976862,1980511,1982065,1986573,1990620,1992556,1997240,1998066,1999380,2003808,2007584,2011116,2014886,2018650,2020513,2029377,2036791,2044285,2051283) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0060754175666101464, 'nb_photo': 16855, 'list_port_cont': '24453383,24453563,24453970,24454601,24455337,24455957,24456523,24457011,24457641,24459164,24459855,24460428,24460962,24461337,24461925,24462419,24463077,24464059,24465041,24466121,24467031,24467760,24468736,24469531,24470502,24471329,24472134,24473080,24473976,24474649,24475416,24476218,24476942,24477609,24478399,24479071,24479845,24480362,24481141,24481721,24482476,24482998,24483647,24484168,24484820,24485474,24486542,24487413,24493821,24494112,24494258,24495310,24498609,24503357,24503434,24504561,24504923,24505575,24506099,24506265,24506957,24507601,24508339,24508660,24508788,24509433,24510144,24511598,24511817,24512608,24513698,24515146,24516552,24518214,24519400,24520368,24521203,24521237,24521291,24521329,24522327,24523104,24524661,24528135,24532423,24534312,24535249,24535872,24535982,24536276,24537012,24537741,24538637,24541308,24542152,24543014,24543970,24544800,24545613,24547906,24548712,24552512,24553451,24561302,24561583,24562819,24563083,24563682,24564731,24565548,24566299,24567069,24568114,2456924', 'assoc_port': '24453336:24453383,24453550:24453563,24453929:24453970,24454494:24454601,24455325:24455337,24455910:24455957,24456503:24456523,24456994:24457011,24457624:24457641,24459089:24459164,24459828:24459855,24460386:24460428,24460928:24460962,24461304:24461337,24461899:24461925,24462393:24462419,24463058:24463077,24463947:24464059,24465018:24465041,24466078:24466121,24467014:24467031,24467726:24467760,24468709:24468736,24469444:24469531,24470475:24470502,24471299:24471329,24472121:24472134,24473035:24473080,24473939:24473976,24474627:24474649,24475411:24475416,24476167:24476218,24476925:24476942,24477545:24477609,24478378:24478399,24479021:24479071,24479821:24479845,24480340:24480362,24481098:24481141,24481692:24481721,24482442:24482476,24482912:24482998,24483630:24483647,24484133:24484168,24484781:24484820,24485391:24485474,24486529:24486542,24487347:24487413,24493818:24493821,24494102:24494112,24494234:24494258,24495217:24495310,24498586:24498609,24503345:24503434,24503346:24503357,24504530:24504561,24504887:2450492', 'assoc_mat': '24453336:autre_refus:3726:24453383,24453550:autre_refus:3726:24453563,24453929:autre_refus:3726:24453970,24454494:autre_refus:3726:24454601,24455325:autre_refus:3726:24455337,24455910:autre_refus:3726:24455957,24456503:autre_refus:3726:24456523,24456994:autre_refus:3726:24457011,24457624:autre_refus:3726:24457641,24459089:autre_refus:3726:24459164,24459828:autre_refus:3726:24459855,24460386:autre_refus:3726:24460428,24460928:autre_refus:3726:24460962,24461304:autre_refus:3726:24461337,24461899:autre_refus:3726:24461925,24462393:autre_refus:3726:24462419,24463058:autre_refus:3726:24463077,24463947:autre_refus:3726:24464059,24465018:autre_refus:3726:24465041,24466078:autre_refus:3726:24466121,24467014:autre_refus:3726:24467031,24467726:autre_refus:3726:24467760,24468709:autre_refus:3726:24468736,24469444:autre_refus:3726:24469531,24470475:autre_refus:3726:24470502,24471299:autre_refus:3726:24471329,24472121:autre_refus:3726:24472134,24473035:autre_refus:3726:24473080,24473939:autre_refus:3726:24473976,24474627:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00524032737807775, 'nb_photo': 22544, 'list_port_cont': '24453564,24453971,24454590,24455341,24455947,24456531,24457009,24457648,24458135,24458697,24459161,24459850,24460425,24460963,24461338,24461920,24462420,24463084,24464062,24465049,24466124,24467038,24467757,24468729,24469532,24470508,24471331,24472144,24474647,24475422,24476228,24476946,24477605,24478395,24479065,24479836,24480358,24481138,24481718,24482472,24482990,24484817,24485465,24486540,24487410,24493824,24494116,24494249,24495312,24498617,24503354,24503427,24503538,24504564,24504922,24505564,24506095,24506262,24506955,24507604,24508336,24508659,24508794,24509420,24511600,24511809,24512603,24513694,24515149,24516547,24518219,24519396,24520367,24521202,24521244,24521294,24521330,24522329,24523107,24524660,24528139,24532420,24534309,24535250,24535868,24535978,24536273,24537015,24537761,24538642,24541301,24542148,24543015,24543979,24547907,24552502,24553441,24561301,24561588,24562812,24563090,24563680,24564742,24565547,24566307,24567064,24568112,24569232,24570355,24571006,24571195,24575154,24575205,2458014', 'assoc_port': '24453550:24453564,24453929:24453971,24454494:24454590,24455325:24455341,24455910:24455947,24456503:24456531,24456994:24457009,24457624:24457648,24458102:24458135,24458664:24458697,24459089:24459161,24459828:24459850,24460386:24460425,24460928:24460963,24461304:24461338,24461899:24461920,24462393:24462420,24463058:24463084,24463947:24464062,24465018:24465049,24466078:24466124,24467014:24467038,24467726:24467757,24468709:24468729,24469444:24469532,24470475:24470508,24471299:24471331,24472121:24472144,24474627:24474647,24475411:24475422,24476167:24476228,24476925:24476946,24477545:24477605,24478378:24478395,24479021:24479065,24479821:24479836,24480340:24480358,24481098:24481138,24481692:24481718,24482442:24482472,24482912:24482990,24484781:24484817,24485391:24485465,24486529:24486540,24487347:24487410,24493818:24493824,24494102:24494116,24494234:24494249,24495217:24495312,24498586:24498617,24503345:24503427,24503346:24503354,24503493:24503538,24504530:24504564,24504887:24504922,24505558:24505564,24506011:2450609', 'assoc_mat': '24453550:cartonnette:3726:24453564,24453929:cartonnette:3726:24453971,24454494:cartonnette:3726:24454590,24455325:cartonnette:3726:24455341,24455910:cartonnette:3726:24455947,24456503:cartonnette:3726:24456531,24456994:cartonnette:3726:24457009,24457624:cartonnette:3726:24457648,24458102:cartonnette:3726:24458135,24458664:cartonnette:3726:24458697,24459089:cartonnette:3726:24459161,24459828:cartonnette:3726:24459850,24460386:cartonnette:3726:24460425,24460928:cartonnette:3726:24460963,24461304:cartonnette:3726:24461338,24461899:cartonnette:3726:24461920,24462393:cartonnette:3726:24462420,24463058:cartonnette:3726:24463084,24463947:cartonnette:3726:24464062,24465018:cartonnette:3726:24465049,24466078:cartonnette:3726:24466124,24467014:cartonnette:3726:24467038,24467726:cartonnette:3726:24467757,24468709:cartonnette:3726:24468729,24469444:cartonnette:3726:24469532,24470475:cartonnette:3726:24470508,24471299:cartonnette:3726:24471331,24472121:cartonnette:3726:24472144,24474627:cartonnette:3726:24474647,24475411:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.022315492048405397, 'nb_photo': 21665, 'list_port_cont': '24453375,24453559,24453963,24454593,24455336,24455955,24456526,24457010,24457644,24458134,24458690,24459162,24459846,24460420,24460965,24461347,24461921,24462421,24463072,24464077,24465048,24466122,24467029,24467751,24468739,24469529,24470506,24471324,24472141,24473078,24474643,24475420,24476227,24476950,24477613,24478394,24479073,24479840,24480365,24481146,24481711,24484812,24485473,24486539,24487411,24493825,24494117,24494256,24495311,24498613,24501136,24503366,24504565,24504924,24505567,24506096,24506259,24506965,24507595,24508337,24508661,24508795,24509434,24511596,24511816,24512599,24513697,24515141,24516543,24518218,24519398,24520362,24521196,24521236,24521293,24521326,24522321,24523106,24524658,24525695,24526532,24527393,24528133,24528333,24529730,24531037,24532414,24532668,24534310,24535251,24535873,24535977,24536269,24537013,24537763,24538635,24541299,24542151,24543008,24543973,24545618,24546379,24547192,24547903,24548709,24549411,24550189,24550911,24551732,24552503,24553443,24561589,24562811,2456369', 'assoc_port': '24453336:24453375,24453550:24453559,24453929:24453963,24454494:24454593,24455325:24455336,24455910:24455955,24456503:24456526,24456994:24457010,24457624:24457644,24458102:24458134,24458664:24458690,24459089:24459162,24459828:24459846,24460386:24460420,24460928:24460965,24461304:24461347,24461899:24461921,24462393:24462421,24463058:24463072,24463947:24464077,24465018:24465048,24466078:24466122,24467014:24467029,24467726:24467751,24468709:24468739,24469444:24469529,24470475:24470506,24471299:24471324,24472121:24472141,24473035:24473078,24474627:24474643,24475411:24475420,24476167:24476227,24476925:24476950,24477545:24477613,24478378:24478394,24479021:24479073,24479821:24479840,24480340:24480365,24481098:24481146,24481692:24481711,24484781:24484812,24485391:24485473,24486529:24486539,24487347:24487411,24493818:24493825,24494102:24494117,24494234:24494256,24495217:24495311,24498586:24498613,24501065:24501136,24503346:24503366,24504530:24504565,24504887:24504924,24505558:24505567,24506011:24506096,24506120:2450625', 'assoc_mat': '24453336:Carton_brun:3726:24453375,24453550:Carton_brun:3726:24453559,24453929:Carton_brun:3726:24453963,24454494:Carton_brun:3726:24454593,24455325:Carton_brun:3726:24455336,24455910:Carton_brun:3726:24455955,24456503:Carton_brun:3726:24456526,24456994:Carton_brun:3726:24457010,24457624:Carton_brun:3726:24457644,24458102:Carton_brun:3726:24458134,24458664:Carton_brun:3726:24458690,24459089:Carton_brun:3726:24459162,24459828:Carton_brun:3726:24459846,24460386:Carton_brun:3726:24460420,24460928:Carton_brun:3726:24460965,24461304:Carton_brun:3726:24461347,24461899:Carton_brun:3726:24461921,24462393:Carton_brun:3726:24462421,24463058:Carton_brun:3726:24463072,24463947:Carton_brun:3726:24464077,24465018:Carton_brun:3726:24465048,24466078:Carton_brun:3726:24466122,24467014:Carton_brun:3726:24467029,24467726:Carton_brun:3726:24467751,24468709:Carton_brun:3726:24468739,24469444:Carton_brun:3726:24469529,24470475:Carton_brun:3726:24470506,24471299:Carton_brun:3726:24471324,24472121:Carton_brun:3726:24472141,24473035:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01218969583935689, 'nb_photo': 24030, 'list_port_cont': '24453379,24453558,24453969,24454600,24455342,24455958,24456521,24457012,24457646,24458139,24458696,24459163,24460429,24460954,24461340,24461927,24462424,24463082,24464080,24465038,24466120,24467035,24467753,24468741,24469524,24470509,24471322,24472140,24474639,24475426,24476223,24476951,24477606,24478397,24479064,24479842,24480356,24481136,24481715,24482479,24482988,24484822,24485475,24486543,24487408,24493826,24494111,24494250,24494787,24495316,24495522,24496195,24496675,24497495,24497656,24498329,24498614,24498725,24499633,24500065,24500820,24501322,24501917,24502288,24503183,24503361,24503424,24503532,24504569,24504927,24505565,24506103,24506261,24506956,24507599,24508343,24508657,24508796,24509424,24510154,24511601,24511815,24512610,24513695,24515153,24516545,24518215,24519395,24520364,24521201,24521243,24521295,24521327,24522322,24523113,24524664,24526535,24527405,24528134,24532419,24534311,24535259,24535876,24535975,24536275,24537011,24537752,24538644,24541303,24542150,24543012,24543981,24545620,2454637', 'assoc_port': '24453336:24453379,24453550:24453558,24453929:24453969,24454494:24454600,24455325:24455342,24455910:24455958,24456503:24456521,24456994:24457012,24457624:24457646,24458102:24458139,24458664:24458696,24459089:24459163,24460386:24460429,24460928:24460954,24461304:24461340,24461899:24461927,24462393:24462424,24463058:24463082,24463947:24464080,24465018:24465038,24466078:24466120,24467014:24467035,24467726:24467753,24468709:24468741,24469444:24469524,24470475:24470509,24471299:24471322,24472121:24472140,24474627:24474639,24475411:24475426,24476167:24476223,24476925:24476951,24477545:24477606,24478378:24478397,24479021:24479064,24479821:24479842,24480340:24480356,24481098:24481136,24481692:24481715,24482442:24482479,24482912:24482988,24484781:24484822,24485391:24485475,24486529:24486543,24487347:24487408,24493818:24493826,24494102:24494111,24494234:24494250,24494774:24494787,24495217:24495316,24495450:24495522,24496182:24496195,24496579:24496675,24497467:24497495,24497619:24497656,24498295:24498329,24498586:2449861', 'assoc_mat': '24453336:Carton_gris:3726:24453379,24453550:Carton_gris:3726:24453558,24453929:Carton_gris:3726:24453969,24454494:Carton_gris:3726:24454600,24455325:Carton_gris:3726:24455342,24455910:Carton_gris:3726:24455958,24456503:Carton_gris:3726:24456521,24456994:Carton_gris:3726:24457012,24457624:Carton_gris:3726:24457646,24458102:Carton_gris:3726:24458139,24458664:Carton_gris:3726:24458696,24459089:Carton_gris:3726:24459163,24460386:Carton_gris:3726:24460429,24460928:Carton_gris:3726:24460954,24461304:Carton_gris:3726:24461340,24461899:Carton_gris:3726:24461927,24462393:Carton_gris:3726:24462424,24463058:Carton_gris:3726:24463082,24463947:Carton_gris:3726:24464080,24465018:Carton_gris:3726:24465038,24466078:Carton_gris:3726:24466120,24467014:Carton_gris:3726:24467035,24467726:Carton_gris:3726:24467753,24468709:Carton_gris:3726:24468741,24469444:Carton_gris:3726:24469524,24470475:Carton_gris:3726:24470509,24471299:Carton_gris:3726:24471322,24472121:Carton_gris:3726:24472140,24474627:Carton_gris:3726:24474639,24475411:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004044582656644895, 'nb_photo': 5340, 'list_port_cont': '24453562,24454597,24460427,24461345,24463073,24464075,24465040,24466131,24467758,24468738,24469527,24470503,24471319,24474644,24479837,24481716,24482481,24482997,24483644,24484165,24485469,24486538,24487419,24493829,24495321,24498610,24504916,24505574,24506256,24507598,24508351,24508787,24509422,24511599,24511811,24516548,24518222,24519390,24521325,24522332,24524665,24532416,24534305,24535258,24535870,24537014,24537748,24538638,24541305,24542147,24543017,24543977,24546381,24547898,24565546,24566304,24568113,24569230,24571001,24571201,24572298,24573171,24574355,24575153,24575209,24575362,24580147,24580411,24582060,24586412,24589763,24591462,24592258,24592887,24597995,24601097,24601560,24601713,24603246,24605354,24607296,24608569,24608810,24609628,24610147,24611262,24612720,24614727,24616107,24616871,24617482,24617917,24618493,24618942,24619987,24621543,24621975,24622465,24624886,24625612,24627006,24627179,24627208,24627240,24627279,24627333,24627357,24627534,24628998,24630888,24631252,24632515,24633931,2463439', 'assoc_port': '24453550:24453562,24454494:24454597,24460386:24460427,24461304:24461345,24463058:24463073,24463947:24464075,24465018:24465040,24466078:24466131,24467726:24467758,24468709:24468738,24469444:24469527,24470475:24470503,24471299:24471319,24474627:24474644,24479821:24479837,24481692:24481716,24482442:24482481,24482912:24482997,24483630:24483644,24484133:24484165,24485391:24485469,24486529:24486538,24487347:24487419,24493818:24493829,24495217:24495321,24498586:24498610,24504887:24504916,24505558:24505574,24506120:24506256,24507576:24507598,24508303:24508351,24508782:24508787,24509402:24509422,24511563:24511599,24511760:24511811,24516386:24516548,24518185:24518222,24519329:24519390,24521308:24521325,24522287:24522332,24524579:24524665,24532381:24532416,24534236:24534305,24535211:24535258,24535806:24535870,24536995:24537014,24537684:24537748,24538618:24538638,24541210:24541305,24542140:24542147,24542941:24543017,24543938:24543977,24546341:24546381,24547868:24547898,24565474:24565546,24566265:24566304,24568090:2456811', 'assoc_mat': '24453550:kraft:3726:24453562,24454494:kraft:3726:24454597,24460386:kraft:3726:24460427,24461304:kraft:3726:24461345,24463058:kraft:3726:24463073,24463947:kraft:3726:24464075,24465018:kraft:3726:24465040,24466078:kraft:3726:24466131,24467726:kraft:3726:24467758,24468709:kraft:3726:24468738,24469444:kraft:3726:24469527,24470475:kraft:3726:24470503,24471299:kraft:3726:24471319,24474627:kraft:3726:24474644,24479821:kraft:3726:24479837,24481692:kraft:3726:24481716,24482442:kraft:3726:24482481,24482912:kraft:3726:24482997,24483630:kraft:3726:24483644,24484133:kraft:3726:24484165,24485391:kraft:3726:24485469,24486529:kraft:3726:24486538,24487347:kraft:3726:24487419,24493818:kraft:3726:24493829,24495217:kraft:3726:24495321,24498586:kraft:3726:24498610,24504887:kraft:3726:24504916,24505558:kraft:3726:24505574,24506120:kraft:3726:24506256,24507576:kraft:3726:24507598,24508303:kraft:3726:24508351,24508782:kraft:3726:24508787,24509402:kraft:3726:24509422,24511563:kraft:3726:24511599,24511760:kraft:3726:24511811,24516386:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.001272257150840642, 'nb_photo': 694, 'list_port_cont': '24453560,24457638,24461346,24466127,24470505,24473973,24474646,24477610,24478404,24479068,24479844,24481717,24486545,24487417,24494109,24495322,24504921,24506257,24508341,24508664,24509436,24512605,24516546,24519399,24521285,24522323,24532413,24534307,24535253,24535972,24537765,24538645,24541297,24547896,24553446,24561587,24562815,24565550,24567060,24568118,24580417,24586413,24592274,24592881,24601557,24604314,24607305,24608095,24608814,24610151,24611900,24612727,24614188,24614726,24617926,24618484,24619480,24620924,24621544,24623949,24626571,24626999,24627181,24627285,24627524,24628124,24628573,24633458,24633932,24635574,24662164,24663038,24663541,24663985,24664423,24671801,24672403,24672850,24673393,24673878,24674815,24675914,24681829,24684041,24686626,24690995,24696921,24699991,24700905,24701877,24702773,24703733,24705457,24707066,24707485,24707925,24708487,24708872,24709328,24709771,24712089,24712506,24712940,24713377,24714253,24714715,24716678,24718480,24721849,24724249,24725568,24755863,24756538,2475897', 'assoc_port': '24453550:24453560,24457624:24457638,24461304:24461346,24466078:24466127,24470475:24470505,24473939:24473973,24474627:24474646,24477545:24477610,24478378:24478404,24479021:24479068,24479821:24479844,24481692:24481717,24486529:24486545,24487347:24487417,24494102:24494109,24495217:24495322,24504887:24504921,24506120:24506257,24508303:24508341,24508622:24508664,24509402:24509436,24512566:24512605,24516386:24516546,24519329:24519399,24521036:24521285,24522287:24522323,24532381:24532413,24534236:24534307,24535211:24535253,24535808:24535972,24537684:24537765,24538618:24538645,24541210:24541297,24547868:24547896,24553425:24553446,24561557:24561587,24562734:24562815,24565474:24565550,24567059:24567060,24568090:24568118,24580345:24580417,24586317:24586413,24592235:24592274,24592838:24592881,24601516:24601557,24604251:24604314,24607246:24607305,24608042:24608095,24608727:24608814,24610124:24610151,24611872:24611900,24612688:24612727,24614163:24614188,24614696:24614726,24617888:24617926,24618457:24618484,24619450:2461948', 'assoc_mat': '24453550:metal:3726:24453560,24457624:metal:3726:24457638,24461304:metal:3726:24461346,24466078:metal:3726:24466127,24470475:metal:3726:24470505,24473939:metal:3726:24473973,24474627:metal:3726:24474646,24477545:metal:3726:24477610,24478378:metal:3726:24478404,24479021:metal:3726:24479068,24479821:metal:3726:24479844,24481692:metal:3726:24481717,24486529:metal:3726:24486545,24487347:metal:3726:24487417,24494102:metal:3726:24494109,24495217:metal:3726:24495322,24504887:metal:3726:24504921,24506120:metal:3726:24506257,24508303:metal:3726:24508341,24508622:metal:3726:24508664,24509402:metal:3726:24509436,24512566:metal:3726:24512605,24516386:metal:3726:24516546,24519329:metal:3726:24519399,24521036:metal:3726:24521285,24522287:metal:3726:24522323,24532381:metal:3726:24532413,24534236:metal:3726:24534307,24535211:metal:3726:24535253,24535808:metal:3726:24535972,24537684:metal:3726:24537765,24538618:metal:3726:24538645,24541210:metal:3726:24541297,24547868:metal:3726:24547896,24553425:metal:3726:24553446,24561557:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007958586799052456, 'nb_photo': 13413, 'list_port_cont': '24453386,24453556,24453966,24454595,24455338,24455948,24456524,24457013,24457643,24459165,24459852,24460424,24460957,24461344,24461916,24462422,24463083,24464079,24465044,24466128,24467759,24468731,24469523,24470511,24471328,24472131,24473075,24473975,24474650,24475419,24476220,24476943,24477603,24478403,24479066,24479839,24480364,24481143,24481720,24484816,24485470,24486541,24487414,24493819,24494119,24495315,24498616,24503356,24504568,24504918,24505572,24506263,24506963,24507602,24508344,24508655,24508797,24509428,24511606,24511806,24512609,24513700,24515142,24516549,24518216,24519391,24520375,24521206,24521241,24521288,24521321,24522328,24523115,24524659,24528137,24532418,24534306,24535257,24535877,24535983,24536268,24537022,24537745,24538636,24541306,24542153,24543018,24543974,24544791,24545623,24547193,24547905,24548710,24552506,24553450,24561305,24561590,24562814,24563088,24564737,24565554,24566303,24567061,24568110,24569238,24570356,24571003,24571202,24572295,24575149,24575212,24580146,24580412,2458165', 'assoc_port': '24453336:24453386,24453550:24453556,24453929:24453966,24454494:24454595,24455325:24455338,24455910:24455948,24456503:24456524,24456994:24457013,24457624:24457643,24459089:24459165,24459828:24459852,24460386:24460424,24460928:24460957,24461304:24461344,24461899:24461916,24462393:24462422,24463058:24463083,24463947:24464079,24465018:24465044,24466078:24466128,24467726:24467759,24468709:24468731,24469444:24469523,24470475:24470511,24471299:24471328,24472121:24472131,24473035:24473075,24473939:24473975,24474627:24474650,24475411:24475419,24476167:24476220,24476925:24476943,24477545:24477603,24478378:24478403,24479021:24479066,24479821:24479839,24480340:24480364,24481098:24481143,24481692:24481720,24484781:24484816,24485391:24485470,24486529:24486541,24487347:24487414,24493818:24493819,24494102:24494119,24495217:24495315,24498586:24498616,24503346:24503356,24504530:24504568,24504887:24504918,24505558:24505572,24506120:24506263,24506947:24506963,24507576:24507602,24508303:24508344,24508622:24508655,24508782:2450879', 'assoc_mat': '24453336:plastique:3726:24453386,24453550:plastique:3726:24453556,24453929:plastique:3726:24453966,24454494:plastique:3726:24454595,24455325:plastique:3726:24455338,24455910:plastique:3726:24455948,24456503:plastique:3726:24456524,24456994:plastique:3726:24457013,24457624:plastique:3726:24457643,24459089:plastique:3726:24459165,24459828:plastique:3726:24459852,24460386:plastique:3726:24460424,24460928:plastique:3726:24460957,24461304:plastique:3726:24461344,24461899:plastique:3726:24461916,24462393:plastique:3726:24462422,24463058:plastique:3726:24463083,24463947:plastique:3726:24464079,24465018:plastique:3726:24465044,24466078:plastique:3726:24466128,24467726:plastique:3726:24467759,24468709:plastique:3726:24468731,24469444:plastique:3726:24469523,24470475:plastique:3726:24470511,24471299:plastique:3726:24471328,24472121:plastique:3726:24472131,24473035:plastique:3726:24473075,24473939:plastique:3726:24473975,24474627:plastique:3726:24474650,24475411:plastique:3726:24475419,24476167:plastique:3726:24476220,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.013705388343444412, 'nb_photo': 57835, 'list_port_cont': '24453378,24453554,24453964,24454591,24455340,24455952,24456525,24457018,24457645,24460423,24460964,24461348,24461923,24462428,24463076,24464061,24465039,24466130,24467033,24467750,24468740,24469528,24470500,24471323,24472143,24473079,24473977,24474642,24475421,24476229,24476949,24477604,24478396,24479070,24479841,24480360,24481147,24481712,24483651,24484819,24485466,24486535,24487409,24493820,24494114,24494257,24495313,24496190,24496669,24497502,24497659,24498618,24501321,24503364,24503537,24504566,24504925,24505568,24506264,24506960,24507594,24508340,24508658,24508789,24509432,24510146,24511607,24511813,24512601,24513704,24515140,24516551,24518225,24519394,24520374,24521197,24521245,24521287,24521322,24522330,24523103,24523958,24524654,24528132,24532424,24533610,24534314,24535248,24535874,24535980,24536277,24537017,24537750,24538634,24541307,24542143,24543010,24543975,24544792,24545617,24546378,24547195,24547901,24548708,24549423,24550184,24550908,24551731,24552507,24553442,24561579,24562813,24563087,2456367', 'assoc_port': '24453336:24453378,24453550:24453554,24453929:24453964,24454494:24454591,24455325:24455340,24455910:24455952,24456503:24456525,24456994:24457018,24457624:24457645,24460386:24460423,24460928:24460964,24461304:24461348,24461899:24461923,24462393:24462428,24463058:24463076,24463947:24464061,24465018:24465039,24466078:24466130,24467014:24467033,24467726:24467750,24468709:24468740,24469444:24469528,24470475:24470500,24471299:24471323,24472121:24472143,24473035:24473079,24473939:24473977,24474627:24474642,24475411:24475421,24476167:24476229,24476925:24476949,24477545:24477604,24478378:24478396,24479021:24479070,24479821:24479841,24480340:24480360,24481098:24481147,24481692:24481712,24483630:24483651,24484781:24484819,24485391:24485466,24486529:24486535,24487347:24487409,24493818:24493820,24494102:24494114,24494234:24494257,24495217:24495313,24496182:24496190,24496579:24496669,24497467:24497502,24497619:24497659,24498586:24498618,24501313:24501321,24503346:24503364,24503493:24503537,24504530:24504566,24504887:2450492', 'assoc_mat': '24453336:Teint_Dans_La_Masse:3726:24453378,24453550:Teint_Dans_La_Masse:3726:24453554,24453929:Teint_Dans_La_Masse:3726:24453964,24454494:Teint_Dans_La_Masse:3726:24454591,24455325:Teint_Dans_La_Masse:3726:24455340,24455910:Teint_Dans_La_Masse:3726:24455952,24456503:Teint_Dans_La_Masse:3726:24456525,24456994:Teint_Dans_La_Masse:3726:24457018,24457624:Teint_Dans_La_Masse:3726:24457645,24460386:Teint_Dans_La_Masse:3726:24460423,24460928:Teint_Dans_La_Masse:3726:24460964,24461304:Teint_Dans_La_Masse:3726:24461348,24461899:Teint_Dans_La_Masse:3726:24461923,24462393:Teint_Dans_La_Masse:3726:24462428,24463058:Teint_Dans_La_Masse:3726:24463076,24463947:Teint_Dans_La_Masse:3726:24464061,24465018:Teint_Dans_La_Masse:3726:24465039,24466078:Teint_Dans_La_Masse:3726:24466130,24467014:Teint_Dans_La_Masse:3726:24467033,24467726:Teint_Dans_La_Masse:3726:24467750,24468709:Teint_Dans_La_Masse:3726:24468740,24469444:Teint_Dans_La_Masse:3726:24469528,24470475:Teint_Dans_La_Masse:3726:24470500,24471299:Teint_Dans_La_Masse:3726:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1950451,1956312,1958228,1962711,1964203,1968835,1969557,1973830,1976862,1980511,1982065,1986573,1990620,1992556,1997240,1998066,1999380,2003808,2007584,2011116,2014886,2018650,2020513,2029377,2036791,2044285,2051283)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=10 and date >='2025-07-01' and date <= '2025-07-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((163169,),), 'unwanted_material_monthly_percentage': ((0.040671754144055244,),), 'material_repartition': (('JRM', 155232),), 'material_dict': {'JRM': 155232}, 'coverage_data': (('2025/07/01/', 0.97581),), 'impurety_average_data': ((datetime.date(2025, 7, 1), 0.040855655523986026, 4202), (datetime.date(2025, 7, 2), 0.038207380350633126, 6636), (datetime.date(2025, 7, 3), 0.06379199269743897, 4091), (datetime.date(2025, 7, 4), 0.03958537043626245, 7738), (datetime.date(2025, 7, 5), 0.03050676366679089, 1913), (datetime.date(2025, 7, 7), 0.03752924246404843, 6917), (datetime.date(2025, 7, 8), 0.042049557450809474, 4254), (datetime.date(2025, 7, 9), 0.0401033191639951, 7824), (datetime.date(2025, 7, 10), 0.033878841412479474, 7723), (datetime.date(2025, 7, 11), 0.01266294801656817, 10853), (datetime.date(2025, 7, 12), 0.04591620152444912, 2346), (datetime.date(2025, 7, 14), 0.04067602677687238, 6467), (datetime.date(2025, 7, 15), 0.03951186143012474, 7399), (datetime.date(2025, 7, 16), 0.050787465513531124, 7890), (datetime.date(2025, 7, 17), 0.04024776954649624, 7992), (datetime.date(2025, 7, 18), 0.04194959947367421, 5750), (datetime.date(2025, 7, 19), 0.03827758029186453, 1447), (datetime.date(2025, 7, 21), 0.04375339924486099, 5517), (datetime.date(2025, 7, 22), 0.0401442233945996, 6318), (datetime.date(2025, 7, 23), 0.04047850713122685, 7141), (datetime.date(2025, 7, 24), 0.03961814910937776, 7418), (datetime.date(2025, 7, 25), 0.040088909002005645, 6992), (datetime.date(2025, 7, 26), 0.06752344862523217, 1500), (datetime.date(2025, 7, 28), 0.0546144830816851, 5818), (datetime.date(2025, 7, 29), 0.0454752388114336, 7136), (datetime.date(2025, 7, 30), 0.04452945281142941, 5950), (datetime.date(2025, 7, 31), 0.045596584941205213, 7258)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 7, 1), 0.040855655523986026, 4202), (datetime.date(2025, 7, 2), 0.038207380350633126, 6636), (datetime.date(2025, 7, 3), 0.06379199269743897, 4091), (datetime.date(2025, 7, 4), 0.03958537043626245, 7738), (datetime.date(2025, 7, 5), 0.03050676366679089, 1913), (datetime.date(2025, 7, 7), 0.03752924246404843, 6917), (datetime.date(2025, 7, 8), 0.042049557450809474, 4254), (datetime.date(2025, 7, 9), 0.0401033191639951, 7824), (datetime.date(2025, 7, 10), 0.033878841412479474, 7723), (datetime.date(2025, 7, 11), 0.01266294801656817, 10853), (datetime.date(2025, 7, 12), 0.04591620152444912, 2346), (datetime.date(2025, 7, 14), 0.04067602677687238, 6467), (datetime.date(2025, 7, 15), 0.03951186143012474, 7399), (datetime.date(2025, 7, 16), 0.050787465513531124, 7890), (datetime.date(2025, 7, 17), 0.04024776954649624, 7992), (datetime.date(2025, 7, 18), 0.04194959947367421, 5750), (datetime.date(2025, 7, 19), 0.03827758029186453, 1447), (datetime.date(2025, 7, 21), 0.04375339924486099, 5517), (datetime.date(2025, 7, 22), 0.0401442233945996, 6318), (datetime.date(2025, 7, 23), 0.04047850713122685, 7141), (datetime.date(2025, 7, 24), 0.03961814910937776, 7418), (datetime.date(2025, 7, 25), 0.040088909002005645, 6992), (datetime.date(2025, 7, 26), 0.06752344862523217, 1500), (datetime.date(2025, 7, 28), 0.0546144830816851, 5818), (datetime.date(2025, 7, 29), 0.0454752388114336, 7136), (datetime.date(2025, 7, 30), 0.04452945281142941, 5950), (datetime.date(2025, 7, 31), 0.045596584941205213, 7258))}, 'quality_array': [['-4.341699517085273', '01072025'], ['-4.5977480980297605', '02072025'], ['-4.397360004664113', '03072025'], ['-4.345002141004766', '04072025'], ['-4.621985778172106', '05072025'], ['-4.377759215804083', '07072025'], ['-4.24892660798865', '08072025'], ['-4.2198381028208', '09072025'], ['-4.30592978596125', '10072025'], ['-4.825295297942701', '11072025'], ['-4.6488564478386865', '12072025'], ['-5.579193564067592', '14072025'], ['-4.52050619011362', '15072025'], ['-4.086062944724691', '16072025'], ['-4.221960154409327', '17072025'], ['-4.30162166729492', '18072025'], ['-4.433269488319977', '19072025'], ['-4.429847897116992', '21072025'], ['-4.295655288294431', '22072025'], ['-4.237552865663832', '23072025'], ['-4.268073677026304', '24072025'], ['-4.221305950038126', '25072025'], ['-4.659506242678513', '26072025'], ['-4.338673125558062', '28072025'], ['-4.63804507585589', '29072025'], ['-4.4031426629233765', '30072025'], ['-4.303352177154817', '31072025']], 'number_of_batch': ((1962,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0060754175666101464, 'nb_photo': 16855, 'list_port_cont': '24453383,24453563,24453970,24454601,24455337,24455957,24456523,24457011,24457641,24459164,24459855,24460428,24460962,24461337,24461925,24462419,24463077,24464059,24465041,24466121,24467031,24467760,24468736,24469531,24470502,24471329,24472134,24473080,24473976,24474649,24475416,24476218,24476942,24477609,24478399,24479071,24479845,24480362,24481141,24481721,24482476,24482998,24483647,24484168,24484820,24485474,24486542,24487413,24493821,24494112,24494258,24495310,24498609,24503357,24503434,24504561,24504923,24505575,24506099,24506265,24506957,24507601,24508339,24508660,24508788,24509433,24510144,24511598,24511817,24512608,24513698,24515146,24516552,24518214,24519400,24520368,24521203,24521237,24521291,24521329,24522327,24523104,24524661,24528135,24532423,24534312,24535249,24535872,24535982,24536276,24537012,24537741,24538637,24541308,24542152,24543014,24543970,24544800,24545613,24547906,24548712,24552512,24553451,24561302,24561583,24562819,24563083,24563682,24564731,24565548,24566299,24567069,24568114,2456924', 'assoc_port': '24453336:24453383,24453550:24453563,24453929:24453970,24454494:24454601,24455325:24455337,24455910:24455957,24456503:24456523,24456994:24457011,24457624:24457641,24459089:24459164,24459828:24459855,24460386:24460428,24460928:24460962,24461304:24461337,24461899:24461925,24462393:24462419,24463058:24463077,24463947:24464059,24465018:24465041,24466078:24466121,24467014:24467031,24467726:24467760,24468709:24468736,24469444:24469531,24470475:24470502,24471299:24471329,24472121:24472134,24473035:24473080,24473939:24473976,24474627:24474649,24475411:24475416,24476167:24476218,24476925:24476942,24477545:24477609,24478378:24478399,24479021:24479071,24479821:24479845,24480340:24480362,24481098:24481141,24481692:24481721,24482442:24482476,24482912:24482998,24483630:24483647,24484133:24484168,24484781:24484820,24485391:24485474,24486529:24486542,24487347:24487413,24493818:24493821,24494102:24494112,24494234:24494258,24495217:24495310,24498586:24498609,24503345:24503434,24503346:24503357,24504530:24504561,24504887:2450492', 'assoc_mat': '24453336:autre_refus:3726:24453383,24453550:autre_refus:3726:24453563,24453929:autre_refus:3726:24453970,24454494:autre_refus:3726:24454601,24455325:autre_refus:3726:24455337,24455910:autre_refus:3726:24455957,24456503:autre_refus:3726:24456523,24456994:autre_refus:3726:24457011,24457624:autre_refus:3726:24457641,24459089:autre_refus:3726:24459164,24459828:autre_refus:3726:24459855,24460386:autre_refus:3726:24460428,24460928:autre_refus:3726:24460962,24461304:autre_refus:3726:24461337,24461899:autre_refus:3726:24461925,24462393:autre_refus:3726:24462419,24463058:autre_refus:3726:24463077,24463947:autre_refus:3726:24464059,24465018:autre_refus:3726:24465041,24466078:autre_refus:3726:24466121,24467014:autre_refus:3726:24467031,24467726:autre_refus:3726:24467760,24468709:autre_refus:3726:24468736,24469444:autre_refus:3726:24469531,24470475:autre_refus:3726:24470502,24471299:autre_refus:3726:24471329,24472121:autre_refus:3726:24472134,24473035:autre_refus:3726:24473080,24473939:autre_refus:3726:24473976,24474627:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00524032737807775, 'nb_photo': 22544, 'list_port_cont': '24453564,24453971,24454590,24455341,24455947,24456531,24457009,24457648,24458135,24458697,24459161,24459850,24460425,24460963,24461338,24461920,24462420,24463084,24464062,24465049,24466124,24467038,24467757,24468729,24469532,24470508,24471331,24472144,24474647,24475422,24476228,24476946,24477605,24478395,24479065,24479836,24480358,24481138,24481718,24482472,24482990,24484817,24485465,24486540,24487410,24493824,24494116,24494249,24495312,24498617,24503354,24503427,24503538,24504564,24504922,24505564,24506095,24506262,24506955,24507604,24508336,24508659,24508794,24509420,24511600,24511809,24512603,24513694,24515149,24516547,24518219,24519396,24520367,24521202,24521244,24521294,24521330,24522329,24523107,24524660,24528139,24532420,24534309,24535250,24535868,24535978,24536273,24537015,24537761,24538642,24541301,24542148,24543015,24543979,24547907,24552502,24553441,24561301,24561588,24562812,24563090,24563680,24564742,24565547,24566307,24567064,24568112,24569232,24570355,24571006,24571195,24575154,24575205,2458014', 'assoc_port': '24453550:24453564,24453929:24453971,24454494:24454590,24455325:24455341,24455910:24455947,24456503:24456531,24456994:24457009,24457624:24457648,24458102:24458135,24458664:24458697,24459089:24459161,24459828:24459850,24460386:24460425,24460928:24460963,24461304:24461338,24461899:24461920,24462393:24462420,24463058:24463084,24463947:24464062,24465018:24465049,24466078:24466124,24467014:24467038,24467726:24467757,24468709:24468729,24469444:24469532,24470475:24470508,24471299:24471331,24472121:24472144,24474627:24474647,24475411:24475422,24476167:24476228,24476925:24476946,24477545:24477605,24478378:24478395,24479021:24479065,24479821:24479836,24480340:24480358,24481098:24481138,24481692:24481718,24482442:24482472,24482912:24482990,24484781:24484817,24485391:24485465,24486529:24486540,24487347:24487410,24493818:24493824,24494102:24494116,24494234:24494249,24495217:24495312,24498586:24498617,24503345:24503427,24503346:24503354,24503493:24503538,24504530:24504564,24504887:24504922,24505558:24505564,24506011:2450609', 'assoc_mat': '24453550:cartonnette:3726:24453564,24453929:cartonnette:3726:24453971,24454494:cartonnette:3726:24454590,24455325:cartonnette:3726:24455341,24455910:cartonnette:3726:24455947,24456503:cartonnette:3726:24456531,24456994:cartonnette:3726:24457009,24457624:cartonnette:3726:24457648,24458102:cartonnette:3726:24458135,24458664:cartonnette:3726:24458697,24459089:cartonnette:3726:24459161,24459828:cartonnette:3726:24459850,24460386:cartonnette:3726:24460425,24460928:cartonnette:3726:24460963,24461304:cartonnette:3726:24461338,24461899:cartonnette:3726:24461920,24462393:cartonnette:3726:24462420,24463058:cartonnette:3726:24463084,24463947:cartonnette:3726:24464062,24465018:cartonnette:3726:24465049,24466078:cartonnette:3726:24466124,24467014:cartonnette:3726:24467038,24467726:cartonnette:3726:24467757,24468709:cartonnette:3726:24468729,24469444:cartonnette:3726:24469532,24470475:cartonnette:3726:24470508,24471299:cartonnette:3726:24471331,24472121:cartonnette:3726:24472144,24474627:cartonnette:3726:24474647,24475411:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.022315492048405397, 'nb_photo': 21665, 'list_port_cont': '24453375,24453559,24453963,24454593,24455336,24455955,24456526,24457010,24457644,24458134,24458690,24459162,24459846,24460420,24460965,24461347,24461921,24462421,24463072,24464077,24465048,24466122,24467029,24467751,24468739,24469529,24470506,24471324,24472141,24473078,24474643,24475420,24476227,24476950,24477613,24478394,24479073,24479840,24480365,24481146,24481711,24484812,24485473,24486539,24487411,24493825,24494117,24494256,24495311,24498613,24501136,24503366,24504565,24504924,24505567,24506096,24506259,24506965,24507595,24508337,24508661,24508795,24509434,24511596,24511816,24512599,24513697,24515141,24516543,24518218,24519398,24520362,24521196,24521236,24521293,24521326,24522321,24523106,24524658,24525695,24526532,24527393,24528133,24528333,24529730,24531037,24532414,24532668,24534310,24535251,24535873,24535977,24536269,24537013,24537763,24538635,24541299,24542151,24543008,24543973,24545618,24546379,24547192,24547903,24548709,24549411,24550189,24550911,24551732,24552503,24553443,24561589,24562811,2456369', 'assoc_port': '24453336:24453375,24453550:24453559,24453929:24453963,24454494:24454593,24455325:24455336,24455910:24455955,24456503:24456526,24456994:24457010,24457624:24457644,24458102:24458134,24458664:24458690,24459089:24459162,24459828:24459846,24460386:24460420,24460928:24460965,24461304:24461347,24461899:24461921,24462393:24462421,24463058:24463072,24463947:24464077,24465018:24465048,24466078:24466122,24467014:24467029,24467726:24467751,24468709:24468739,24469444:24469529,24470475:24470506,24471299:24471324,24472121:24472141,24473035:24473078,24474627:24474643,24475411:24475420,24476167:24476227,24476925:24476950,24477545:24477613,24478378:24478394,24479021:24479073,24479821:24479840,24480340:24480365,24481098:24481146,24481692:24481711,24484781:24484812,24485391:24485473,24486529:24486539,24487347:24487411,24493818:24493825,24494102:24494117,24494234:24494256,24495217:24495311,24498586:24498613,24501065:24501136,24503346:24503366,24504530:24504565,24504887:24504924,24505558:24505567,24506011:24506096,24506120:2450625', 'assoc_mat': '24453336:Carton_brun:3726:24453375,24453550:Carton_brun:3726:24453559,24453929:Carton_brun:3726:24453963,24454494:Carton_brun:3726:24454593,24455325:Carton_brun:3726:24455336,24455910:Carton_brun:3726:24455955,24456503:Carton_brun:3726:24456526,24456994:Carton_brun:3726:24457010,24457624:Carton_brun:3726:24457644,24458102:Carton_brun:3726:24458134,24458664:Carton_brun:3726:24458690,24459089:Carton_brun:3726:24459162,24459828:Carton_brun:3726:24459846,24460386:Carton_brun:3726:24460420,24460928:Carton_brun:3726:24460965,24461304:Carton_brun:3726:24461347,24461899:Carton_brun:3726:24461921,24462393:Carton_brun:3726:24462421,24463058:Carton_brun:3726:24463072,24463947:Carton_brun:3726:24464077,24465018:Carton_brun:3726:24465048,24466078:Carton_brun:3726:24466122,24467014:Carton_brun:3726:24467029,24467726:Carton_brun:3726:24467751,24468709:Carton_brun:3726:24468739,24469444:Carton_brun:3726:24469529,24470475:Carton_brun:3726:24470506,24471299:Carton_brun:3726:24471324,24472121:Carton_brun:3726:24472141,24473035:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01218969583935689, 'nb_photo': 24030, 'list_port_cont': '24453379,24453558,24453969,24454600,24455342,24455958,24456521,24457012,24457646,24458139,24458696,24459163,24460429,24460954,24461340,24461927,24462424,24463082,24464080,24465038,24466120,24467035,24467753,24468741,24469524,24470509,24471322,24472140,24474639,24475426,24476223,24476951,24477606,24478397,24479064,24479842,24480356,24481136,24481715,24482479,24482988,24484822,24485475,24486543,24487408,24493826,24494111,24494250,24494787,24495316,24495522,24496195,24496675,24497495,24497656,24498329,24498614,24498725,24499633,24500065,24500820,24501322,24501917,24502288,24503183,24503361,24503424,24503532,24504569,24504927,24505565,24506103,24506261,24506956,24507599,24508343,24508657,24508796,24509424,24510154,24511601,24511815,24512610,24513695,24515153,24516545,24518215,24519395,24520364,24521201,24521243,24521295,24521327,24522322,24523113,24524664,24526535,24527405,24528134,24532419,24534311,24535259,24535876,24535975,24536275,24537011,24537752,24538644,24541303,24542150,24543012,24543981,24545620,2454637', 'assoc_port': '24453336:24453379,24453550:24453558,24453929:24453969,24454494:24454600,24455325:24455342,24455910:24455958,24456503:24456521,24456994:24457012,24457624:24457646,24458102:24458139,24458664:24458696,24459089:24459163,24460386:24460429,24460928:24460954,24461304:24461340,24461899:24461927,24462393:24462424,24463058:24463082,24463947:24464080,24465018:24465038,24466078:24466120,24467014:24467035,24467726:24467753,24468709:24468741,24469444:24469524,24470475:24470509,24471299:24471322,24472121:24472140,24474627:24474639,24475411:24475426,24476167:24476223,24476925:24476951,24477545:24477606,24478378:24478397,24479021:24479064,24479821:24479842,24480340:24480356,24481098:24481136,24481692:24481715,24482442:24482479,24482912:24482988,24484781:24484822,24485391:24485475,24486529:24486543,24487347:24487408,24493818:24493826,24494102:24494111,24494234:24494250,24494774:24494787,24495217:24495316,24495450:24495522,24496182:24496195,24496579:24496675,24497467:24497495,24497619:24497656,24498295:24498329,24498586:2449861', 'assoc_mat': '24453336:Carton_gris:3726:24453379,24453550:Carton_gris:3726:24453558,24453929:Carton_gris:3726:24453969,24454494:Carton_gris:3726:24454600,24455325:Carton_gris:3726:24455342,24455910:Carton_gris:3726:24455958,24456503:Carton_gris:3726:24456521,24456994:Carton_gris:3726:24457012,24457624:Carton_gris:3726:24457646,24458102:Carton_gris:3726:24458139,24458664:Carton_gris:3726:24458696,24459089:Carton_gris:3726:24459163,24460386:Carton_gris:3726:24460429,24460928:Carton_gris:3726:24460954,24461304:Carton_gris:3726:24461340,24461899:Carton_gris:3726:24461927,24462393:Carton_gris:3726:24462424,24463058:Carton_gris:3726:24463082,24463947:Carton_gris:3726:24464080,24465018:Carton_gris:3726:24465038,24466078:Carton_gris:3726:24466120,24467014:Carton_gris:3726:24467035,24467726:Carton_gris:3726:24467753,24468709:Carton_gris:3726:24468741,24469444:Carton_gris:3726:24469524,24470475:Carton_gris:3726:24470509,24471299:Carton_gris:3726:24471322,24472121:Carton_gris:3726:24472140,24474627:Carton_gris:3726:24474639,24475411:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004044582656644895, 'nb_photo': 5340, 'list_port_cont': '24453562,24454597,24460427,24461345,24463073,24464075,24465040,24466131,24467758,24468738,24469527,24470503,24471319,24474644,24479837,24481716,24482481,24482997,24483644,24484165,24485469,24486538,24487419,24493829,24495321,24498610,24504916,24505574,24506256,24507598,24508351,24508787,24509422,24511599,24511811,24516548,24518222,24519390,24521325,24522332,24524665,24532416,24534305,24535258,24535870,24537014,24537748,24538638,24541305,24542147,24543017,24543977,24546381,24547898,24565546,24566304,24568113,24569230,24571001,24571201,24572298,24573171,24574355,24575153,24575209,24575362,24580147,24580411,24582060,24586412,24589763,24591462,24592258,24592887,24597995,24601097,24601560,24601713,24603246,24605354,24607296,24608569,24608810,24609628,24610147,24611262,24612720,24614727,24616107,24616871,24617482,24617917,24618493,24618942,24619987,24621543,24621975,24622465,24624886,24625612,24627006,24627179,24627208,24627240,24627279,24627333,24627357,24627534,24628998,24630888,24631252,24632515,24633931,2463439', 'assoc_port': '24453550:24453562,24454494:24454597,24460386:24460427,24461304:24461345,24463058:24463073,24463947:24464075,24465018:24465040,24466078:24466131,24467726:24467758,24468709:24468738,24469444:24469527,24470475:24470503,24471299:24471319,24474627:24474644,24479821:24479837,24481692:24481716,24482442:24482481,24482912:24482997,24483630:24483644,24484133:24484165,24485391:24485469,24486529:24486538,24487347:24487419,24493818:24493829,24495217:24495321,24498586:24498610,24504887:24504916,24505558:24505574,24506120:24506256,24507576:24507598,24508303:24508351,24508782:24508787,24509402:24509422,24511563:24511599,24511760:24511811,24516386:24516548,24518185:24518222,24519329:24519390,24521308:24521325,24522287:24522332,24524579:24524665,24532381:24532416,24534236:24534305,24535211:24535258,24535806:24535870,24536995:24537014,24537684:24537748,24538618:24538638,24541210:24541305,24542140:24542147,24542941:24543017,24543938:24543977,24546341:24546381,24547868:24547898,24565474:24565546,24566265:24566304,24568090:2456811', 'assoc_mat': '24453550:kraft:3726:24453562,24454494:kraft:3726:24454597,24460386:kraft:3726:24460427,24461304:kraft:3726:24461345,24463058:kraft:3726:24463073,24463947:kraft:3726:24464075,24465018:kraft:3726:24465040,24466078:kraft:3726:24466131,24467726:kraft:3726:24467758,24468709:kraft:3726:24468738,24469444:kraft:3726:24469527,24470475:kraft:3726:24470503,24471299:kraft:3726:24471319,24474627:kraft:3726:24474644,24479821:kraft:3726:24479837,24481692:kraft:3726:24481716,24482442:kraft:3726:24482481,24482912:kraft:3726:24482997,24483630:kraft:3726:24483644,24484133:kraft:3726:24484165,24485391:kraft:3726:24485469,24486529:kraft:3726:24486538,24487347:kraft:3726:24487419,24493818:kraft:3726:24493829,24495217:kraft:3726:24495321,24498586:kraft:3726:24498610,24504887:kraft:3726:24504916,24505558:kraft:3726:24505574,24506120:kraft:3726:24506256,24507576:kraft:3726:24507598,24508303:kraft:3726:24508351,24508782:kraft:3726:24508787,24509402:kraft:3726:24509422,24511563:kraft:3726:24511599,24511760:kraft:3726:24511811,24516386:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.001272257150840642, 'nb_photo': 694, 'list_port_cont': '24453560,24457638,24461346,24466127,24470505,24473973,24474646,24477610,24478404,24479068,24479844,24481717,24486545,24487417,24494109,24495322,24504921,24506257,24508341,24508664,24509436,24512605,24516546,24519399,24521285,24522323,24532413,24534307,24535253,24535972,24537765,24538645,24541297,24547896,24553446,24561587,24562815,24565550,24567060,24568118,24580417,24586413,24592274,24592881,24601557,24604314,24607305,24608095,24608814,24610151,24611900,24612727,24614188,24614726,24617926,24618484,24619480,24620924,24621544,24623949,24626571,24626999,24627181,24627285,24627524,24628124,24628573,24633458,24633932,24635574,24662164,24663038,24663541,24663985,24664423,24671801,24672403,24672850,24673393,24673878,24674815,24675914,24681829,24684041,24686626,24690995,24696921,24699991,24700905,24701877,24702773,24703733,24705457,24707066,24707485,24707925,24708487,24708872,24709328,24709771,24712089,24712506,24712940,24713377,24714253,24714715,24716678,24718480,24721849,24724249,24725568,24755863,24756538,2475897', 'assoc_port': '24453550:24453560,24457624:24457638,24461304:24461346,24466078:24466127,24470475:24470505,24473939:24473973,24474627:24474646,24477545:24477610,24478378:24478404,24479021:24479068,24479821:24479844,24481692:24481717,24486529:24486545,24487347:24487417,24494102:24494109,24495217:24495322,24504887:24504921,24506120:24506257,24508303:24508341,24508622:24508664,24509402:24509436,24512566:24512605,24516386:24516546,24519329:24519399,24521036:24521285,24522287:24522323,24532381:24532413,24534236:24534307,24535211:24535253,24535808:24535972,24537684:24537765,24538618:24538645,24541210:24541297,24547868:24547896,24553425:24553446,24561557:24561587,24562734:24562815,24565474:24565550,24567059:24567060,24568090:24568118,24580345:24580417,24586317:24586413,24592235:24592274,24592838:24592881,24601516:24601557,24604251:24604314,24607246:24607305,24608042:24608095,24608727:24608814,24610124:24610151,24611872:24611900,24612688:24612727,24614163:24614188,24614696:24614726,24617888:24617926,24618457:24618484,24619450:2461948', 'assoc_mat': '24453550:metal:3726:24453560,24457624:metal:3726:24457638,24461304:metal:3726:24461346,24466078:metal:3726:24466127,24470475:metal:3726:24470505,24473939:metal:3726:24473973,24474627:metal:3726:24474646,24477545:metal:3726:24477610,24478378:metal:3726:24478404,24479021:metal:3726:24479068,24479821:metal:3726:24479844,24481692:metal:3726:24481717,24486529:metal:3726:24486545,24487347:metal:3726:24487417,24494102:metal:3726:24494109,24495217:metal:3726:24495322,24504887:metal:3726:24504921,24506120:metal:3726:24506257,24508303:metal:3726:24508341,24508622:metal:3726:24508664,24509402:metal:3726:24509436,24512566:metal:3726:24512605,24516386:metal:3726:24516546,24519329:metal:3726:24519399,24521036:metal:3726:24521285,24522287:metal:3726:24522323,24532381:metal:3726:24532413,24534236:metal:3726:24534307,24535211:metal:3726:24535253,24535808:metal:3726:24535972,24537684:metal:3726:24537765,24538618:metal:3726:24538645,24541210:metal:3726:24541297,24547868:metal:3726:24547896,24553425:metal:3726:24553446,24561557:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007958586799052456, 'nb_photo': 13413, 'list_port_cont': '24453386,24453556,24453966,24454595,24455338,24455948,24456524,24457013,24457643,24459165,24459852,24460424,24460957,24461344,24461916,24462422,24463083,24464079,24465044,24466128,24467759,24468731,24469523,24470511,24471328,24472131,24473075,24473975,24474650,24475419,24476220,24476943,24477603,24478403,24479066,24479839,24480364,24481143,24481720,24484816,24485470,24486541,24487414,24493819,24494119,24495315,24498616,24503356,24504568,24504918,24505572,24506263,24506963,24507602,24508344,24508655,24508797,24509428,24511606,24511806,24512609,24513700,24515142,24516549,24518216,24519391,24520375,24521206,24521241,24521288,24521321,24522328,24523115,24524659,24528137,24532418,24534306,24535257,24535877,24535983,24536268,24537022,24537745,24538636,24541306,24542153,24543018,24543974,24544791,24545623,24547193,24547905,24548710,24552506,24553450,24561305,24561590,24562814,24563088,24564737,24565554,24566303,24567061,24568110,24569238,24570356,24571003,24571202,24572295,24575149,24575212,24580146,24580412,2458165', 'assoc_port': '24453336:24453386,24453550:24453556,24453929:24453966,24454494:24454595,24455325:24455338,24455910:24455948,24456503:24456524,24456994:24457013,24457624:24457643,24459089:24459165,24459828:24459852,24460386:24460424,24460928:24460957,24461304:24461344,24461899:24461916,24462393:24462422,24463058:24463083,24463947:24464079,24465018:24465044,24466078:24466128,24467726:24467759,24468709:24468731,24469444:24469523,24470475:24470511,24471299:24471328,24472121:24472131,24473035:24473075,24473939:24473975,24474627:24474650,24475411:24475419,24476167:24476220,24476925:24476943,24477545:24477603,24478378:24478403,24479021:24479066,24479821:24479839,24480340:24480364,24481098:24481143,24481692:24481720,24484781:24484816,24485391:24485470,24486529:24486541,24487347:24487414,24493818:24493819,24494102:24494119,24495217:24495315,24498586:24498616,24503346:24503356,24504530:24504568,24504887:24504918,24505558:24505572,24506120:24506263,24506947:24506963,24507576:24507602,24508303:24508344,24508622:24508655,24508782:2450879', 'assoc_mat': '24453336:plastique:3726:24453386,24453550:plastique:3726:24453556,24453929:plastique:3726:24453966,24454494:plastique:3726:24454595,24455325:plastique:3726:24455338,24455910:plastique:3726:24455948,24456503:plastique:3726:24456524,24456994:plastique:3726:24457013,24457624:plastique:3726:24457643,24459089:plastique:3726:24459165,24459828:plastique:3726:24459852,24460386:plastique:3726:24460424,24460928:plastique:3726:24460957,24461304:plastique:3726:24461344,24461899:plastique:3726:24461916,24462393:plastique:3726:24462422,24463058:plastique:3726:24463083,24463947:plastique:3726:24464079,24465018:plastique:3726:24465044,24466078:plastique:3726:24466128,24467726:plastique:3726:24467759,24468709:plastique:3726:24468731,24469444:plastique:3726:24469523,24470475:plastique:3726:24470511,24471299:plastique:3726:24471328,24472121:plastique:3726:24472131,24473035:plastique:3726:24473075,24473939:plastique:3726:24473975,24474627:plastique:3726:24474650,24475411:plastique:3726:24475419,24476167:plastique:3726:24476220,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.013705388343444412, 'nb_photo': 57835, 'list_port_cont': '24453378,24453554,24453964,24454591,24455340,24455952,24456525,24457018,24457645,24460423,24460964,24461348,24461923,24462428,24463076,24464061,24465039,24466130,24467033,24467750,24468740,24469528,24470500,24471323,24472143,24473079,24473977,24474642,24475421,24476229,24476949,24477604,24478396,24479070,24479841,24480360,24481147,24481712,24483651,24484819,24485466,24486535,24487409,24493820,24494114,24494257,24495313,24496190,24496669,24497502,24497659,24498618,24501321,24503364,24503537,24504566,24504925,24505568,24506264,24506960,24507594,24508340,24508658,24508789,24509432,24510146,24511607,24511813,24512601,24513704,24515140,24516551,24518225,24519394,24520374,24521197,24521245,24521287,24521322,24522330,24523103,24523958,24524654,24528132,24532424,24533610,24534314,24535248,24535874,24535980,24536277,24537017,24537750,24538634,24541307,24542143,24543010,24543975,24544792,24545617,24546378,24547195,24547901,24548708,24549423,24550184,24550908,24551731,24552507,24553442,24561579,24562813,24563087,2456367', 'assoc_port': '24453336:24453378,24453550:24453554,24453929:24453964,24454494:24454591,24455325:24455340,24455910:24455952,24456503:24456525,24456994:24457018,24457624:24457645,24460386:24460423,24460928:24460964,24461304:24461348,24461899:24461923,24462393:24462428,24463058:24463076,24463947:24464061,24465018:24465039,24466078:24466130,24467014:24467033,24467726:24467750,24468709:24468740,24469444:24469528,24470475:24470500,24471299:24471323,24472121:24472143,24473035:24473079,24473939:24473977,24474627:24474642,24475411:24475421,24476167:24476229,24476925:24476949,24477545:24477604,24478378:24478396,24479021:24479070,24479821:24479841,24480340:24480360,24481098:24481147,24481692:24481712,24483630:24483651,24484781:24484819,24485391:24485466,24486529:24486535,24487347:24487409,24493818:24493820,24494102:24494114,24494234:24494257,24495217:24495313,24496182:24496190,24496579:24496669,24497467:24497502,24497619:24497659,24498586:24498618,24501313:24501321,24503346:24503364,24503493:24503537,24504530:24504566,24504887:2450492', 'assoc_mat': '24453336:Teint_Dans_La_Masse:3726:24453378,24453550:Teint_Dans_La_Masse:3726:24453554,24453929:Teint_Dans_La_Masse:3726:24453964,24454494:Teint_Dans_La_Masse:3726:24454591,24455325:Teint_Dans_La_Masse:3726:24455340,24455910:Teint_Dans_La_Masse:3726:24455952,24456503:Teint_Dans_La_Masse:3726:24456525,24456994:Teint_Dans_La_Masse:3726:24457018,24457624:Teint_Dans_La_Masse:3726:24457645,24460386:Teint_Dans_La_Masse:3726:24460423,24460928:Teint_Dans_La_Masse:3726:24460964,24461304:Teint_Dans_La_Masse:3726:24461348,24461899:Teint_Dans_La_Masse:3726:24461923,24462393:Teint_Dans_La_Masse:3726:24462428,24463058:Teint_Dans_La_Masse:3726:24463076,24463947:Teint_Dans_La_Masse:3726:24464061,24465018:Teint_Dans_La_Masse:3726:24465039,24466078:Teint_Dans_La_Masse:3726:24466130,24467014:Teint_Dans_La_Masse:3726:24467033,24467726:Teint_Dans_La_Masse:3726:24467750,24468709:Teint_Dans_La_Masse:3726:24468740,24469444:Teint_Dans_La_Masse:3726:24469528,24470475:Teint_Dans_La_Masse:3726:24470500,24471299:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 163169}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-07', 0.040671754144055244),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((163169,),), 'unwanted_material_monthly_percentage': ((0.040671754144055244,),), 'material_repartition': (('JRM', 155232),), 'material_dict': {'JRM': 155232}, 'coverage_data': (('2025/07/01/', 0.97581),), 'impurety_average_data': ((datetime.date(2025, 7, 1), 0.040855655523986026, 4202), (datetime.date(2025, 7, 2), 0.038207380350633126, 6636), (datetime.date(2025, 7, 3), 0.06379199269743897, 4091), (datetime.date(2025, 7, 4), 0.03958537043626245, 7738), (datetime.date(2025, 7, 5), 0.03050676366679089, 1913), (datetime.date(2025, 7, 7), 0.03752924246404843, 6917), (datetime.date(2025, 7, 8), 0.042049557450809474, 4254), (datetime.date(2025, 7, 9), 0.0401033191639951, 7824), (datetime.date(2025, 7, 10), 0.033878841412479474, 7723), (datetime.date(2025, 7, 11), 0.01266294801656817, 10853), (datetime.date(2025, 7, 12), 0.04591620152444912, 2346), (datetime.date(2025, 7, 14), 0.04067602677687238, 6467), (datetime.date(2025, 7, 15), 0.03951186143012474, 7399), (datetime.date(2025, 7, 16), 0.050787465513531124, 7890), (datetime.date(2025, 7, 17), 0.04024776954649624, 7992), (datetime.date(2025, 7, 18), 0.04194959947367421, 5750), (datetime.date(2025, 7, 19), 0.03827758029186453, 1447), (datetime.date(2025, 7, 21), 0.04375339924486099, 5517), (datetime.date(2025, 7, 22), 0.0401442233945996, 6318), (datetime.date(2025, 7, 23), 0.04047850713122685, 7141), (datetime.date(2025, 7, 24), 0.03961814910937776, 7418), (datetime.date(2025, 7, 25), 0.040088909002005645, 6992), (datetime.date(2025, 7, 26), 0.06752344862523217, 1500), (datetime.date(2025, 7, 28), 0.0546144830816851, 5818), (datetime.date(2025, 7, 29), 0.0454752388114336, 7136), (datetime.date(2025, 7, 30), 0.04452945281142941, 5950), (datetime.date(2025, 7, 31), 0.045596584941205213, 7258)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 7, 1), 0.040855655523986026, 4202), (datetime.date(2025, 7, 2), 0.038207380350633126, 6636), (datetime.date(2025, 7, 3), 0.06379199269743897, 4091), (datetime.date(2025, 7, 4), 0.03958537043626245, 7738), (datetime.date(2025, 7, 5), 0.03050676366679089, 1913), (datetime.date(2025, 7, 7), 0.03752924246404843, 6917), (datetime.date(2025, 7, 8), 0.042049557450809474, 4254), (datetime.date(2025, 7, 9), 0.0401033191639951, 7824), (datetime.date(2025, 7, 10), 0.033878841412479474, 7723), (datetime.date(2025, 7, 11), 0.01266294801656817, 10853), (datetime.date(2025, 7, 12), 0.04591620152444912, 2346), (datetime.date(2025, 7, 14), 0.04067602677687238, 6467), (datetime.date(2025, 7, 15), 0.03951186143012474, 7399), (datetime.date(2025, 7, 16), 0.050787465513531124, 7890), (datetime.date(2025, 7, 17), 0.04024776954649624, 7992), (datetime.date(2025, 7, 18), 0.04194959947367421, 5750), (datetime.date(2025, 7, 19), 0.03827758029186453, 1447), (datetime.date(2025, 7, 21), 0.04375339924486099, 5517), (datetime.date(2025, 7, 22), 0.0401442233945996, 6318), (datetime.date(2025, 7, 23), 0.04047850713122685, 7141), (datetime.date(2025, 7, 24), 0.03961814910937776, 7418), (datetime.date(2025, 7, 25), 0.040088909002005645, 6992), (datetime.date(2025, 7, 26), 0.06752344862523217, 1500), (datetime.date(2025, 7, 28), 0.0546144830816851, 5818), (datetime.date(2025, 7, 29), 0.0454752388114336, 7136), (datetime.date(2025, 7, 30), 0.04452945281142941, 5950), (datetime.date(2025, 7, 31), 0.045596584941205213, 7258))}, 'quality_array': [['-4.341699517085273', '01072025'], ['-4.5977480980297605', '02072025'], ['-4.397360004664113', '03072025'], ['-4.345002141004766', '04072025'], ['-4.621985778172106', '05072025'], ['-4.377759215804083', '07072025'], ['-4.24892660798865', '08072025'], ['-4.2198381028208', '09072025'], ['-4.30592978596125', '10072025'], ['-4.825295297942701', '11072025'], ['-4.6488564478386865', '12072025'], ['-5.579193564067592', '14072025'], ['-4.52050619011362', '15072025'], ['-4.086062944724691', '16072025'], ['-4.221960154409327', '17072025'], ['-4.30162166729492', '18072025'], ['-4.433269488319977', '19072025'], ['-4.429847897116992', '21072025'], ['-4.295655288294431', '22072025'], ['-4.237552865663832', '23072025'], ['-4.268073677026304', '24072025'], ['-4.221305950038126', '25072025'], ['-4.659506242678513', '26072025'], ['-4.338673125558062', '28072025'], ['-4.63804507585589', '29072025'], ['-4.4031426629233765', '30072025'], ['-4.303352177154817', '31072025']], 'number_of_batch': ((1962,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0060754175666101464, 'nb_photo': 16855, 'list_port_cont': '24453383,24453563,24453970,24454601,24455337,24455957,24456523,24457011,24457641,24459164,24459855,24460428,24460962,24461337,24461925,24462419,24463077,24464059,24465041,24466121,24467031,24467760,24468736,24469531,24470502,24471329,24472134,24473080,24473976,24474649,24475416,24476218,24476942,24477609,24478399,24479071,24479845,24480362,24481141,24481721,24482476,24482998,24483647,24484168,24484820,24485474,24486542,24487413,24493821,24494112,24494258,24495310,24498609,24503357,24503434,24504561,24504923,24505575,24506099,24506265,24506957,24507601,24508339,24508660,24508788,24509433,24510144,24511598,24511817,24512608,24513698,24515146,24516552,24518214,24519400,24520368,24521203,24521237,24521291,24521329,24522327,24523104,24524661,24528135,24532423,24534312,24535249,24535872,24535982,24536276,24537012,24537741,24538637,24541308,24542152,24543014,24543970,24544800,24545613,24547906,24548712,24552512,24553451,24561302,24561583,24562819,24563083,24563682,24564731,24565548,24566299,24567069,24568114,2456924', 'assoc_port': '24453336:24453383,24453550:24453563,24453929:24453970,24454494:24454601,24455325:24455337,24455910:24455957,24456503:24456523,24456994:24457011,24457624:24457641,24459089:24459164,24459828:24459855,24460386:24460428,24460928:24460962,24461304:24461337,24461899:24461925,24462393:24462419,24463058:24463077,24463947:24464059,24465018:24465041,24466078:24466121,24467014:24467031,24467726:24467760,24468709:24468736,24469444:24469531,24470475:24470502,24471299:24471329,24472121:24472134,24473035:24473080,24473939:24473976,24474627:24474649,24475411:24475416,24476167:24476218,24476925:24476942,24477545:24477609,24478378:24478399,24479021:24479071,24479821:24479845,24480340:24480362,24481098:24481141,24481692:24481721,24482442:24482476,24482912:24482998,24483630:24483647,24484133:24484168,24484781:24484820,24485391:24485474,24486529:24486542,24487347:24487413,24493818:24493821,24494102:24494112,24494234:24494258,24495217:24495310,24498586:24498609,24503345:24503434,24503346:24503357,24504530:24504561,24504887:2450492', 'assoc_mat': '24453336:autre_refus:3726:24453383,24453550:autre_refus:3726:24453563,24453929:autre_refus:3726:24453970,24454494:autre_refus:3726:24454601,24455325:autre_refus:3726:24455337,24455910:autre_refus:3726:24455957,24456503:autre_refus:3726:24456523,24456994:autre_refus:3726:24457011,24457624:autre_refus:3726:24457641,24459089:autre_refus:3726:24459164,24459828:autre_refus:3726:24459855,24460386:autre_refus:3726:24460428,24460928:autre_refus:3726:24460962,24461304:autre_refus:3726:24461337,24461899:autre_refus:3726:24461925,24462393:autre_refus:3726:24462419,24463058:autre_refus:3726:24463077,24463947:autre_refus:3726:24464059,24465018:autre_refus:3726:24465041,24466078:autre_refus:3726:24466121,24467014:autre_refus:3726:24467031,24467726:autre_refus:3726:24467760,24468709:autre_refus:3726:24468736,24469444:autre_refus:3726:24469531,24470475:autre_refus:3726:24470502,24471299:autre_refus:3726:24471329,24472121:autre_refus:3726:24472134,24473035:autre_refus:3726:24473080,24473939:autre_refus:3726:24473976,24474627:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.00524032737807775, 'nb_photo': 22544, 'list_port_cont': '24453564,24453971,24454590,24455341,24455947,24456531,24457009,24457648,24458135,24458697,24459161,24459850,24460425,24460963,24461338,24461920,24462420,24463084,24464062,24465049,24466124,24467038,24467757,24468729,24469532,24470508,24471331,24472144,24474647,24475422,24476228,24476946,24477605,24478395,24479065,24479836,24480358,24481138,24481718,24482472,24482990,24484817,24485465,24486540,24487410,24493824,24494116,24494249,24495312,24498617,24503354,24503427,24503538,24504564,24504922,24505564,24506095,24506262,24506955,24507604,24508336,24508659,24508794,24509420,24511600,24511809,24512603,24513694,24515149,24516547,24518219,24519396,24520367,24521202,24521244,24521294,24521330,24522329,24523107,24524660,24528139,24532420,24534309,24535250,24535868,24535978,24536273,24537015,24537761,24538642,24541301,24542148,24543015,24543979,24547907,24552502,24553441,24561301,24561588,24562812,24563090,24563680,24564742,24565547,24566307,24567064,24568112,24569232,24570355,24571006,24571195,24575154,24575205,2458014', 'assoc_port': '24453550:24453564,24453929:24453971,24454494:24454590,24455325:24455341,24455910:24455947,24456503:24456531,24456994:24457009,24457624:24457648,24458102:24458135,24458664:24458697,24459089:24459161,24459828:24459850,24460386:24460425,24460928:24460963,24461304:24461338,24461899:24461920,24462393:24462420,24463058:24463084,24463947:24464062,24465018:24465049,24466078:24466124,24467014:24467038,24467726:24467757,24468709:24468729,24469444:24469532,24470475:24470508,24471299:24471331,24472121:24472144,24474627:24474647,24475411:24475422,24476167:24476228,24476925:24476946,24477545:24477605,24478378:24478395,24479021:24479065,24479821:24479836,24480340:24480358,24481098:24481138,24481692:24481718,24482442:24482472,24482912:24482990,24484781:24484817,24485391:24485465,24486529:24486540,24487347:24487410,24493818:24493824,24494102:24494116,24494234:24494249,24495217:24495312,24498586:24498617,24503345:24503427,24503346:24503354,24503493:24503538,24504530:24504564,24504887:24504922,24505558:24505564,24506011:2450609', 'assoc_mat': '24453550:cartonnette:3726:24453564,24453929:cartonnette:3726:24453971,24454494:cartonnette:3726:24454590,24455325:cartonnette:3726:24455341,24455910:cartonnette:3726:24455947,24456503:cartonnette:3726:24456531,24456994:cartonnette:3726:24457009,24457624:cartonnette:3726:24457648,24458102:cartonnette:3726:24458135,24458664:cartonnette:3726:24458697,24459089:cartonnette:3726:24459161,24459828:cartonnette:3726:24459850,24460386:cartonnette:3726:24460425,24460928:cartonnette:3726:24460963,24461304:cartonnette:3726:24461338,24461899:cartonnette:3726:24461920,24462393:cartonnette:3726:24462420,24463058:cartonnette:3726:24463084,24463947:cartonnette:3726:24464062,24465018:cartonnette:3726:24465049,24466078:cartonnette:3726:24466124,24467014:cartonnette:3726:24467038,24467726:cartonnette:3726:24467757,24468709:cartonnette:3726:24468729,24469444:cartonnette:3726:24469532,24470475:cartonnette:3726:24470508,24471299:cartonnette:3726:24471331,24472121:cartonnette:3726:24472144,24474627:cartonnette:3726:24474647,24475411:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.022315492048405397, 'nb_photo': 21665, 'list_port_cont': '24453375,24453559,24453963,24454593,24455336,24455955,24456526,24457010,24457644,24458134,24458690,24459162,24459846,24460420,24460965,24461347,24461921,24462421,24463072,24464077,24465048,24466122,24467029,24467751,24468739,24469529,24470506,24471324,24472141,24473078,24474643,24475420,24476227,24476950,24477613,24478394,24479073,24479840,24480365,24481146,24481711,24484812,24485473,24486539,24487411,24493825,24494117,24494256,24495311,24498613,24501136,24503366,24504565,24504924,24505567,24506096,24506259,24506965,24507595,24508337,24508661,24508795,24509434,24511596,24511816,24512599,24513697,24515141,24516543,24518218,24519398,24520362,24521196,24521236,24521293,24521326,24522321,24523106,24524658,24525695,24526532,24527393,24528133,24528333,24529730,24531037,24532414,24532668,24534310,24535251,24535873,24535977,24536269,24537013,24537763,24538635,24541299,24542151,24543008,24543973,24545618,24546379,24547192,24547903,24548709,24549411,24550189,24550911,24551732,24552503,24553443,24561589,24562811,2456369', 'assoc_port': '24453336:24453375,24453550:24453559,24453929:24453963,24454494:24454593,24455325:24455336,24455910:24455955,24456503:24456526,24456994:24457010,24457624:24457644,24458102:24458134,24458664:24458690,24459089:24459162,24459828:24459846,24460386:24460420,24460928:24460965,24461304:24461347,24461899:24461921,24462393:24462421,24463058:24463072,24463947:24464077,24465018:24465048,24466078:24466122,24467014:24467029,24467726:24467751,24468709:24468739,24469444:24469529,24470475:24470506,24471299:24471324,24472121:24472141,24473035:24473078,24474627:24474643,24475411:24475420,24476167:24476227,24476925:24476950,24477545:24477613,24478378:24478394,24479021:24479073,24479821:24479840,24480340:24480365,24481098:24481146,24481692:24481711,24484781:24484812,24485391:24485473,24486529:24486539,24487347:24487411,24493818:24493825,24494102:24494117,24494234:24494256,24495217:24495311,24498586:24498613,24501065:24501136,24503346:24503366,24504530:24504565,24504887:24504924,24505558:24505567,24506011:24506096,24506120:2450625', 'assoc_mat': '24453336:Carton_brun:3726:24453375,24453550:Carton_brun:3726:24453559,24453929:Carton_brun:3726:24453963,24454494:Carton_brun:3726:24454593,24455325:Carton_brun:3726:24455336,24455910:Carton_brun:3726:24455955,24456503:Carton_brun:3726:24456526,24456994:Carton_brun:3726:24457010,24457624:Carton_brun:3726:24457644,24458102:Carton_brun:3726:24458134,24458664:Carton_brun:3726:24458690,24459089:Carton_brun:3726:24459162,24459828:Carton_brun:3726:24459846,24460386:Carton_brun:3726:24460420,24460928:Carton_brun:3726:24460965,24461304:Carton_brun:3726:24461347,24461899:Carton_brun:3726:24461921,24462393:Carton_brun:3726:24462421,24463058:Carton_brun:3726:24463072,24463947:Carton_brun:3726:24464077,24465018:Carton_brun:3726:24465048,24466078:Carton_brun:3726:24466122,24467014:Carton_brun:3726:24467029,24467726:Carton_brun:3726:24467751,24468709:Carton_brun:3726:24468739,24469444:Carton_brun:3726:24469529,24470475:Carton_brun:3726:24470506,24471299:Carton_brun:3726:24471324,24472121:Carton_brun:3726:24472141,24473035:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01218969583935689, 'nb_photo': 24030, 'list_port_cont': '24453379,24453558,24453969,24454600,24455342,24455958,24456521,24457012,24457646,24458139,24458696,24459163,24460429,24460954,24461340,24461927,24462424,24463082,24464080,24465038,24466120,24467035,24467753,24468741,24469524,24470509,24471322,24472140,24474639,24475426,24476223,24476951,24477606,24478397,24479064,24479842,24480356,24481136,24481715,24482479,24482988,24484822,24485475,24486543,24487408,24493826,24494111,24494250,24494787,24495316,24495522,24496195,24496675,24497495,24497656,24498329,24498614,24498725,24499633,24500065,24500820,24501322,24501917,24502288,24503183,24503361,24503424,24503532,24504569,24504927,24505565,24506103,24506261,24506956,24507599,24508343,24508657,24508796,24509424,24510154,24511601,24511815,24512610,24513695,24515153,24516545,24518215,24519395,24520364,24521201,24521243,24521295,24521327,24522322,24523113,24524664,24526535,24527405,24528134,24532419,24534311,24535259,24535876,24535975,24536275,24537011,24537752,24538644,24541303,24542150,24543012,24543981,24545620,2454637', 'assoc_port': '24453336:24453379,24453550:24453558,24453929:24453969,24454494:24454600,24455325:24455342,24455910:24455958,24456503:24456521,24456994:24457012,24457624:24457646,24458102:24458139,24458664:24458696,24459089:24459163,24460386:24460429,24460928:24460954,24461304:24461340,24461899:24461927,24462393:24462424,24463058:24463082,24463947:24464080,24465018:24465038,24466078:24466120,24467014:24467035,24467726:24467753,24468709:24468741,24469444:24469524,24470475:24470509,24471299:24471322,24472121:24472140,24474627:24474639,24475411:24475426,24476167:24476223,24476925:24476951,24477545:24477606,24478378:24478397,24479021:24479064,24479821:24479842,24480340:24480356,24481098:24481136,24481692:24481715,24482442:24482479,24482912:24482988,24484781:24484822,24485391:24485475,24486529:24486543,24487347:24487408,24493818:24493826,24494102:24494111,24494234:24494250,24494774:24494787,24495217:24495316,24495450:24495522,24496182:24496195,24496579:24496675,24497467:24497495,24497619:24497656,24498295:24498329,24498586:2449861', 'assoc_mat': '24453336:Carton_gris:3726:24453379,24453550:Carton_gris:3726:24453558,24453929:Carton_gris:3726:24453969,24454494:Carton_gris:3726:24454600,24455325:Carton_gris:3726:24455342,24455910:Carton_gris:3726:24455958,24456503:Carton_gris:3726:24456521,24456994:Carton_gris:3726:24457012,24457624:Carton_gris:3726:24457646,24458102:Carton_gris:3726:24458139,24458664:Carton_gris:3726:24458696,24459089:Carton_gris:3726:24459163,24460386:Carton_gris:3726:24460429,24460928:Carton_gris:3726:24460954,24461304:Carton_gris:3726:24461340,24461899:Carton_gris:3726:24461927,24462393:Carton_gris:3726:24462424,24463058:Carton_gris:3726:24463082,24463947:Carton_gris:3726:24464080,24465018:Carton_gris:3726:24465038,24466078:Carton_gris:3726:24466120,24467014:Carton_gris:3726:24467035,24467726:Carton_gris:3726:24467753,24468709:Carton_gris:3726:24468741,24469444:Carton_gris:3726:24469524,24470475:Carton_gris:3726:24470509,24471299:Carton_gris:3726:24471322,24472121:Carton_gris:3726:24472140,24474627:Carton_gris:3726:24474639,24475411:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004044582656644895, 'nb_photo': 5340, 'list_port_cont': '24453562,24454597,24460427,24461345,24463073,24464075,24465040,24466131,24467758,24468738,24469527,24470503,24471319,24474644,24479837,24481716,24482481,24482997,24483644,24484165,24485469,24486538,24487419,24493829,24495321,24498610,24504916,24505574,24506256,24507598,24508351,24508787,24509422,24511599,24511811,24516548,24518222,24519390,24521325,24522332,24524665,24532416,24534305,24535258,24535870,24537014,24537748,24538638,24541305,24542147,24543017,24543977,24546381,24547898,24565546,24566304,24568113,24569230,24571001,24571201,24572298,24573171,24574355,24575153,24575209,24575362,24580147,24580411,24582060,24586412,24589763,24591462,24592258,24592887,24597995,24601097,24601560,24601713,24603246,24605354,24607296,24608569,24608810,24609628,24610147,24611262,24612720,24614727,24616107,24616871,24617482,24617917,24618493,24618942,24619987,24621543,24621975,24622465,24624886,24625612,24627006,24627179,24627208,24627240,24627279,24627333,24627357,24627534,24628998,24630888,24631252,24632515,24633931,2463439', 'assoc_port': '24453550:24453562,24454494:24454597,24460386:24460427,24461304:24461345,24463058:24463073,24463947:24464075,24465018:24465040,24466078:24466131,24467726:24467758,24468709:24468738,24469444:24469527,24470475:24470503,24471299:24471319,24474627:24474644,24479821:24479837,24481692:24481716,24482442:24482481,24482912:24482997,24483630:24483644,24484133:24484165,24485391:24485469,24486529:24486538,24487347:24487419,24493818:24493829,24495217:24495321,24498586:24498610,24504887:24504916,24505558:24505574,24506120:24506256,24507576:24507598,24508303:24508351,24508782:24508787,24509402:24509422,24511563:24511599,24511760:24511811,24516386:24516548,24518185:24518222,24519329:24519390,24521308:24521325,24522287:24522332,24524579:24524665,24532381:24532416,24534236:24534305,24535211:24535258,24535806:24535870,24536995:24537014,24537684:24537748,24538618:24538638,24541210:24541305,24542140:24542147,24542941:24543017,24543938:24543977,24546341:24546381,24547868:24547898,24565474:24565546,24566265:24566304,24568090:2456811', 'assoc_mat': '24453550:kraft:3726:24453562,24454494:kraft:3726:24454597,24460386:kraft:3726:24460427,24461304:kraft:3726:24461345,24463058:kraft:3726:24463073,24463947:kraft:3726:24464075,24465018:kraft:3726:24465040,24466078:kraft:3726:24466131,24467726:kraft:3726:24467758,24468709:kraft:3726:24468738,24469444:kraft:3726:24469527,24470475:kraft:3726:24470503,24471299:kraft:3726:24471319,24474627:kraft:3726:24474644,24479821:kraft:3726:24479837,24481692:kraft:3726:24481716,24482442:kraft:3726:24482481,24482912:kraft:3726:24482997,24483630:kraft:3726:24483644,24484133:kraft:3726:24484165,24485391:kraft:3726:24485469,24486529:kraft:3726:24486538,24487347:kraft:3726:24487419,24493818:kraft:3726:24493829,24495217:kraft:3726:24495321,24498586:kraft:3726:24498610,24504887:kraft:3726:24504916,24505558:kraft:3726:24505574,24506120:kraft:3726:24506256,24507576:kraft:3726:24507598,24508303:kraft:3726:24508351,24508782:kraft:3726:24508787,24509402:kraft:3726:24509422,24511563:kraft:3726:24511599,24511760:kraft:3726:24511811,24516386:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.001272257150840642, 'nb_photo': 694, 'list_port_cont': '24453560,24457638,24461346,24466127,24470505,24473973,24474646,24477610,24478404,24479068,24479844,24481717,24486545,24487417,24494109,24495322,24504921,24506257,24508341,24508664,24509436,24512605,24516546,24519399,24521285,24522323,24532413,24534307,24535253,24535972,24537765,24538645,24541297,24547896,24553446,24561587,24562815,24565550,24567060,24568118,24580417,24586413,24592274,24592881,24601557,24604314,24607305,24608095,24608814,24610151,24611900,24612727,24614188,24614726,24617926,24618484,24619480,24620924,24621544,24623949,24626571,24626999,24627181,24627285,24627524,24628124,24628573,24633458,24633932,24635574,24662164,24663038,24663541,24663985,24664423,24671801,24672403,24672850,24673393,24673878,24674815,24675914,24681829,24684041,24686626,24690995,24696921,24699991,24700905,24701877,24702773,24703733,24705457,24707066,24707485,24707925,24708487,24708872,24709328,24709771,24712089,24712506,24712940,24713377,24714253,24714715,24716678,24718480,24721849,24724249,24725568,24755863,24756538,2475897', 'assoc_port': '24453550:24453560,24457624:24457638,24461304:24461346,24466078:24466127,24470475:24470505,24473939:24473973,24474627:24474646,24477545:24477610,24478378:24478404,24479021:24479068,24479821:24479844,24481692:24481717,24486529:24486545,24487347:24487417,24494102:24494109,24495217:24495322,24504887:24504921,24506120:24506257,24508303:24508341,24508622:24508664,24509402:24509436,24512566:24512605,24516386:24516546,24519329:24519399,24521036:24521285,24522287:24522323,24532381:24532413,24534236:24534307,24535211:24535253,24535808:24535972,24537684:24537765,24538618:24538645,24541210:24541297,24547868:24547896,24553425:24553446,24561557:24561587,24562734:24562815,24565474:24565550,24567059:24567060,24568090:24568118,24580345:24580417,24586317:24586413,24592235:24592274,24592838:24592881,24601516:24601557,24604251:24604314,24607246:24607305,24608042:24608095,24608727:24608814,24610124:24610151,24611872:24611900,24612688:24612727,24614163:24614188,24614696:24614726,24617888:24617926,24618457:24618484,24619450:2461948', 'assoc_mat': '24453550:metal:3726:24453560,24457624:metal:3726:24457638,24461304:metal:3726:24461346,24466078:metal:3726:24466127,24470475:metal:3726:24470505,24473939:metal:3726:24473973,24474627:metal:3726:24474646,24477545:metal:3726:24477610,24478378:metal:3726:24478404,24479021:metal:3726:24479068,24479821:metal:3726:24479844,24481692:metal:3726:24481717,24486529:metal:3726:24486545,24487347:metal:3726:24487417,24494102:metal:3726:24494109,24495217:metal:3726:24495322,24504887:metal:3726:24504921,24506120:metal:3726:24506257,24508303:metal:3726:24508341,24508622:metal:3726:24508664,24509402:metal:3726:24509436,24512566:metal:3726:24512605,24516386:metal:3726:24516546,24519329:metal:3726:24519399,24521036:metal:3726:24521285,24522287:metal:3726:24522323,24532381:metal:3726:24532413,24534236:metal:3726:24534307,24535211:metal:3726:24535253,24535808:metal:3726:24535972,24537684:metal:3726:24537765,24538618:metal:3726:24538645,24541210:metal:3726:24541297,24547868:metal:3726:24547896,24553425:metal:3726:24553446,24561557:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007958586799052456, 'nb_photo': 13413, 'list_port_cont': '24453386,24453556,24453966,24454595,24455338,24455948,24456524,24457013,24457643,24459165,24459852,24460424,24460957,24461344,24461916,24462422,24463083,24464079,24465044,24466128,24467759,24468731,24469523,24470511,24471328,24472131,24473075,24473975,24474650,24475419,24476220,24476943,24477603,24478403,24479066,24479839,24480364,24481143,24481720,24484816,24485470,24486541,24487414,24493819,24494119,24495315,24498616,24503356,24504568,24504918,24505572,24506263,24506963,24507602,24508344,24508655,24508797,24509428,24511606,24511806,24512609,24513700,24515142,24516549,24518216,24519391,24520375,24521206,24521241,24521288,24521321,24522328,24523115,24524659,24528137,24532418,24534306,24535257,24535877,24535983,24536268,24537022,24537745,24538636,24541306,24542153,24543018,24543974,24544791,24545623,24547193,24547905,24548710,24552506,24553450,24561305,24561590,24562814,24563088,24564737,24565554,24566303,24567061,24568110,24569238,24570356,24571003,24571202,24572295,24575149,24575212,24580146,24580412,2458165', 'assoc_port': '24453336:24453386,24453550:24453556,24453929:24453966,24454494:24454595,24455325:24455338,24455910:24455948,24456503:24456524,24456994:24457013,24457624:24457643,24459089:24459165,24459828:24459852,24460386:24460424,24460928:24460957,24461304:24461344,24461899:24461916,24462393:24462422,24463058:24463083,24463947:24464079,24465018:24465044,24466078:24466128,24467726:24467759,24468709:24468731,24469444:24469523,24470475:24470511,24471299:24471328,24472121:24472131,24473035:24473075,24473939:24473975,24474627:24474650,24475411:24475419,24476167:24476220,24476925:24476943,24477545:24477603,24478378:24478403,24479021:24479066,24479821:24479839,24480340:24480364,24481098:24481143,24481692:24481720,24484781:24484816,24485391:24485470,24486529:24486541,24487347:24487414,24493818:24493819,24494102:24494119,24495217:24495315,24498586:24498616,24503346:24503356,24504530:24504568,24504887:24504918,24505558:24505572,24506120:24506263,24506947:24506963,24507576:24507602,24508303:24508344,24508622:24508655,24508782:2450879', 'assoc_mat': '24453336:plastique:3726:24453386,24453550:plastique:3726:24453556,24453929:plastique:3726:24453966,24454494:plastique:3726:24454595,24455325:plastique:3726:24455338,24455910:plastique:3726:24455948,24456503:plastique:3726:24456524,24456994:plastique:3726:24457013,24457624:plastique:3726:24457643,24459089:plastique:3726:24459165,24459828:plastique:3726:24459852,24460386:plastique:3726:24460424,24460928:plastique:3726:24460957,24461304:plastique:3726:24461344,24461899:plastique:3726:24461916,24462393:plastique:3726:24462422,24463058:plastique:3726:24463083,24463947:plastique:3726:24464079,24465018:plastique:3726:24465044,24466078:plastique:3726:24466128,24467726:plastique:3726:24467759,24468709:plastique:3726:24468731,24469444:plastique:3726:24469523,24470475:plastique:3726:24470511,24471299:plastique:3726:24471328,24472121:plastique:3726:24472131,24473035:plastique:3726:24473075,24473939:plastique:3726:24473975,24474627:plastique:3726:24474650,24475411:plastique:3726:24475419,24476167:plastique:3726:24476220,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.013705388343444412, 'nb_photo': 57835, 'list_port_cont': '24453378,24453554,24453964,24454591,24455340,24455952,24456525,24457018,24457645,24460423,24460964,24461348,24461923,24462428,24463076,24464061,24465039,24466130,24467033,24467750,24468740,24469528,24470500,24471323,24472143,24473079,24473977,24474642,24475421,24476229,24476949,24477604,24478396,24479070,24479841,24480360,24481147,24481712,24483651,24484819,24485466,24486535,24487409,24493820,24494114,24494257,24495313,24496190,24496669,24497502,24497659,24498618,24501321,24503364,24503537,24504566,24504925,24505568,24506264,24506960,24507594,24508340,24508658,24508789,24509432,24510146,24511607,24511813,24512601,24513704,24515140,24516551,24518225,24519394,24520374,24521197,24521245,24521287,24521322,24522330,24523103,24523958,24524654,24528132,24532424,24533610,24534314,24535248,24535874,24535980,24536277,24537017,24537750,24538634,24541307,24542143,24543010,24543975,24544792,24545617,24546378,24547195,24547901,24548708,24549423,24550184,24550908,24551731,24552507,24553442,24561579,24562813,24563087,2456367', 'assoc_port': '24453336:24453378,24453550:24453554,24453929:24453964,24454494:24454591,24455325:24455340,24455910:24455952,24456503:24456525,24456994:24457018,24457624:24457645,24460386:24460423,24460928:24460964,24461304:24461348,24461899:24461923,24462393:24462428,24463058:24463076,24463947:24464061,24465018:24465039,24466078:24466130,24467014:24467033,24467726:24467750,24468709:24468740,24469444:24469528,24470475:24470500,24471299:24471323,24472121:24472143,24473035:24473079,24473939:24473977,24474627:24474642,24475411:24475421,24476167:24476229,24476925:24476949,24477545:24477604,24478378:24478396,24479021:24479070,24479821:24479841,24480340:24480360,24481098:24481147,24481692:24481712,24483630:24483651,24484781:24484819,24485391:24485466,24486529:24486535,24487347:24487409,24493818:24493820,24494102:24494114,24494234:24494257,24495217:24495313,24496182:24496190,24496579:24496669,24497467:24497502,24497619:24497659,24498586:24498618,24501313:24501321,24503346:24503364,24503493:24503537,24504530:24504566,24504887:2450492', 'assoc_mat': '24453336:Teint_Dans_La_Masse:3726:24453378,24453550:Teint_Dans_La_Masse:3726:24453554,24453929:Teint_Dans_La_Masse:3726:24453964,24454494:Teint_Dans_La_Masse:3726:24454591,24455325:Teint_Dans_La_Masse:3726:24455340,24455910:Teint_Dans_La_Masse:3726:24455952,24456503:Teint_Dans_La_Masse:3726:24456525,24456994:Teint_Dans_La_Masse:3726:24457018,24457624:Teint_Dans_La_Masse:3726:24457645,24460386:Teint_Dans_La_Masse:3726:24460423,24460928:Teint_Dans_La_Masse:3726:24460964,24461304:Teint_Dans_La_Masse:3726:24461348,24461899:Teint_Dans_La_Masse:3726:24461923,24462393:Teint_Dans_La_Masse:3726:24462428,24463058:Teint_Dans_La_Masse:3726:24463076,24463947:Teint_Dans_La_Masse:3726:24464061,24465018:Teint_Dans_La_Masse:3726:24465039,24466078:Teint_Dans_La_Masse:3726:24466130,24467014:Teint_Dans_La_Masse:3726:24467033,24467726:Teint_Dans_La_Masse:3726:24467750,24468709:Teint_Dans_La_Masse:3726:24468740,24469444:Teint_Dans_La_Masse:3726:24469528,24470475:Teint_Dans_La_Masse:3726:24470500,24471299:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 163169}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-07', 0.040671754144055244),)]} filepath : /data_4/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_07_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '0.61%', 16855], 'cartonnette': ['cartonnette', '0.52%', 22544], 'Carton_brun': ['Carton_brun', '2.23%', 21665], 'Carton_gris': ['Carton_gris', '1.22%', 24030], 'kraft': ['kraft', '0.4%', 5340], 'metal': ['metal', '0.13%', 694], 'plastique': ['plastique', '0.8%', 13413], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '1.37%', 57835]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_4/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_07_annee_2025.pdf le fichier se trouve ici : /data_4/data_log/job/memo/arc_en_ciel_jrm 2.52user 2.64system 0:17.97elapsed 28%CPU (0avgtext+0avgdata 176344maxresident)k 23136inputs+336outputs (80major+44907minor)pagefaults 0swaps