python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=30073 --dashboard_places=arc_en_ciel_jrm --rootfolder_sla=/data_2/data_log/job/memo/arc_en_ciel_jrm -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 30073, Date : 2025-05 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (3, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (3, 31) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 10 month : 05 mtr_id : 979 dashboard_places : arc_en_ciel_jrm date : 2025-05 year : 2025 raspi : 30073 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm' and date like '%2025-05%') and created_at like '%2025-05%'))); nb_day : (3, 31) after unwanted_material_data nb_day : (3, 31) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%30073%' AND ms.result_str like '%2025/05%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84257 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8464, 'nb_gray_level_ok': 8464, 'nb_dedup_ok': 3801, 'nb_two_criteria_ok': 3801, 'nb_forced_upload': 80, 'end_of_day_photos_duplicated': 4659, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3876, 'ratio_coverage': 0.9752080463894258}, 'dashboard_dict': {'nb_ptf_finished': 65, 'nb_images_finished': 3734, 'nb_ptf_finished_for_older': 1, 'nb_images_finished_for_older': 9, 'nb_ptf_started': 2, 'nb_images_started': 138, 'nb_selected_images': 3881, 'last_update': '2025/05/16', 'portfolio_id': 22986733, 'last_run_id': 1819812, 'total_number_of_photos': 3900}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84432 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3296, 'nb_two_criteria_ok': 3296, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 5167, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3376, 'ratio_coverage': 0.9772335327955185}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 3118, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 197, 'nb_selected_images': 3315, 'last_update': '2025/05/15', 'portfolio_id': 22940775, 'last_run_id': 1814888, 'total_number_of_photos': 3396}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84213 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8432, 'nb_gray_level_ok': 8432, 'nb_dedup_ok': 3203, 'nb_two_criteria_ok': 3203, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5229, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 3294, 'ratio_coverage': 0.9746987812358939}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3193, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 43, 'nb_selected_images': 3236, 'last_update': '2025/05/15', 'portfolio_id': 22899558, 'last_run_id': 1812096, 'total_number_of_photos': 3315}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66747 seconds', 'coverage_times_pause': '0 days 67737 seconds', 'nb_photos_decision': 6681, 'nb_gray_level_ok': 6681, 'nb_dedup_ok': 3483, 'nb_two_criteria_ok': 3483, 'nb_forced_upload': 74, 'end_of_day_photos_duplicated': 3198, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3551, 'ratio_coverage': 0.9758476001111127}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 3056, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 498, 'nb_selected_images': 3554, 'last_update': '2025/05/15', 'portfolio_id': 22870033, 'last_run_id': 1808299, 'total_number_of_photos': 3576}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21178 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2129, 'nb_gray_level_ok': 2129, 'nb_dedup_ok': 724, 'nb_two_criteria_ok': 724, 'nb_forced_upload': 19, 'end_of_day_photos_duplicated': 1405, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 737, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 727, 'last_update': '2025/05/11', 'portfolio_id': 22848512, 'last_run_id': 1803854, 'total_number_of_photos': 738}} No error ? {'log_dict': {'total_nb_images': 8539, 'max_time_between_images': '0 days 82 seconds', 'coverage_pause': '0 days 84257 seconds', 'coverage_times_pause': '0 days 85628 seconds', 'nb_photos_decision': 8464, 'nb_gray_level_ok': 8464, 'nb_dedup_ok': 3801, 'nb_two_criteria_ok': 3801, 'nb_forced_upload': 80, 'end_of_day_photos_duplicated': 4659, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3876, 'ratio_coverage': 0.9752080463894258}, 'dashboard_dict': {'nb_ptf_finished': 65, 'nb_images_finished': 3734, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 147, 'nb_selected_images': 3881, 'last_update': '2025/05/16', 'portfolio_id': 22986733, 'last_run_id': 1819812, 'total_number_of_photos': 3900}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84432 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3296, 'nb_two_criteria_ok': 3296, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 5167, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3376, 'ratio_coverage': 0.9772335327955185}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 3118, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 197, 'nb_selected_images': 3315, 'last_update': '2025/05/15', 'portfolio_id': 22940775, 'last_run_id': 1814888, 'total_number_of_photos': 3396}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84213 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8432, 'nb_gray_level_ok': 8432, 'nb_dedup_ok': 3203, 'nb_two_criteria_ok': 3203, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5229, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 3294, 'ratio_coverage': 0.9746987812358939}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3193, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 43, 'nb_selected_images': 3236, 'last_update': '2025/05/15', 'portfolio_id': 22899558, 'last_run_id': 1812096, 'total_number_of_photos': 3315}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84286 seconds', 'coverage_times_pause': '0 days 85619 seconds', 'nb_photos_decision': 8457, 'nb_gray_level_ok': 8457, 'nb_dedup_ok': 3601, 'nb_two_criteria_ok': 3601, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 4856, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3678, 'ratio_coverage': 0.9755436984224355}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 3653, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3653, 'last_update': '2025/05/10', 'portfolio_id': 22807051, 'last_run_id': 1802472, 'total_number_of_photos': 3687}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84432 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3296, 'nb_two_criteria_ok': 3296, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 5167, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3376, 'ratio_coverage': 0.9772335327955185}, 'dashboard_dict': {'nb_ptf_finished': 54, 'nb_images_finished': 3118, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 197, 'nb_selected_images': 3315, 'last_update': '2025/05/15', 'portfolio_id': 22940775, 'last_run_id': 1814888, 'total_number_of_photos': 3396}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84213 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8432, 'nb_gray_level_ok': 8432, 'nb_dedup_ok': 3203, 'nb_two_criteria_ok': 3203, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5229, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 3294, 'ratio_coverage': 0.9746987812358939}, 'dashboard_dict': {'nb_ptf_finished': 56, 'nb_images_finished': 3193, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 43, 'nb_selected_images': 3236, 'last_update': '2025/05/14', 'portfolio_id': 22899558, 'last_run_id': 1812096, 'total_number_of_photos': 3315}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66747 seconds', 'coverage_times_pause': '0 days 67737 seconds', 'nb_photos_decision': 6681, 'nb_gray_level_ok': 6681, 'nb_dedup_ok': 3483, 'nb_two_criteria_ok': 3483, 'nb_forced_upload': 74, 'end_of_day_photos_duplicated': 3198, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3551, 'ratio_coverage': 0.9758476001111127}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 3056, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 498, 'nb_selected_images': 3554, 'last_update': '2025/05/13', 'portfolio_id': 22870033, 'last_run_id': 1808299, 'total_number_of_photos': 3576}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21178 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2129, 'nb_gray_level_ok': 2129, 'nb_dedup_ok': 724, 'nb_two_criteria_ok': 724, 'nb_forced_upload': 19, 'end_of_day_photos_duplicated': 1405, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 737, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 727, 'last_update': '2025/05/11', 'portfolio_id': 22848512, 'last_run_id': 1803854, 'total_number_of_photos': 738}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797600, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84213 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8432, 'nb_gray_level_ok': 8432, 'nb_dedup_ok': 3203, 'nb_two_criteria_ok': 3203, 'nb_forced_upload': 94, 'end_of_day_photos_duplicated': 5229, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 3294, 'ratio_coverage': 0.9746987812358939}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 256, 'nb_selected_images': 3236, 'last_update': '2025/05/14', 'portfolio_id': 22899558, 'last_run_id': 1811684, 'total_number_of_photos': 3315}} No error ? {'log_dict': {'total_nb_images': 6755, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66747 seconds', 'coverage_times_pause': '0 days 67737 seconds', 'nb_photos_decision': 6681, 'nb_gray_level_ok': 6681, 'nb_dedup_ok': 3483, 'nb_two_criteria_ok': 3483, 'nb_forced_upload': 74, 'end_of_day_photos_duplicated': 3198, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3551, 'ratio_coverage': 0.9758476001111127}, 'dashboard_dict': {'nb_ptf_finished': 48, 'nb_images_finished': 3056, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 8, 'nb_images_started': 498, 'nb_selected_images': 3554, 'last_update': '2025/05/13', 'portfolio_id': 22870033, 'last_run_id': 1808299, 'total_number_of_photos': 3576}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21178 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2129, 'nb_gray_level_ok': 2129, 'nb_dedup_ok': 724, 'nb_two_criteria_ok': 724, 'nb_forced_upload': 19, 'end_of_day_photos_duplicated': 1405, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 737, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 727, 'last_update': '2025/05/11', 'portfolio_id': 22848512, 'last_run_id': 1803854, 'total_number_of_photos': 738}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84286 seconds', 'coverage_times_pause': '0 days 85619 seconds', 'nb_photos_decision': 8457, 'nb_gray_level_ok': 8457, 'nb_dedup_ok': 3601, 'nb_two_criteria_ok': 3601, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 4856, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3678, 'ratio_coverage': 0.9755436984224355}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 3653, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3653, 'last_update': '2025/05/10', 'portfolio_id': 22807051, 'last_run_id': 1802472, 'total_number_of_photos': 3687}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797600, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83961 seconds', 'coverage_times_pause': '0 days 85264 seconds', 'nb_photos_decision': 8412, 'nb_gray_level_ok': 8412, 'nb_dedup_ok': 4281, 'nb_two_criteria_ok': 4281, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4131, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4370, 'ratio_coverage': 0.9717820808111205}, 'dashboard_dict': {'nb_ptf_finished': 72, 'nb_images_finished': 4348, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4348, 'last_update': '2025/05/08', 'portfolio_id': 22739986, 'last_run_id': 1793793, 'total_number_of_photos': 4391}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2143, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 21178 seconds', 'coverage_times_pause': '0 days 21488 seconds', 'nb_photos_decision': 2129, 'nb_gray_level_ok': 2129, 'nb_dedup_ok': 724, 'nb_two_criteria_ok': 724, 'nb_forced_upload': 19, 'end_of_day_photos_duplicated': 1405, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 737, 'ratio_coverage': 1.0}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 727, 'last_update': '2025/05/11', 'portfolio_id': 22848512, 'last_run_id': 1803854, 'total_number_of_photos': 738}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797600, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83961 seconds', 'coverage_times_pause': '0 days 85264 seconds', 'nb_photos_decision': 8412, 'nb_gray_level_ok': 8412, 'nb_dedup_ok': 4281, 'nb_two_criteria_ok': 4281, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4131, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4370, 'ratio_coverage': 0.9717820808111205}, 'dashboard_dict': {'nb_ptf_finished': 72, 'nb_images_finished': 4348, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4348, 'last_update': '2025/05/08', 'portfolio_id': 22739986, 'last_run_id': 1793793, 'total_number_of_photos': 4391}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 46, 'nb_images_finished': 2931, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 792, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789412, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84286 seconds', 'coverage_times_pause': '0 days 85619 seconds', 'nb_photos_decision': 8457, 'nb_gray_level_ok': 8457, 'nb_dedup_ok': 3601, 'nb_two_criteria_ok': 3601, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 4856, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3678, 'ratio_coverage': 0.9755436984224355}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 3653, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3653, 'last_update': '2025/05/10', 'portfolio_id': 22807051, 'last_run_id': 1802472, 'total_number_of_photos': 3687}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797600, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83961 seconds', 'coverage_times_pause': '0 days 85264 seconds', 'nb_photos_decision': 8412, 'nb_gray_level_ok': 8412, 'nb_dedup_ok': 4281, 'nb_two_criteria_ok': 4281, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4131, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4370, 'ratio_coverage': 0.9717820808111205}, 'dashboard_dict': {'nb_ptf_finished': 72, 'nb_images_finished': 4348, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4348, 'last_update': '2025/05/08', 'portfolio_id': 22739986, 'last_run_id': 1793793, 'total_number_of_photos': 4391}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 46, 'nb_images_finished': 2931, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 792, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789412, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785438, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8538, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84286 seconds', 'coverage_times_pause': '0 days 85619 seconds', 'nb_photos_decision': 8457, 'nb_gray_level_ok': 8457, 'nb_dedup_ok': 3601, 'nb_two_criteria_ok': 3601, 'nb_forced_upload': 81, 'end_of_day_photos_duplicated': 4856, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 3678, 'ratio_coverage': 0.9755436984224355}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 3653, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3653, 'last_update': '2025/05/10', 'portfolio_id': 22807051, 'last_run_id': 1801907, 'total_number_of_photos': 3687}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797600, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 46, 'nb_images_finished': 2931, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 792, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789412, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785438, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8533, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84224 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 60, 'nb_two_criteria_ok': 60, 'nb_forced_upload': 75, 'end_of_day_photos_duplicated': 8399, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 133, 'ratio_coverage': 0.9748260975242768}, 'dashboard_dict': {'nb_ptf_finished': 1, 'nb_images_finished': 19, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 19, 'last_update': '2025/05/09', 'portfolio_id': 22792365, 'last_run_id': 1797473, 'total_number_of_photos': 134}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83961 seconds', 'coverage_times_pause': '0 days 85264 seconds', 'nb_photos_decision': 8412, 'nb_gray_level_ok': 8412, 'nb_dedup_ok': 4281, 'nb_two_criteria_ok': 4281, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4131, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4370, 'ratio_coverage': 0.9717820808111205}, 'dashboard_dict': {'nb_ptf_finished': 72, 'nb_images_finished': 4348, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4348, 'last_update': '2025/05/08', 'portfolio_id': 22739986, 'last_run_id': 1793793, 'total_number_of_photos': 4391}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 46, 'nb_images_finished': 2931, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 792, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789412, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785438, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778113, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83961 seconds', 'coverage_times_pause': '0 days 85264 seconds', 'nb_photos_decision': 8412, 'nb_gray_level_ok': 8412, 'nb_dedup_ok': 4281, 'nb_two_criteria_ok': 4281, 'nb_forced_upload': 90, 'end_of_day_photos_duplicated': 4131, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 4370, 'ratio_coverage': 0.9717820808111205}, 'dashboard_dict': {'nb_ptf_finished': 72, 'nb_images_finished': 4348, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 4348, 'last_update': '2025/05/08', 'portfolio_id': 22739986, 'last_run_id': 1793521, 'total_number_of_photos': 4391}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 46, 'nb_images_finished': 2931, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 11, 'nb_images_started': 792, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789412, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785438, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778113, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84562 seconds', 'coverage_times_pause': '0 days 85747 seconds', 'nb_photos_decision': 8463, 'nb_gray_level_ok': 8463, 'nb_dedup_ok': 3615, 'nb_two_criteria_ok': 3615, 'nb_forced_upload': 93, 'end_of_day_photos_duplicated': 4843, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 5, 'end_of_day_photos_uploaded': 3702, 'ratio_coverage': 0.9787381798400444}, 'dashboard_dict': {'nb_ptf_finished': 45, 'nb_images_finished': 2860, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 863, 'nb_selected_images': 3723, 'last_update': '2025/05/07', 'portfolio_id': 22700488, 'last_run_id': 1789049, 'total_number_of_photos': 3780}} No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785438, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778113, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 6767, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 66857 seconds', 'coverage_times_pause': '0 days 67859 seconds', 'nb_photos_decision': 6696, 'nb_gray_level_ok': 6696, 'nb_dedup_ok': 3126, 'nb_two_criteria_ok': 3126, 'nb_forced_upload': 71, 'end_of_day_photos_duplicated': 3570, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 3196, 'ratio_coverage': 0.9774558107574672}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 3142, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 3142, 'last_update': '2025/05/06', 'portfolio_id': 22656475, 'last_run_id': 1785341, 'total_number_of_photos': 3197}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778113, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780373, 'total_number_of_photos': 743}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778113, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 1777, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 17555 seconds', 'coverage_times_pause': '0 days 17820 seconds', 'nb_photos_decision': 1763, 'nb_gray_level_ok': 1763, 'nb_dedup_ok': 725, 'nb_two_criteria_ok': 725, 'nb_forced_upload': 14, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 738, 'ratio_coverage': 0.975331962886827}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 736, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 736, 'last_update': '2025/05/04', 'portfolio_id': 22628244, 'last_run_id': 1780231, 'total_number_of_photos': 742}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 84196 seconds', 'coverage_times_pause': '0 days 85498 seconds', 'nb_photos_decision': 8453, 'nb_gray_level_ok': 8453, 'nb_dedup_ok': 2926, 'nb_two_criteria_ok': 2926, 'nb_forced_upload': 73, 'end_of_day_photos_duplicated': 5527, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 2994, 'ratio_coverage': 0.9745020196993021}, 'dashboard_dict': {'nb_ptf_finished': 61, 'nb_images_finished': 2980, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2980, 'last_update': '2025/05/03', 'portfolio_id': 22588288, 'last_run_id': 1778012, 'total_number_of_photos': 3005}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773660, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 84490 seconds', 'coverage_times_pause': '0 days 85740 seconds', 'nb_photos_decision': 8461, 'nb_gray_level_ok': 8461, 'nb_dedup_ok': 791, 'nb_two_criteria_ok': 791, 'nb_forced_upload': 89, 'end_of_day_photos_duplicated': 7670, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_uploaded': 879, 'ratio_coverage': 0.9779048368615377}, 'dashboard_dict': {'nb_ptf_finished': 15, 'nb_images_finished': 804, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 804, 'last_update': '2025/05/02', 'portfolio_id': 22572464, 'last_run_id': 1773499, 'total_number_of_photos': 880}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-05-15 00:00:00 Found day : 2025-05-14 00:00:00 Found day : 2025-05-13 00:00:00 Found day : 2025-05-12 00:00:00 Found day : 2025-05-10 00:00:00 Found day : 2025-05-09 00:00:00 Found day : 2025-05-08 00:00:00 Found day : 2025-05-07 00:00:00 Found day : 2025-05-06 00:00:00 Found day : 2025-05-05 00:00:00 Found day : 2025-05-03 00:00:00 Found day : 2025-05-02 00:00:00 Found day : 2025-05-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-05-16 00:00:00,2025-05-17 00:00:00,2025-05-19 00:00:00,2025-05-20 00:00:00,2025-05-21 00:00:00,2025-05-22 00:00:00,2025-05-23 00:00:00,2025-05-24 00:00:00,2025-05-26 00:00:00,2025-05-27 00:00:00,2025-05-28 00:00:00,2025-05-29 00:00:00,2025-05-30 00:00:00,2025-05-31 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 10 and month(ded.date) = 05 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 10 and month(ded.date) = 05 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 10 and mp.name like '%052025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-05-01 : dt_date_just_month_year : 2025-05-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-05-01" AND ded.date <= "2025-05-31" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 4302, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1773660,1778113,1780373,1785438,1789412,1793793,1797600,1802472,1803854,1808299,1812096,1814888,1823609,1823385,1824317) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004159077379151244, 'nb_photo': 4373, 'list_port_cont': '22572531,22573123,22573357,22573784,22574442,22574828,22575328,22575765,22576307,22576612,22577102,22577652,22578172,22578592,22579106,22589206,22589350,22589756,22590364,22590745,22590874,22591366,22591664,22592229,22592673,22593237,22593642,22594250,22594941,22595308,22596869,22597378,22597864,22598413,22598744,22599231,22599855,22600276,22600829,22601407,22601896,22604802,22605141,22605714,22606063,22606911,22607994,22608555,22609418,22609805,22610463,22611029,22611700,22613024,22613780,22614376,22615190,22615963,22616563,22617302,22618021,22618592,22619087,22619812,22620539,22620877,22621333,22622041,22622509,22623241,22624057,22624881,22625745,22626327,22627174,22627843,22628428,22628934,22629382,22629928,22630629,22630894,22631545,22631979,22632907,22633456,22634232,22634763,22635245,22635599,22636132,22656523,22656769,22657139,22657386,22658144,22658630,22658921,22659340,22659921,22660404,22660890,22661474,22662015,22662607,22662983,22663759,22665506,22666118,22666605,22667073,22667560,22668068,2266887', 'assoc_port': '22572496:22572531,22573115:22573123,22573326:22573357,22573742:22573784,22574433:22574442,22574815:22574828,22575317:22575328,22575738:22575765,22576269:22576307,22576604:22576612,22577091:22577102,22577585:22577652,22578157:22578172,22578558:22578592,22579061:22579106,22589204:22589206,22589345:22589350,22589743:22589756,22590338:22590364,22590734:22590745,22590863:22590874,22591348:22591366,22591636:22591664,22592221:22592229,22592634:22592673,22593197:22593237,22593637:22593642,22594215:22594250,22594939:22594941,22595293:22595308,22596857:22596869,22597376:22597378,22597852:22597864,22598402:22598413,22598714:22598744,22599216:22599231,22599783:22599855,22600238:22600276,22600776:22600829,22601365:22601407,22601825:22601896,22604792:22604802,22605092:22605141,22605713:22605714,22606058:22606063,22606881:22606911,22607985:22607994,22608501:22608555,22609408:22609418,22609715:22609805,22610437:22610463,22610994:22611029,22611606:22611700,22613023:22613024,22613686:22613780,22614349:22614376,22615158:2261519', 'assoc_mat': '22572496:autre_refus:3726:22572531,22573115:autre_refus:3726:22573123,22573326:autre_refus:3726:22573357,22573742:autre_refus:3726:22573784,22574433:autre_refus:3726:22574442,22574815:autre_refus:3726:22574828,22575317:autre_refus:3726:22575328,22575738:autre_refus:3726:22575765,22576269:autre_refus:3726:22576307,22576604:autre_refus:3726:22576612,22577091:autre_refus:3726:22577102,22577585:autre_refus:3726:22577652,22578157:autre_refus:3726:22578172,22578558:autre_refus:3726:22578592,22579061:autre_refus:3726:22579106,22589204:autre_refus:3726:22589206,22589345:autre_refus:3726:22589350,22589743:autre_refus:3726:22589756,22590338:autre_refus:3726:22590364,22590734:autre_refus:3726:22590745,22590863:autre_refus:3726:22590874,22591348:autre_refus:3726:22591366,22591636:autre_refus:3726:22591664,22592221:autre_refus:3726:22592229,22592634:autre_refus:3726:22592673,22593197:autre_refus:3726:22593237,22593637:autre_refus:3726:22593642,22594215:autre_refus:3726:22594250,22594939:autre_refus:3726:22594941,22595293:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0054072875288875884, 'nb_photo': 7088, 'list_port_cont': '22572532,22573126,22573359,22573779,22574436,22574830,22575326,22575772,22576300,22576611,22577100,22577650,22578167,22578593,22579108,22589355,22589747,22590365,22590741,22590864,22591360,22591667,22592236,22592678,22593234,22593651,22594256,22594948,22595302,22596863,22597377,22597863,22598412,22598748,22599227,22599845,22600279,22600825,22601396,22601892,22604804,22605145,22605720,22606068,22606910,22607990,22608547,22609410,22609810,22610466,22611034,22611702,22613031,22613774,22614378,22615191,22615957,22616560,22617306,22618031,22618589,22619091,22619815,22620542,22620886,22621332,22622047,22622512,22623242,22624058,22624878,22625743,22626323,22627175,22627849,22628427,22628941,22629381,22629930,22630632,22630897,22631555,22631973,22632910,22633447,22634235,22634754,22635242,22635608,22636133,22656513,22656773,22657138,22657379,22658141,22658628,22658918,22659336,22659925,22660409,22660893,22661473,22662023,22662606,22662988,22663768,22665505,22666123,22666604,22667082,22667555,22668071,22668871,2266951', 'assoc_port': '22572496:22572532,22573115:22573126,22573326:22573359,22573742:22573779,22574433:22574436,22574815:22574830,22575317:22575326,22575738:22575772,22576269:22576300,22576604:22576611,22577091:22577100,22577585:22577650,22578157:22578167,22578558:22578593,22579061:22579108,22589345:22589355,22589743:22589747,22590338:22590365,22590734:22590741,22590863:22590864,22591348:22591360,22591636:22591667,22592221:22592236,22592634:22592678,22593197:22593234,22593637:22593651,22594215:22594256,22594939:22594948,22595293:22595302,22596857:22596863,22597376:22597377,22597852:22597863,22598402:22598412,22598714:22598748,22599216:22599227,22599783:22599845,22600238:22600279,22600776:22600825,22601365:22601396,22601825:22601892,22604792:22604804,22605092:22605145,22605713:22605720,22606058:22606068,22606881:22606910,22607985:22607990,22608501:22608547,22609408:22609410,22609715:22609810,22610437:22610466,22610994:22611034,22611606:22611702,22613023:22613031,22613686:22613774,22614349:22614378,22615158:22615191,22615897:2261595', 'assoc_mat': '22572496:cartonnette:3726:22572532,22573115:cartonnette:3726:22573126,22573326:cartonnette:3726:22573359,22573742:cartonnette:3726:22573779,22574433:cartonnette:3726:22574436,22574815:cartonnette:3726:22574830,22575317:cartonnette:3726:22575326,22575738:cartonnette:3726:22575772,22576269:cartonnette:3726:22576300,22576604:cartonnette:3726:22576611,22577091:cartonnette:3726:22577100,22577585:cartonnette:3726:22577650,22578157:cartonnette:3726:22578167,22578558:cartonnette:3726:22578593,22579061:cartonnette:3726:22579108,22589345:cartonnette:3726:22589355,22589743:cartonnette:3726:22589747,22590338:cartonnette:3726:22590365,22590734:cartonnette:3726:22590741,22590863:cartonnette:3726:22590864,22591348:cartonnette:3726:22591360,22591636:cartonnette:3726:22591667,22592221:cartonnette:3726:22592236,22592634:cartonnette:3726:22592678,22593197:cartonnette:3726:22593234,22593637:cartonnette:3726:22593651,22594215:cartonnette:3726:22594256,22594939:cartonnette:3726:22594948,22595293:cartonnette:3726:22595302,22596857:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.014560488363956393, 'nb_photo': 6465, 'list_port_cont': '22572526,22573128,22573368,22573782,22574443,22574824,22575324,22575768,22576309,22576607,22577093,22577646,22578162,22578591,22579112,22589211,22589347,22589757,22590368,22590744,22590872,22591365,22591666,22592235,22592681,22593229,22593652,22594255,22594947,22595309,22596865,22597384,22597865,22598416,22598749,22599226,22599846,22600268,22600826,22601403,22601900,22604794,22605140,22605723,22606074,22606906,22607995,22608557,22609417,22609808,22610457,22611030,22611703,22613025,22613771,22614383,22615197,22615958,22616557,22617301,22618022,22618595,22619082,22619813,22620541,22620880,22621326,22622042,22622505,22623233,22624060,22624879,22625739,22626320,22627179,22627847,22628433,22628943,22629379,22629924,22630623,22630891,22631551,22631972,22632913,22633451,22634226,22634753,22635246,22635601,22636129,22656520,22656778,22657129,22657384,22658139,22658632,22658917,22659337,22659927,22660410,22660892,22661480,22662012,22662610,22662985,22663764,22665503,22666114,22666596,22667074,22667558,22668074,2266886', 'assoc_port': '22572496:22572526,22573115:22573128,22573326:22573368,22573742:22573782,22574433:22574443,22574815:22574824,22575317:22575324,22575738:22575768,22576269:22576309,22576604:22576607,22577091:22577093,22577585:22577646,22578157:22578162,22578558:22578591,22579061:22579112,22589204:22589211,22589345:22589347,22589743:22589757,22590338:22590368,22590734:22590744,22590863:22590872,22591348:22591365,22591636:22591666,22592221:22592235,22592634:22592681,22593197:22593229,22593637:22593652,22594215:22594255,22594939:22594947,22595293:22595309,22596857:22596865,22597376:22597384,22597852:22597865,22598402:22598416,22598714:22598749,22599216:22599226,22599783:22599846,22600238:22600268,22600776:22600826,22601365:22601403,22601825:22601900,22604792:22604794,22605092:22605140,22605713:22605723,22606058:22606074,22606881:22606906,22607985:22607995,22608501:22608557,22609408:22609417,22609715:22609808,22610437:22610457,22610994:22611030,22611606:22611703,22613023:22613025,22613686:22613771,22614349:22614383,22615158:2261519', 'assoc_mat': '22572496:Carton_brun:3726:22572526,22573115:Carton_brun:3726:22573128,22573326:Carton_brun:3726:22573368,22573742:Carton_brun:3726:22573782,22574433:Carton_brun:3726:22574443,22574815:Carton_brun:3726:22574824,22575317:Carton_brun:3726:22575324,22575738:Carton_brun:3726:22575768,22576269:Carton_brun:3726:22576309,22576604:Carton_brun:3726:22576607,22577091:Carton_brun:3726:22577093,22577585:Carton_brun:3726:22577646,22578157:Carton_brun:3726:22578162,22578558:Carton_brun:3726:22578591,22579061:Carton_brun:3726:22579112,22589204:Carton_brun:3726:22589211,22589345:Carton_brun:3726:22589347,22589743:Carton_brun:3726:22589757,22590338:Carton_brun:3726:22590368,22590734:Carton_brun:3726:22590744,22590863:Carton_brun:3726:22590872,22591348:Carton_brun:3726:22591365,22591636:Carton_brun:3726:22591666,22592221:Carton_brun:3726:22592235,22592634:Carton_brun:3726:22592681,22593197:Carton_brun:3726:22593229,22593637:Carton_brun:3726:22593652,22594215:Carton_brun:3726:22594255,22594939:Carton_brun:3726:22594947,22595293:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007544476649318626, 'nb_photo': 7069, 'list_port_cont': '22572527,22573121,22573362,22573778,22574441,22574823,22575321,22575763,22576299,22576606,22577095,22577655,22578165,22578588,22579113,22589210,22589356,22589752,22590371,22590747,22590867,22591361,22591670,22592228,22592672,22593228,22593649,22594246,22594950,22595301,22596861,22597383,22597857,22598410,22598743,22599223,22599843,22600277,22600820,22601404,22601893,22604799,22605724,22606069,22606907,22607997,22608553,22609412,22609804,22610461,22611023,22611697,22613032,22613778,22614384,22615189,22615960,22616566,22617300,22618027,22618600,22619090,22619816,22620543,22620888,22621325,22622045,22622513,22623235,22624056,22624888,22625741,22626328,22627172,22627840,22628430,22628937,22629380,22629929,22630631,22630888,22631552,22631982,22632909,22633448,22634236,22634757,22635241,22635606,22636131,22656522,22656768,22657133,22657382,22658146,22658623,22658920,22659341,22659922,22660408,22660897,22661471,22662017,22662609,22662987,22663761,22665504,22666115,22666595,22667072,22667553,22668063,22668865,2266951', 'assoc_port': '22572496:22572527,22573115:22573121,22573326:22573362,22573742:22573778,22574433:22574441,22574815:22574823,22575317:22575321,22575738:22575763,22576269:22576299,22576604:22576606,22577091:22577095,22577585:22577655,22578157:22578165,22578558:22578588,22579061:22579113,22589204:22589210,22589345:22589356,22589743:22589752,22590338:22590371,22590734:22590747,22590863:22590867,22591348:22591361,22591636:22591670,22592221:22592228,22592634:22592672,22593197:22593228,22593637:22593649,22594215:22594246,22594939:22594950,22595293:22595301,22596857:22596861,22597376:22597383,22597852:22597857,22598402:22598410,22598714:22598743,22599216:22599223,22599783:22599843,22600238:22600277,22600776:22600820,22601365:22601404,22601825:22601893,22604792:22604799,22605713:22605724,22606058:22606069,22606881:22606907,22607985:22607997,22608501:22608553,22609408:22609412,22609715:22609804,22610437:22610461,22610994:22611023,22611606:22611697,22613023:22613032,22613686:22613778,22614349:22614384,22615158:22615189,22615897:2261596', 'assoc_mat': '22572496:Carton_gris:3726:22572527,22573115:Carton_gris:3726:22573121,22573326:Carton_gris:3726:22573362,22573742:Carton_gris:3726:22573778,22574433:Carton_gris:3726:22574441,22574815:Carton_gris:3726:22574823,22575317:Carton_gris:3726:22575321,22575738:Carton_gris:3726:22575763,22576269:Carton_gris:3726:22576299,22576604:Carton_gris:3726:22576606,22577091:Carton_gris:3726:22577095,22577585:Carton_gris:3726:22577655,22578157:Carton_gris:3726:22578165,22578558:Carton_gris:3726:22578588,22579061:Carton_gris:3726:22579113,22589204:Carton_gris:3726:22589210,22589345:Carton_gris:3726:22589356,22589743:Carton_gris:3726:22589752,22590338:Carton_gris:3726:22590371,22590734:Carton_gris:3726:22590747,22590863:Carton_gris:3726:22590867,22591348:Carton_gris:3726:22591361,22591636:Carton_gris:3726:22591670,22592221:Carton_gris:3726:22592228,22592634:Carton_gris:3726:22592672,22593197:Carton_gris:3726:22593228,22593637:Carton_gris:3726:22593649,22594215:Carton_gris:3726:22594246,22594939:Carton_gris:3726:22594950,22595293:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018355330311349211, 'nb_photo': 1102, 'list_port_cont': '22575322,22575767,22576306,22576608,22577104,22577653,22579114,22589212,22589353,22589753,22590370,22591359,22591672,22592230,22592675,22593650,22594951,22595300,22596866,22597386,22597856,22598747,22599850,22600819,22601406,22601897,22604793,22605725,22606073,22608552,22609409,22610462,22611701,22613775,22614374,22615187,22616565,22618032,22618598,22619081,22619817,22620533,22620883,22621330,22622504,22623240,22624054,22624880,22627176,22627841,22628429,22628938,22629931,22630898,22631548,22631978,22632914,22633453,22634234,22634764,22635238,22636135,22656516,22657140,22658624,22659333,22660412,22660891,22661478,22662019,22662604,22662986,22663766,22665509,22666116,22666602,22667081,22667550,22668070,22668864,22669515,22669924,22670710,22671382,22674915,22675873,22676672,22677436,22679024,22679764,22680708,22681692,22682469,22683307,22687879,22688523,22690241,22690957,22692347,22693009,22693815,22694858,22703243,22704052,22704436,22705002,22705531,22706332,22707088,22707643,22708176,22708840,22709629,2271015', 'assoc_port': '22575317:22575322,22575738:22575767,22576269:22576306,22576604:22576608,22577091:22577104,22577585:22577653,22579061:22579114,22589204:22589212,22589345:22589353,22589743:22589753,22590338:22590370,22591348:22591359,22591636:22591672,22592221:22592230,22592634:22592675,22593637:22593650,22594939:22594951,22595293:22595300,22596857:22596866,22597376:22597386,22597852:22597856,22598714:22598747,22599783:22599850,22600776:22600819,22601365:22601406,22601825:22601897,22604792:22604793,22605713:22605725,22606058:22606073,22608501:22608552,22609408:22609409,22610437:22610462,22611606:22611701,22613686:22613775,22614349:22614374,22615158:22615187,22616551:22616565,22618017:22618032,22618470:22618598,22619074:22619081,22619744:22619817,22620531:22620533,22620848:22620883,22621300:22621330,22622472:22622504,22623210:22623240,22624019:22624054,22624848:22624880,22627137:22627176,22627814:22627841,22628404:22628429,22628933:22628938,22629887:22629931,22630857:22630898,22631507:22631548,22631970:22631978,22632867:2263291', 'assoc_mat': '22575317:kraft:3726:22575322,22575738:kraft:3726:22575767,22576269:kraft:3726:22576306,22576604:kraft:3726:22576608,22577091:kraft:3726:22577104,22577585:kraft:3726:22577653,22579061:kraft:3726:22579114,22589204:kraft:3726:22589212,22589345:kraft:3726:22589353,22589743:kraft:3726:22589753,22590338:kraft:3726:22590370,22591348:kraft:3726:22591359,22591636:kraft:3726:22591672,22592221:kraft:3726:22592230,22592634:kraft:3726:22592675,22593637:kraft:3726:22593650,22594939:kraft:3726:22594951,22595293:kraft:3726:22595300,22596857:kraft:3726:22596866,22597376:kraft:3726:22597386,22597852:kraft:3726:22597856,22598714:kraft:3726:22598747,22599783:kraft:3726:22599850,22600776:kraft:3726:22600819,22601365:kraft:3726:22601406,22601825:kraft:3726:22601897,22604792:kraft:3726:22604793,22605713:kraft:3726:22605725,22606058:kraft:3726:22606073,22608501:kraft:3726:22608552,22609408:kraft:3726:22609409,22610437:kraft:3726:22610462,22611606:kraft:3726:22611701,22613686:kraft:3726:22613775,22614349:kraft:3726:22614374,22615158:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0007788010285389047, 'nb_photo': 272, 'list_port_cont': '22573788,22574435,22577649,22579105,22590374,22590865,22592676,22594943,22595304,22596867,22598754,22601405,22610458,22618597,22619818,22622503,22625752,22630624,22630896,22633446,22634228,22634755,22635243,22658145,22658912,22659330,22660406,22661475,22662020,22662600,22662991,22666597,22669925,22675739,22676681,22677444,22682474,22687881,22689533,22690235,22692350,22693012,22703007,22704999,22705751,22707635,22710148,22710585,22717043,22718266,22720139,22720564,22721864,22723708,22724657,22725265,22725402,22726766,22740064,22741237,22742327,22743961,22744871,22745555,22745942,22747369,22748293,22750054,22750675,22751208,22752003,22752196,22752584,22753269,22755049,22755620,22756949,22759302,22759921,22761463,22761970,22763339,22769483,22771153,22772495,22774634,22779448,22780668,22809507,22810342,22810823,22811276,22811691,22813783,22814429,22820064,22820753,22822287,22828558,22830665,22831124,22831643,22832357,22833222,22834839,22836605,22837274,22840108,22842275,22842652,22847348,22851848,22853074,2285438', 'assoc_port': '22573742:22573788,22574433:22574435,22577585:22577649,22579061:22579105,22590338:22590374,22590863:22590865,22592634:22592676,22594939:22594943,22595293:22595304,22596857:22596867,22598714:22598754,22601365:22601405,22610437:22610458,22618470:22618597,22619744:22619818,22622472:22622503,22625733:22625752,22630596:22630624,22630857:22630896,22633414:22633446,22634144:22634228,22634720:22634755,22635212:22635243,22658111:22658145,22658886:22658912,22659324:22659330,22660372:22660406,22661429:22661475,22661981:22662020,22662597:22662600,22662926:22662991,22666582:22666597,22669909:22669925,22675633:22675739,22676642:22676681,22677428:22677444,22682426:22682474,22687701:22687881,22689449:22689533,22690184:22690235,22692320:22692350,22692960:22693012,22702995:22703007,22704969:22704999,22705714:22705751,22707600:22707635,22710140:22710148,22710502:22710585,22716945:22717043,22718167:22718266,22720089:22720139,22720474:22720564,22721783:22721864,22723569:22723708,22724626:22724657,22725167:22725402,22725184:2272526', 'assoc_mat': '22573742:metal:3726:22573788,22574433:metal:3726:22574435,22577585:metal:3726:22577649,22579061:metal:3726:22579105,22590338:metal:3726:22590374,22590863:metal:3726:22590865,22592634:metal:3726:22592676,22594939:metal:3726:22594943,22595293:metal:3726:22595304,22596857:metal:3726:22596867,22598714:metal:3726:22598754,22601365:metal:3726:22601405,22610437:metal:3726:22610458,22618470:metal:3726:22618597,22619744:metal:3726:22619818,22622472:metal:3726:22622503,22625733:metal:3726:22625752,22630596:metal:3726:22630624,22630857:metal:3726:22630896,22633414:metal:3726:22633446,22634144:metal:3726:22634228,22634720:metal:3726:22634755,22635212:metal:3726:22635243,22658111:metal:3726:22658145,22658886:metal:3726:22658912,22659324:metal:3726:22659330,22660372:metal:3726:22660406,22661429:metal:3726:22661475,22661981:metal:3726:22662020,22662597:metal:3726:22662600,22662926:metal:3726:22662991,22666582:metal:3726:22666597,22669909:metal:3726:22669925,22675633:metal:3726:22675739,22676642:metal:3726:22676681,22677428:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.003856822478184073, 'nb_photo': 4449, 'list_port_cont': '22572529,22573120,22573365,22573781,22574438,22574831,22575330,22575773,22576302,22576615,22577098,22577656,22578166,22578589,22579111,22589208,22589351,22589749,22590375,22590740,22590873,22591356,22591668,22592233,22592674,22593238,22593647,22594247,22594949,22595299,22596862,22597382,22598406,22598750,22599222,22599854,22600273,22600828,22601400,22601891,22604801,22605142,22605715,22606903,22607996,22608551,22609419,22609815,22610459,22611028,22611699,22613033,22613777,22614381,22615188,22615954,22616558,22617309,22618025,22618594,22619089,22619810,22620540,22620879,22621331,22622038,22622507,22623236,22624050,22624884,22625750,22626319,22627169,22627851,22628431,22628935,22629376,22629935,22630627,22630890,22631547,22631981,22632912,22633450,22634233,22634762,22635247,22635607,22636134,22656517,22656770,22657137,22657383,22658147,22658627,22658916,22659332,22659928,22660411,22660899,22661472,22662022,22662608,22662989,22663763,22665508,22666119,22666603,22667077,22667554,22668067,22668862,22669524,2266992', 'assoc_port': '22572496:22572529,22573115:22573120,22573326:22573365,22573742:22573781,22574433:22574438,22574815:22574831,22575317:22575330,22575738:22575773,22576269:22576302,22576604:22576615,22577091:22577098,22577585:22577656,22578157:22578166,22578558:22578589,22579061:22579111,22589204:22589208,22589345:22589351,22589743:22589749,22590338:22590375,22590734:22590740,22590863:22590873,22591348:22591356,22591636:22591668,22592221:22592233,22592634:22592674,22593197:22593238,22593637:22593647,22594215:22594247,22594939:22594949,22595293:22595299,22596857:22596862,22597376:22597382,22598402:22598406,22598714:22598750,22599216:22599222,22599783:22599854,22600238:22600273,22600776:22600828,22601365:22601400,22601825:22601891,22604792:22604801,22605092:22605142,22605713:22605715,22606881:22606903,22607985:22607996,22608501:22608551,22609408:22609419,22609715:22609815,22610437:22610459,22610994:22611028,22611606:22611699,22613023:22613033,22613686:22613777,22614349:22614381,22615158:22615188,22615897:22615954,22616551:2261655', 'assoc_mat': '22572496:plastique:3726:22572529,22573115:plastique:3726:22573120,22573326:plastique:3726:22573365,22573742:plastique:3726:22573781,22574433:plastique:3726:22574438,22574815:plastique:3726:22574831,22575317:plastique:3726:22575330,22575738:plastique:3726:22575773,22576269:plastique:3726:22576302,22576604:plastique:3726:22576615,22577091:plastique:3726:22577098,22577585:plastique:3726:22577656,22578157:plastique:3726:22578166,22578558:plastique:3726:22578589,22579061:plastique:3726:22579111,22589204:plastique:3726:22589208,22589345:plastique:3726:22589351,22589743:plastique:3726:22589749,22590338:plastique:3726:22590375,22590734:plastique:3726:22590740,22590863:plastique:3726:22590873,22591348:plastique:3726:22591356,22591636:plastique:3726:22591668,22592221:plastique:3726:22592233,22592634:plastique:3726:22592674,22593197:plastique:3726:22593238,22593637:plastique:3726:22593647,22594215:plastique:3726:22594247,22594939:plastique:3726:22594949,22595293:plastique:3726:22595299,22596857:plastique:3726:22596862,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01315606130266256, 'nb_photo': 11572, 'list_port_cont': '22572522,22573130,22573364,22573780,22574444,22574826,22575331,22575769,22576301,22576605,22577103,22577657,22578171,22578586,22579107,22589207,22589354,22589751,22590373,22590738,22590875,22591367,22591661,22592234,22592680,22593227,22593653,22594254,22594940,22595306,22596864,22597385,22597855,22598415,22598746,22599221,22599851,22600274,22600824,22601402,22601894,22604796,22605144,22605719,22606070,22606909,22607992,22608558,22609411,22609811,22610460,22611026,22611704,22613026,22613779,22614375,22615193,22615952,22616561,22617298,22618023,22618599,22619080,22619819,22620532,22620882,22621328,22622039,22622510,22623244,22624055,22624887,22625735,22626325,22627170,22627845,22628422,22628939,22629372,22629934,22630630,22630892,22631546,22631974,22632911,22633449,22634229,22634758,22635244,22635597,22636128,22656515,22656771,22657134,22657381,22658143,22658629,22658913,22659331,22659924,22660413,22660898,22661470,22662014,22662602,22662992,22663760,22665510,22666124,22666598,22667079,22667556,22668065,2266886', 'assoc_port': '22572496:22572522,22573115:22573130,22573326:22573364,22573742:22573780,22574433:22574444,22574815:22574826,22575317:22575331,22575738:22575769,22576269:22576301,22576604:22576605,22577091:22577103,22577585:22577657,22578157:22578171,22578558:22578586,22579061:22579107,22589204:22589207,22589345:22589354,22589743:22589751,22590338:22590373,22590734:22590738,22590863:22590875,22591348:22591367,22591636:22591661,22592221:22592234,22592634:22592680,22593197:22593227,22593637:22593653,22594215:22594254,22594939:22594940,22595293:22595306,22596857:22596864,22597376:22597385,22597852:22597855,22598402:22598415,22598714:22598746,22599216:22599221,22599783:22599851,22600238:22600274,22600776:22600824,22601365:22601402,22601825:22601894,22604792:22604796,22605092:22605144,22605713:22605719,22606058:22606070,22606881:22606909,22607985:22607992,22608501:22608558,22609408:22609411,22609715:22609811,22610437:22610460,22610994:22611026,22611606:22611704,22613023:22613026,22613686:22613779,22614349:22614375,22615158:2261519', 'assoc_mat': '22572496:Teint_Dans_La_Masse:3726:22572522,22573115:Teint_Dans_La_Masse:3726:22573130,22573326:Teint_Dans_La_Masse:3726:22573364,22573742:Teint_Dans_La_Masse:3726:22573780,22574433:Teint_Dans_La_Masse:3726:22574444,22574815:Teint_Dans_La_Masse:3726:22574826,22575317:Teint_Dans_La_Masse:3726:22575331,22575738:Teint_Dans_La_Masse:3726:22575769,22576269:Teint_Dans_La_Masse:3726:22576301,22576604:Teint_Dans_La_Masse:3726:22576605,22577091:Teint_Dans_La_Masse:3726:22577103,22577585:Teint_Dans_La_Masse:3726:22577657,22578157:Teint_Dans_La_Masse:3726:22578171,22578558:Teint_Dans_La_Masse:3726:22578586,22579061:Teint_Dans_La_Masse:3726:22579107,22589204:Teint_Dans_La_Masse:3726:22589207,22589345:Teint_Dans_La_Masse:3726:22589354,22589743:Teint_Dans_La_Masse:3726:22589751,22590338:Teint_Dans_La_Masse:3726:22590373,22590734:Teint_Dans_La_Masse:3726:22590738,22590863:Teint_Dans_La_Masse:3726:22590875,22591348:Teint_Dans_La_Masse:3726:22591367,22591636:Teint_Dans_La_Masse:3726:22591661,22592221:Teint_Dans_La_Masse:3726:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1773660,1778113,1780373,1785438,1789412,1793793,1797600,1802472,1803854,1808299,1812096,1814888,1823609,1823385,1824317)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=10 and date >='2025-05-01' and date <= '2025-05-31') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((38285,),), 'unwanted_material_monthly_percentage': ((0.04592301469143381,),), 'material_repartition': (('JRM', 38015),), 'material_dict': {'JRM': 38015}, 'coverage_data': (('2025/05/15/', 0.975208), ('2025/05/14/', 0.977234), ('2025/05/13/', 0.974699), ('2025/05/12/', 0.975848), ('2025/05/10/', 1.0), ('2025/05/09/', 0.975544), ('2025/05/08/', 0.974826), ('2025/05/07/', 0.971782), ('2025/05/06/', 0.978738), ('2025/05/05/', 0.977456), ('2025/05/03/', 0.975332), ('2025/05/02/', 0.974502), ('2025/05/01/', 0.977905)), 'impurety_average_data': ((datetime.date(2025, 5, 1), 0.0517629800070253, 804), (datetime.date(2025, 5, 2), 0.05416864639025957, 2980), (datetime.date(2025, 5, 3), 0.052184404660923736, 736), (datetime.date(2025, 5, 5), 0.044745248246737576, 3142), (datetime.date(2025, 5, 6), 0.04264769458623977, 3723), (datetime.date(2025, 5, 7), 0.0432984921811175, 4348), (datetime.date(2025, 5, 8), 0.047808357200980665, 19), (datetime.date(2025, 5, 9), 0.0453137066219222, 3653), (datetime.date(2025, 5, 10), 0.0453060504385659, 727), (datetime.date(2025, 5, 12), 0.04370732101421575, 3554), (datetime.date(2025, 5, 13), 0.04600209756769339, 3236), (datetime.date(2025, 5, 14), 0.04725385342006534, 3248), (datetime.date(2025, 5, 15), 0.04537503618306493, 3743), (datetime.date(2025, 5, 16), 0.0450615749650272, 4102)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 5, 1), 0.0517629800070253, 804), (datetime.date(2025, 5, 2), 0.05416864639025957, 2980), (datetime.date(2025, 5, 3), 0.052184404660923736, 736), (datetime.date(2025, 5, 5), 0.044745248246737576, 3142), (datetime.date(2025, 5, 6), 0.04264769458623977, 3723), (datetime.date(2025, 5, 7), 0.0432984921811175, 4348), (datetime.date(2025, 5, 8), 0.047808357200980665, 19), (datetime.date(2025, 5, 9), 0.0453137066219222, 3653), (datetime.date(2025, 5, 10), 0.0453060504385659, 727), (datetime.date(2025, 5, 12), 0.04370732101421575, 3554), (datetime.date(2025, 5, 13), 0.04600209756769339, 3236), (datetime.date(2025, 5, 14), 0.04725385342006534, 3248), (datetime.date(2025, 5, 15), 0.04537503618306493, 3743), (datetime.date(2025, 5, 16), 0.0450615749650272, 4102))}, 'quality_array': [['-4.491755057322415', '01052025'], ['-4.6494079839349665', '02052025'], ['-4.737289055724324', '03052025'], ['-4.641189930158067', '05052025'], ['-4.467853996790199', '06052025'], ['-4.631018616181677', '07052025'], ['-4.28603021073238', '08052025'], ['-4.6102238743028225', '09052025'], ['-4.443015436351809', '10052025'], ['-4.498218263762559', '12052025'], ['-4.554868263829699', '13052025'], ['-4.519909800035487', '14052025'], ['-4.447863601413848', '15052025'], ['-4.53002145970041', '16052025'], ['-2.6838061134858844', '17052025']], 'number_of_batch': ((668,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004159077379151244, 'nb_photo': 4373, 'list_port_cont': '22572531,22573123,22573357,22573784,22574442,22574828,22575328,22575765,22576307,22576612,22577102,22577652,22578172,22578592,22579106,22589206,22589350,22589756,22590364,22590745,22590874,22591366,22591664,22592229,22592673,22593237,22593642,22594250,22594941,22595308,22596869,22597378,22597864,22598413,22598744,22599231,22599855,22600276,22600829,22601407,22601896,22604802,22605141,22605714,22606063,22606911,22607994,22608555,22609418,22609805,22610463,22611029,22611700,22613024,22613780,22614376,22615190,22615963,22616563,22617302,22618021,22618592,22619087,22619812,22620539,22620877,22621333,22622041,22622509,22623241,22624057,22624881,22625745,22626327,22627174,22627843,22628428,22628934,22629382,22629928,22630629,22630894,22631545,22631979,22632907,22633456,22634232,22634763,22635245,22635599,22636132,22656523,22656769,22657139,22657386,22658144,22658630,22658921,22659340,22659921,22660404,22660890,22661474,22662015,22662607,22662983,22663759,22665506,22666118,22666605,22667073,22667560,22668068,2266887', 'assoc_port': '22572496:22572531,22573115:22573123,22573326:22573357,22573742:22573784,22574433:22574442,22574815:22574828,22575317:22575328,22575738:22575765,22576269:22576307,22576604:22576612,22577091:22577102,22577585:22577652,22578157:22578172,22578558:22578592,22579061:22579106,22589204:22589206,22589345:22589350,22589743:22589756,22590338:22590364,22590734:22590745,22590863:22590874,22591348:22591366,22591636:22591664,22592221:22592229,22592634:22592673,22593197:22593237,22593637:22593642,22594215:22594250,22594939:22594941,22595293:22595308,22596857:22596869,22597376:22597378,22597852:22597864,22598402:22598413,22598714:22598744,22599216:22599231,22599783:22599855,22600238:22600276,22600776:22600829,22601365:22601407,22601825:22601896,22604792:22604802,22605092:22605141,22605713:22605714,22606058:22606063,22606881:22606911,22607985:22607994,22608501:22608555,22609408:22609418,22609715:22609805,22610437:22610463,22610994:22611029,22611606:22611700,22613023:22613024,22613686:22613780,22614349:22614376,22615158:2261519', 'assoc_mat': '22572496:autre_refus:3726:22572531,22573115:autre_refus:3726:22573123,22573326:autre_refus:3726:22573357,22573742:autre_refus:3726:22573784,22574433:autre_refus:3726:22574442,22574815:autre_refus:3726:22574828,22575317:autre_refus:3726:22575328,22575738:autre_refus:3726:22575765,22576269:autre_refus:3726:22576307,22576604:autre_refus:3726:22576612,22577091:autre_refus:3726:22577102,22577585:autre_refus:3726:22577652,22578157:autre_refus:3726:22578172,22578558:autre_refus:3726:22578592,22579061:autre_refus:3726:22579106,22589204:autre_refus:3726:22589206,22589345:autre_refus:3726:22589350,22589743:autre_refus:3726:22589756,22590338:autre_refus:3726:22590364,22590734:autre_refus:3726:22590745,22590863:autre_refus:3726:22590874,22591348:autre_refus:3726:22591366,22591636:autre_refus:3726:22591664,22592221:autre_refus:3726:22592229,22592634:autre_refus:3726:22592673,22593197:autre_refus:3726:22593237,22593637:autre_refus:3726:22593642,22594215:autre_refus:3726:22594250,22594939:autre_refus:3726:22594941,22595293:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0054072875288875884, 'nb_photo': 7088, 'list_port_cont': '22572532,22573126,22573359,22573779,22574436,22574830,22575326,22575772,22576300,22576611,22577100,22577650,22578167,22578593,22579108,22589355,22589747,22590365,22590741,22590864,22591360,22591667,22592236,22592678,22593234,22593651,22594256,22594948,22595302,22596863,22597377,22597863,22598412,22598748,22599227,22599845,22600279,22600825,22601396,22601892,22604804,22605145,22605720,22606068,22606910,22607990,22608547,22609410,22609810,22610466,22611034,22611702,22613031,22613774,22614378,22615191,22615957,22616560,22617306,22618031,22618589,22619091,22619815,22620542,22620886,22621332,22622047,22622512,22623242,22624058,22624878,22625743,22626323,22627175,22627849,22628427,22628941,22629381,22629930,22630632,22630897,22631555,22631973,22632910,22633447,22634235,22634754,22635242,22635608,22636133,22656513,22656773,22657138,22657379,22658141,22658628,22658918,22659336,22659925,22660409,22660893,22661473,22662023,22662606,22662988,22663768,22665505,22666123,22666604,22667082,22667555,22668071,22668871,2266951', 'assoc_port': '22572496:22572532,22573115:22573126,22573326:22573359,22573742:22573779,22574433:22574436,22574815:22574830,22575317:22575326,22575738:22575772,22576269:22576300,22576604:22576611,22577091:22577100,22577585:22577650,22578157:22578167,22578558:22578593,22579061:22579108,22589345:22589355,22589743:22589747,22590338:22590365,22590734:22590741,22590863:22590864,22591348:22591360,22591636:22591667,22592221:22592236,22592634:22592678,22593197:22593234,22593637:22593651,22594215:22594256,22594939:22594948,22595293:22595302,22596857:22596863,22597376:22597377,22597852:22597863,22598402:22598412,22598714:22598748,22599216:22599227,22599783:22599845,22600238:22600279,22600776:22600825,22601365:22601396,22601825:22601892,22604792:22604804,22605092:22605145,22605713:22605720,22606058:22606068,22606881:22606910,22607985:22607990,22608501:22608547,22609408:22609410,22609715:22609810,22610437:22610466,22610994:22611034,22611606:22611702,22613023:22613031,22613686:22613774,22614349:22614378,22615158:22615191,22615897:2261595', 'assoc_mat': '22572496:cartonnette:3726:22572532,22573115:cartonnette:3726:22573126,22573326:cartonnette:3726:22573359,22573742:cartonnette:3726:22573779,22574433:cartonnette:3726:22574436,22574815:cartonnette:3726:22574830,22575317:cartonnette:3726:22575326,22575738:cartonnette:3726:22575772,22576269:cartonnette:3726:22576300,22576604:cartonnette:3726:22576611,22577091:cartonnette:3726:22577100,22577585:cartonnette:3726:22577650,22578157:cartonnette:3726:22578167,22578558:cartonnette:3726:22578593,22579061:cartonnette:3726:22579108,22589345:cartonnette:3726:22589355,22589743:cartonnette:3726:22589747,22590338:cartonnette:3726:22590365,22590734:cartonnette:3726:22590741,22590863:cartonnette:3726:22590864,22591348:cartonnette:3726:22591360,22591636:cartonnette:3726:22591667,22592221:cartonnette:3726:22592236,22592634:cartonnette:3726:22592678,22593197:cartonnette:3726:22593234,22593637:cartonnette:3726:22593651,22594215:cartonnette:3726:22594256,22594939:cartonnette:3726:22594948,22595293:cartonnette:3726:22595302,22596857:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.014560488363956393, 'nb_photo': 6465, 'list_port_cont': '22572526,22573128,22573368,22573782,22574443,22574824,22575324,22575768,22576309,22576607,22577093,22577646,22578162,22578591,22579112,22589211,22589347,22589757,22590368,22590744,22590872,22591365,22591666,22592235,22592681,22593229,22593652,22594255,22594947,22595309,22596865,22597384,22597865,22598416,22598749,22599226,22599846,22600268,22600826,22601403,22601900,22604794,22605140,22605723,22606074,22606906,22607995,22608557,22609417,22609808,22610457,22611030,22611703,22613025,22613771,22614383,22615197,22615958,22616557,22617301,22618022,22618595,22619082,22619813,22620541,22620880,22621326,22622042,22622505,22623233,22624060,22624879,22625739,22626320,22627179,22627847,22628433,22628943,22629379,22629924,22630623,22630891,22631551,22631972,22632913,22633451,22634226,22634753,22635246,22635601,22636129,22656520,22656778,22657129,22657384,22658139,22658632,22658917,22659337,22659927,22660410,22660892,22661480,22662012,22662610,22662985,22663764,22665503,22666114,22666596,22667074,22667558,22668074,2266886', 'assoc_port': '22572496:22572526,22573115:22573128,22573326:22573368,22573742:22573782,22574433:22574443,22574815:22574824,22575317:22575324,22575738:22575768,22576269:22576309,22576604:22576607,22577091:22577093,22577585:22577646,22578157:22578162,22578558:22578591,22579061:22579112,22589204:22589211,22589345:22589347,22589743:22589757,22590338:22590368,22590734:22590744,22590863:22590872,22591348:22591365,22591636:22591666,22592221:22592235,22592634:22592681,22593197:22593229,22593637:22593652,22594215:22594255,22594939:22594947,22595293:22595309,22596857:22596865,22597376:22597384,22597852:22597865,22598402:22598416,22598714:22598749,22599216:22599226,22599783:22599846,22600238:22600268,22600776:22600826,22601365:22601403,22601825:22601900,22604792:22604794,22605092:22605140,22605713:22605723,22606058:22606074,22606881:22606906,22607985:22607995,22608501:22608557,22609408:22609417,22609715:22609808,22610437:22610457,22610994:22611030,22611606:22611703,22613023:22613025,22613686:22613771,22614349:22614383,22615158:2261519', 'assoc_mat': '22572496:Carton_brun:3726:22572526,22573115:Carton_brun:3726:22573128,22573326:Carton_brun:3726:22573368,22573742:Carton_brun:3726:22573782,22574433:Carton_brun:3726:22574443,22574815:Carton_brun:3726:22574824,22575317:Carton_brun:3726:22575324,22575738:Carton_brun:3726:22575768,22576269:Carton_brun:3726:22576309,22576604:Carton_brun:3726:22576607,22577091:Carton_brun:3726:22577093,22577585:Carton_brun:3726:22577646,22578157:Carton_brun:3726:22578162,22578558:Carton_brun:3726:22578591,22579061:Carton_brun:3726:22579112,22589204:Carton_brun:3726:22589211,22589345:Carton_brun:3726:22589347,22589743:Carton_brun:3726:22589757,22590338:Carton_brun:3726:22590368,22590734:Carton_brun:3726:22590744,22590863:Carton_brun:3726:22590872,22591348:Carton_brun:3726:22591365,22591636:Carton_brun:3726:22591666,22592221:Carton_brun:3726:22592235,22592634:Carton_brun:3726:22592681,22593197:Carton_brun:3726:22593229,22593637:Carton_brun:3726:22593652,22594215:Carton_brun:3726:22594255,22594939:Carton_brun:3726:22594947,22595293:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007544476649318626, 'nb_photo': 7069, 'list_port_cont': '22572527,22573121,22573362,22573778,22574441,22574823,22575321,22575763,22576299,22576606,22577095,22577655,22578165,22578588,22579113,22589210,22589356,22589752,22590371,22590747,22590867,22591361,22591670,22592228,22592672,22593228,22593649,22594246,22594950,22595301,22596861,22597383,22597857,22598410,22598743,22599223,22599843,22600277,22600820,22601404,22601893,22604799,22605724,22606069,22606907,22607997,22608553,22609412,22609804,22610461,22611023,22611697,22613032,22613778,22614384,22615189,22615960,22616566,22617300,22618027,22618600,22619090,22619816,22620543,22620888,22621325,22622045,22622513,22623235,22624056,22624888,22625741,22626328,22627172,22627840,22628430,22628937,22629380,22629929,22630631,22630888,22631552,22631982,22632909,22633448,22634236,22634757,22635241,22635606,22636131,22656522,22656768,22657133,22657382,22658146,22658623,22658920,22659341,22659922,22660408,22660897,22661471,22662017,22662609,22662987,22663761,22665504,22666115,22666595,22667072,22667553,22668063,22668865,2266951', 'assoc_port': '22572496:22572527,22573115:22573121,22573326:22573362,22573742:22573778,22574433:22574441,22574815:22574823,22575317:22575321,22575738:22575763,22576269:22576299,22576604:22576606,22577091:22577095,22577585:22577655,22578157:22578165,22578558:22578588,22579061:22579113,22589204:22589210,22589345:22589356,22589743:22589752,22590338:22590371,22590734:22590747,22590863:22590867,22591348:22591361,22591636:22591670,22592221:22592228,22592634:22592672,22593197:22593228,22593637:22593649,22594215:22594246,22594939:22594950,22595293:22595301,22596857:22596861,22597376:22597383,22597852:22597857,22598402:22598410,22598714:22598743,22599216:22599223,22599783:22599843,22600238:22600277,22600776:22600820,22601365:22601404,22601825:22601893,22604792:22604799,22605713:22605724,22606058:22606069,22606881:22606907,22607985:22607997,22608501:22608553,22609408:22609412,22609715:22609804,22610437:22610461,22610994:22611023,22611606:22611697,22613023:22613032,22613686:22613778,22614349:22614384,22615158:22615189,22615897:2261596', 'assoc_mat': '22572496:Carton_gris:3726:22572527,22573115:Carton_gris:3726:22573121,22573326:Carton_gris:3726:22573362,22573742:Carton_gris:3726:22573778,22574433:Carton_gris:3726:22574441,22574815:Carton_gris:3726:22574823,22575317:Carton_gris:3726:22575321,22575738:Carton_gris:3726:22575763,22576269:Carton_gris:3726:22576299,22576604:Carton_gris:3726:22576606,22577091:Carton_gris:3726:22577095,22577585:Carton_gris:3726:22577655,22578157:Carton_gris:3726:22578165,22578558:Carton_gris:3726:22578588,22579061:Carton_gris:3726:22579113,22589204:Carton_gris:3726:22589210,22589345:Carton_gris:3726:22589356,22589743:Carton_gris:3726:22589752,22590338:Carton_gris:3726:22590371,22590734:Carton_gris:3726:22590747,22590863:Carton_gris:3726:22590867,22591348:Carton_gris:3726:22591361,22591636:Carton_gris:3726:22591670,22592221:Carton_gris:3726:22592228,22592634:Carton_gris:3726:22592672,22593197:Carton_gris:3726:22593228,22593637:Carton_gris:3726:22593649,22594215:Carton_gris:3726:22594246,22594939:Carton_gris:3726:22594950,22595293:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018355330311349211, 'nb_photo': 1102, 'list_port_cont': '22575322,22575767,22576306,22576608,22577104,22577653,22579114,22589212,22589353,22589753,22590370,22591359,22591672,22592230,22592675,22593650,22594951,22595300,22596866,22597386,22597856,22598747,22599850,22600819,22601406,22601897,22604793,22605725,22606073,22608552,22609409,22610462,22611701,22613775,22614374,22615187,22616565,22618032,22618598,22619081,22619817,22620533,22620883,22621330,22622504,22623240,22624054,22624880,22627176,22627841,22628429,22628938,22629931,22630898,22631548,22631978,22632914,22633453,22634234,22634764,22635238,22636135,22656516,22657140,22658624,22659333,22660412,22660891,22661478,22662019,22662604,22662986,22663766,22665509,22666116,22666602,22667081,22667550,22668070,22668864,22669515,22669924,22670710,22671382,22674915,22675873,22676672,22677436,22679024,22679764,22680708,22681692,22682469,22683307,22687879,22688523,22690241,22690957,22692347,22693009,22693815,22694858,22703243,22704052,22704436,22705002,22705531,22706332,22707088,22707643,22708176,22708840,22709629,2271015', 'assoc_port': '22575317:22575322,22575738:22575767,22576269:22576306,22576604:22576608,22577091:22577104,22577585:22577653,22579061:22579114,22589204:22589212,22589345:22589353,22589743:22589753,22590338:22590370,22591348:22591359,22591636:22591672,22592221:22592230,22592634:22592675,22593637:22593650,22594939:22594951,22595293:22595300,22596857:22596866,22597376:22597386,22597852:22597856,22598714:22598747,22599783:22599850,22600776:22600819,22601365:22601406,22601825:22601897,22604792:22604793,22605713:22605725,22606058:22606073,22608501:22608552,22609408:22609409,22610437:22610462,22611606:22611701,22613686:22613775,22614349:22614374,22615158:22615187,22616551:22616565,22618017:22618032,22618470:22618598,22619074:22619081,22619744:22619817,22620531:22620533,22620848:22620883,22621300:22621330,22622472:22622504,22623210:22623240,22624019:22624054,22624848:22624880,22627137:22627176,22627814:22627841,22628404:22628429,22628933:22628938,22629887:22629931,22630857:22630898,22631507:22631548,22631970:22631978,22632867:2263291', 'assoc_mat': '22575317:kraft:3726:22575322,22575738:kraft:3726:22575767,22576269:kraft:3726:22576306,22576604:kraft:3726:22576608,22577091:kraft:3726:22577104,22577585:kraft:3726:22577653,22579061:kraft:3726:22579114,22589204:kraft:3726:22589212,22589345:kraft:3726:22589353,22589743:kraft:3726:22589753,22590338:kraft:3726:22590370,22591348:kraft:3726:22591359,22591636:kraft:3726:22591672,22592221:kraft:3726:22592230,22592634:kraft:3726:22592675,22593637:kraft:3726:22593650,22594939:kraft:3726:22594951,22595293:kraft:3726:22595300,22596857:kraft:3726:22596866,22597376:kraft:3726:22597386,22597852:kraft:3726:22597856,22598714:kraft:3726:22598747,22599783:kraft:3726:22599850,22600776:kraft:3726:22600819,22601365:kraft:3726:22601406,22601825:kraft:3726:22601897,22604792:kraft:3726:22604793,22605713:kraft:3726:22605725,22606058:kraft:3726:22606073,22608501:kraft:3726:22608552,22609408:kraft:3726:22609409,22610437:kraft:3726:22610462,22611606:kraft:3726:22611701,22613686:kraft:3726:22613775,22614349:kraft:3726:22614374,22615158:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0007788010285389047, 'nb_photo': 272, 'list_port_cont': '22573788,22574435,22577649,22579105,22590374,22590865,22592676,22594943,22595304,22596867,22598754,22601405,22610458,22618597,22619818,22622503,22625752,22630624,22630896,22633446,22634228,22634755,22635243,22658145,22658912,22659330,22660406,22661475,22662020,22662600,22662991,22666597,22669925,22675739,22676681,22677444,22682474,22687881,22689533,22690235,22692350,22693012,22703007,22704999,22705751,22707635,22710148,22710585,22717043,22718266,22720139,22720564,22721864,22723708,22724657,22725265,22725402,22726766,22740064,22741237,22742327,22743961,22744871,22745555,22745942,22747369,22748293,22750054,22750675,22751208,22752003,22752196,22752584,22753269,22755049,22755620,22756949,22759302,22759921,22761463,22761970,22763339,22769483,22771153,22772495,22774634,22779448,22780668,22809507,22810342,22810823,22811276,22811691,22813783,22814429,22820064,22820753,22822287,22828558,22830665,22831124,22831643,22832357,22833222,22834839,22836605,22837274,22840108,22842275,22842652,22847348,22851848,22853074,2285438', 'assoc_port': '22573742:22573788,22574433:22574435,22577585:22577649,22579061:22579105,22590338:22590374,22590863:22590865,22592634:22592676,22594939:22594943,22595293:22595304,22596857:22596867,22598714:22598754,22601365:22601405,22610437:22610458,22618470:22618597,22619744:22619818,22622472:22622503,22625733:22625752,22630596:22630624,22630857:22630896,22633414:22633446,22634144:22634228,22634720:22634755,22635212:22635243,22658111:22658145,22658886:22658912,22659324:22659330,22660372:22660406,22661429:22661475,22661981:22662020,22662597:22662600,22662926:22662991,22666582:22666597,22669909:22669925,22675633:22675739,22676642:22676681,22677428:22677444,22682426:22682474,22687701:22687881,22689449:22689533,22690184:22690235,22692320:22692350,22692960:22693012,22702995:22703007,22704969:22704999,22705714:22705751,22707600:22707635,22710140:22710148,22710502:22710585,22716945:22717043,22718167:22718266,22720089:22720139,22720474:22720564,22721783:22721864,22723569:22723708,22724626:22724657,22725167:22725402,22725184:2272526', 'assoc_mat': '22573742:metal:3726:22573788,22574433:metal:3726:22574435,22577585:metal:3726:22577649,22579061:metal:3726:22579105,22590338:metal:3726:22590374,22590863:metal:3726:22590865,22592634:metal:3726:22592676,22594939:metal:3726:22594943,22595293:metal:3726:22595304,22596857:metal:3726:22596867,22598714:metal:3726:22598754,22601365:metal:3726:22601405,22610437:metal:3726:22610458,22618470:metal:3726:22618597,22619744:metal:3726:22619818,22622472:metal:3726:22622503,22625733:metal:3726:22625752,22630596:metal:3726:22630624,22630857:metal:3726:22630896,22633414:metal:3726:22633446,22634144:metal:3726:22634228,22634720:metal:3726:22634755,22635212:metal:3726:22635243,22658111:metal:3726:22658145,22658886:metal:3726:22658912,22659324:metal:3726:22659330,22660372:metal:3726:22660406,22661429:metal:3726:22661475,22661981:metal:3726:22662020,22662597:metal:3726:22662600,22662926:metal:3726:22662991,22666582:metal:3726:22666597,22669909:metal:3726:22669925,22675633:metal:3726:22675739,22676642:metal:3726:22676681,22677428:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.003856822478184073, 'nb_photo': 4449, 'list_port_cont': '22572529,22573120,22573365,22573781,22574438,22574831,22575330,22575773,22576302,22576615,22577098,22577656,22578166,22578589,22579111,22589208,22589351,22589749,22590375,22590740,22590873,22591356,22591668,22592233,22592674,22593238,22593647,22594247,22594949,22595299,22596862,22597382,22598406,22598750,22599222,22599854,22600273,22600828,22601400,22601891,22604801,22605142,22605715,22606903,22607996,22608551,22609419,22609815,22610459,22611028,22611699,22613033,22613777,22614381,22615188,22615954,22616558,22617309,22618025,22618594,22619089,22619810,22620540,22620879,22621331,22622038,22622507,22623236,22624050,22624884,22625750,22626319,22627169,22627851,22628431,22628935,22629376,22629935,22630627,22630890,22631547,22631981,22632912,22633450,22634233,22634762,22635247,22635607,22636134,22656517,22656770,22657137,22657383,22658147,22658627,22658916,22659332,22659928,22660411,22660899,22661472,22662022,22662608,22662989,22663763,22665508,22666119,22666603,22667077,22667554,22668067,22668862,22669524,2266992', 'assoc_port': '22572496:22572529,22573115:22573120,22573326:22573365,22573742:22573781,22574433:22574438,22574815:22574831,22575317:22575330,22575738:22575773,22576269:22576302,22576604:22576615,22577091:22577098,22577585:22577656,22578157:22578166,22578558:22578589,22579061:22579111,22589204:22589208,22589345:22589351,22589743:22589749,22590338:22590375,22590734:22590740,22590863:22590873,22591348:22591356,22591636:22591668,22592221:22592233,22592634:22592674,22593197:22593238,22593637:22593647,22594215:22594247,22594939:22594949,22595293:22595299,22596857:22596862,22597376:22597382,22598402:22598406,22598714:22598750,22599216:22599222,22599783:22599854,22600238:22600273,22600776:22600828,22601365:22601400,22601825:22601891,22604792:22604801,22605092:22605142,22605713:22605715,22606881:22606903,22607985:22607996,22608501:22608551,22609408:22609419,22609715:22609815,22610437:22610459,22610994:22611028,22611606:22611699,22613023:22613033,22613686:22613777,22614349:22614381,22615158:22615188,22615897:22615954,22616551:2261655', 'assoc_mat': '22572496:plastique:3726:22572529,22573115:plastique:3726:22573120,22573326:plastique:3726:22573365,22573742:plastique:3726:22573781,22574433:plastique:3726:22574438,22574815:plastique:3726:22574831,22575317:plastique:3726:22575330,22575738:plastique:3726:22575773,22576269:plastique:3726:22576302,22576604:plastique:3726:22576615,22577091:plastique:3726:22577098,22577585:plastique:3726:22577656,22578157:plastique:3726:22578166,22578558:plastique:3726:22578589,22579061:plastique:3726:22579111,22589204:plastique:3726:22589208,22589345:plastique:3726:22589351,22589743:plastique:3726:22589749,22590338:plastique:3726:22590375,22590734:plastique:3726:22590740,22590863:plastique:3726:22590873,22591348:plastique:3726:22591356,22591636:plastique:3726:22591668,22592221:plastique:3726:22592233,22592634:plastique:3726:22592674,22593197:plastique:3726:22593238,22593637:plastique:3726:22593647,22594215:plastique:3726:22594247,22594939:plastique:3726:22594949,22595293:plastique:3726:22595299,22596857:plastique:3726:22596862,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01315606130266256, 'nb_photo': 11572, 'list_port_cont': '22572522,22573130,22573364,22573780,22574444,22574826,22575331,22575769,22576301,22576605,22577103,22577657,22578171,22578586,22579107,22589207,22589354,22589751,22590373,22590738,22590875,22591367,22591661,22592234,22592680,22593227,22593653,22594254,22594940,22595306,22596864,22597385,22597855,22598415,22598746,22599221,22599851,22600274,22600824,22601402,22601894,22604796,22605144,22605719,22606070,22606909,22607992,22608558,22609411,22609811,22610460,22611026,22611704,22613026,22613779,22614375,22615193,22615952,22616561,22617298,22618023,22618599,22619080,22619819,22620532,22620882,22621328,22622039,22622510,22623244,22624055,22624887,22625735,22626325,22627170,22627845,22628422,22628939,22629372,22629934,22630630,22630892,22631546,22631974,22632911,22633449,22634229,22634758,22635244,22635597,22636128,22656515,22656771,22657134,22657381,22658143,22658629,22658913,22659331,22659924,22660413,22660898,22661470,22662014,22662602,22662992,22663760,22665510,22666124,22666598,22667079,22667556,22668065,2266886', 'assoc_port': '22572496:22572522,22573115:22573130,22573326:22573364,22573742:22573780,22574433:22574444,22574815:22574826,22575317:22575331,22575738:22575769,22576269:22576301,22576604:22576605,22577091:22577103,22577585:22577657,22578157:22578171,22578558:22578586,22579061:22579107,22589204:22589207,22589345:22589354,22589743:22589751,22590338:22590373,22590734:22590738,22590863:22590875,22591348:22591367,22591636:22591661,22592221:22592234,22592634:22592680,22593197:22593227,22593637:22593653,22594215:22594254,22594939:22594940,22595293:22595306,22596857:22596864,22597376:22597385,22597852:22597855,22598402:22598415,22598714:22598746,22599216:22599221,22599783:22599851,22600238:22600274,22600776:22600824,22601365:22601402,22601825:22601894,22604792:22604796,22605092:22605144,22605713:22605719,22606058:22606070,22606881:22606909,22607985:22607992,22608501:22608558,22609408:22609411,22609715:22609811,22610437:22610460,22610994:22611026,22611606:22611704,22613023:22613026,22613686:22613779,22614349:22614375,22615158:2261519', 'assoc_mat': '22572496:Teint_Dans_La_Masse:3726:22572522,22573115:Teint_Dans_La_Masse:3726:22573130,22573326:Teint_Dans_La_Masse:3726:22573364,22573742:Teint_Dans_La_Masse:3726:22573780,22574433:Teint_Dans_La_Masse:3726:22574444,22574815:Teint_Dans_La_Masse:3726:22574826,22575317:Teint_Dans_La_Masse:3726:22575331,22575738:Teint_Dans_La_Masse:3726:22575769,22576269:Teint_Dans_La_Masse:3726:22576301,22576604:Teint_Dans_La_Masse:3726:22576605,22577091:Teint_Dans_La_Masse:3726:22577103,22577585:Teint_Dans_La_Masse:3726:22577657,22578157:Teint_Dans_La_Masse:3726:22578171,22578558:Teint_Dans_La_Masse:3726:22578586,22579061:Teint_Dans_La_Masse:3726:22579107,22589204:Teint_Dans_La_Masse:3726:22589207,22589345:Teint_Dans_La_Masse:3726:22589354,22589743:Teint_Dans_La_Masse:3726:22589751,22590338:Teint_Dans_La_Masse:3726:22590373,22590734:Teint_Dans_La_Masse:3726:22590738,22590863:Teint_Dans_La_Masse:3726:22590875,22591348:Teint_Dans_La_Masse:3726:22591367,22591636:Teint_Dans_La_Masse:3726:22591661,22592221:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 38285}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-05', 0.04592301469143381),)]} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4873 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4873 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4873 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier,background', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4878 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4878 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4878 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4878 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4302 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4302 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4302 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4302 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition ! Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6 WARNING : type of output 1 of step 13596 doesn't seem to be define in the database( WARNING : type of input 3 of step 11881 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((38285,),), 'unwanted_material_monthly_percentage': ((0.04592301469143381,),), 'material_repartition': (('JRM', 38015),), 'material_dict': {'JRM': 38015}, 'coverage_data': (('2025/05/15/', 0.975208), ('2025/05/14/', 0.977234), ('2025/05/13/', 0.974699), ('2025/05/12/', 0.975848), ('2025/05/10/', 1.0), ('2025/05/09/', 0.975544), ('2025/05/08/', 0.974826), ('2025/05/07/', 0.971782), ('2025/05/06/', 0.978738), ('2025/05/05/', 0.977456), ('2025/05/03/', 0.975332), ('2025/05/02/', 0.974502), ('2025/05/01/', 0.977905)), 'impurety_average_data': ((datetime.date(2025, 5, 1), 0.0517629800070253, 804), (datetime.date(2025, 5, 2), 0.05416864639025957, 2980), (datetime.date(2025, 5, 3), 0.052184404660923736, 736), (datetime.date(2025, 5, 5), 0.044745248246737576, 3142), (datetime.date(2025, 5, 6), 0.04264769458623977, 3723), (datetime.date(2025, 5, 7), 0.0432984921811175, 4348), (datetime.date(2025, 5, 8), 0.047808357200980665, 19), (datetime.date(2025, 5, 9), 0.0453137066219222, 3653), (datetime.date(2025, 5, 10), 0.0453060504385659, 727), (datetime.date(2025, 5, 12), 0.04370732101421575, 3554), (datetime.date(2025, 5, 13), 0.04600209756769339, 3236), (datetime.date(2025, 5, 14), 0.04725385342006534, 3248), (datetime.date(2025, 5, 15), 0.04537503618306493, 3743), (datetime.date(2025, 5, 16), 0.0450615749650272, 4102)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 5, 1), 0.0517629800070253, 804), (datetime.date(2025, 5, 2), 0.05416864639025957, 2980), (datetime.date(2025, 5, 3), 0.052184404660923736, 736), (datetime.date(2025, 5, 5), 0.044745248246737576, 3142), (datetime.date(2025, 5, 6), 0.04264769458623977, 3723), (datetime.date(2025, 5, 7), 0.0432984921811175, 4348), (datetime.date(2025, 5, 8), 0.047808357200980665, 19), (datetime.date(2025, 5, 9), 0.0453137066219222, 3653), (datetime.date(2025, 5, 10), 0.0453060504385659, 727), (datetime.date(2025, 5, 12), 0.04370732101421575, 3554), (datetime.date(2025, 5, 13), 0.04600209756769339, 3236), (datetime.date(2025, 5, 14), 0.04725385342006534, 3248), (datetime.date(2025, 5, 15), 0.04537503618306493, 3743), (datetime.date(2025, 5, 16), 0.0450615749650272, 4102))}, 'quality_array': [['-4.491755057322415', '01052025'], ['-4.6494079839349665', '02052025'], ['-4.737289055724324', '03052025'], ['-4.641189930158067', '05052025'], ['-4.467853996790199', '06052025'], ['-4.631018616181677', '07052025'], ['-4.28603021073238', '08052025'], ['-4.6102238743028225', '09052025'], ['-4.443015436351809', '10052025'], ['-4.498218263762559', '12052025'], ['-4.554868263829699', '13052025'], ['-4.519909800035487', '14052025'], ['-4.447863601413848', '15052025'], ['-4.53002145970041', '16052025'], ['-2.6838061134858844', '17052025']], 'number_of_batch': ((668,),), 'datou_id_sts': 4878, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.004159077379151244, 'nb_photo': 4373, 'list_port_cont': '22572531,22573123,22573357,22573784,22574442,22574828,22575328,22575765,22576307,22576612,22577102,22577652,22578172,22578592,22579106,22589206,22589350,22589756,22590364,22590745,22590874,22591366,22591664,22592229,22592673,22593237,22593642,22594250,22594941,22595308,22596869,22597378,22597864,22598413,22598744,22599231,22599855,22600276,22600829,22601407,22601896,22604802,22605141,22605714,22606063,22606911,22607994,22608555,22609418,22609805,22610463,22611029,22611700,22613024,22613780,22614376,22615190,22615963,22616563,22617302,22618021,22618592,22619087,22619812,22620539,22620877,22621333,22622041,22622509,22623241,22624057,22624881,22625745,22626327,22627174,22627843,22628428,22628934,22629382,22629928,22630629,22630894,22631545,22631979,22632907,22633456,22634232,22634763,22635245,22635599,22636132,22656523,22656769,22657139,22657386,22658144,22658630,22658921,22659340,22659921,22660404,22660890,22661474,22662015,22662607,22662983,22663759,22665506,22666118,22666605,22667073,22667560,22668068,2266887', 'assoc_port': '22572496:22572531,22573115:22573123,22573326:22573357,22573742:22573784,22574433:22574442,22574815:22574828,22575317:22575328,22575738:22575765,22576269:22576307,22576604:22576612,22577091:22577102,22577585:22577652,22578157:22578172,22578558:22578592,22579061:22579106,22589204:22589206,22589345:22589350,22589743:22589756,22590338:22590364,22590734:22590745,22590863:22590874,22591348:22591366,22591636:22591664,22592221:22592229,22592634:22592673,22593197:22593237,22593637:22593642,22594215:22594250,22594939:22594941,22595293:22595308,22596857:22596869,22597376:22597378,22597852:22597864,22598402:22598413,22598714:22598744,22599216:22599231,22599783:22599855,22600238:22600276,22600776:22600829,22601365:22601407,22601825:22601896,22604792:22604802,22605092:22605141,22605713:22605714,22606058:22606063,22606881:22606911,22607985:22607994,22608501:22608555,22609408:22609418,22609715:22609805,22610437:22610463,22610994:22611029,22611606:22611700,22613023:22613024,22613686:22613780,22614349:22614376,22615158:2261519', 'assoc_mat': '22572496:autre_refus:3726:22572531,22573115:autre_refus:3726:22573123,22573326:autre_refus:3726:22573357,22573742:autre_refus:3726:22573784,22574433:autre_refus:3726:22574442,22574815:autre_refus:3726:22574828,22575317:autre_refus:3726:22575328,22575738:autre_refus:3726:22575765,22576269:autre_refus:3726:22576307,22576604:autre_refus:3726:22576612,22577091:autre_refus:3726:22577102,22577585:autre_refus:3726:22577652,22578157:autre_refus:3726:22578172,22578558:autre_refus:3726:22578592,22579061:autre_refus:3726:22579106,22589204:autre_refus:3726:22589206,22589345:autre_refus:3726:22589350,22589743:autre_refus:3726:22589756,22590338:autre_refus:3726:22590364,22590734:autre_refus:3726:22590745,22590863:autre_refus:3726:22590874,22591348:autre_refus:3726:22591366,22591636:autre_refus:3726:22591664,22592221:autre_refus:3726:22592229,22592634:autre_refus:3726:22592673,22593197:autre_refus:3726:22593237,22593637:autre_refus:3726:22593642,22594215:autre_refus:3726:22594250,22594939:autre_refus:3726:22594941,22595293:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0054072875288875884, 'nb_photo': 7088, 'list_port_cont': '22572532,22573126,22573359,22573779,22574436,22574830,22575326,22575772,22576300,22576611,22577100,22577650,22578167,22578593,22579108,22589355,22589747,22590365,22590741,22590864,22591360,22591667,22592236,22592678,22593234,22593651,22594256,22594948,22595302,22596863,22597377,22597863,22598412,22598748,22599227,22599845,22600279,22600825,22601396,22601892,22604804,22605145,22605720,22606068,22606910,22607990,22608547,22609410,22609810,22610466,22611034,22611702,22613031,22613774,22614378,22615191,22615957,22616560,22617306,22618031,22618589,22619091,22619815,22620542,22620886,22621332,22622047,22622512,22623242,22624058,22624878,22625743,22626323,22627175,22627849,22628427,22628941,22629381,22629930,22630632,22630897,22631555,22631973,22632910,22633447,22634235,22634754,22635242,22635608,22636133,22656513,22656773,22657138,22657379,22658141,22658628,22658918,22659336,22659925,22660409,22660893,22661473,22662023,22662606,22662988,22663768,22665505,22666123,22666604,22667082,22667555,22668071,22668871,2266951', 'assoc_port': '22572496:22572532,22573115:22573126,22573326:22573359,22573742:22573779,22574433:22574436,22574815:22574830,22575317:22575326,22575738:22575772,22576269:22576300,22576604:22576611,22577091:22577100,22577585:22577650,22578157:22578167,22578558:22578593,22579061:22579108,22589345:22589355,22589743:22589747,22590338:22590365,22590734:22590741,22590863:22590864,22591348:22591360,22591636:22591667,22592221:22592236,22592634:22592678,22593197:22593234,22593637:22593651,22594215:22594256,22594939:22594948,22595293:22595302,22596857:22596863,22597376:22597377,22597852:22597863,22598402:22598412,22598714:22598748,22599216:22599227,22599783:22599845,22600238:22600279,22600776:22600825,22601365:22601396,22601825:22601892,22604792:22604804,22605092:22605145,22605713:22605720,22606058:22606068,22606881:22606910,22607985:22607990,22608501:22608547,22609408:22609410,22609715:22609810,22610437:22610466,22610994:22611034,22611606:22611702,22613023:22613031,22613686:22613774,22614349:22614378,22615158:22615191,22615897:2261595', 'assoc_mat': '22572496:cartonnette:3726:22572532,22573115:cartonnette:3726:22573126,22573326:cartonnette:3726:22573359,22573742:cartonnette:3726:22573779,22574433:cartonnette:3726:22574436,22574815:cartonnette:3726:22574830,22575317:cartonnette:3726:22575326,22575738:cartonnette:3726:22575772,22576269:cartonnette:3726:22576300,22576604:cartonnette:3726:22576611,22577091:cartonnette:3726:22577100,22577585:cartonnette:3726:22577650,22578157:cartonnette:3726:22578167,22578558:cartonnette:3726:22578593,22579061:cartonnette:3726:22579108,22589345:cartonnette:3726:22589355,22589743:cartonnette:3726:22589747,22590338:cartonnette:3726:22590365,22590734:cartonnette:3726:22590741,22590863:cartonnette:3726:22590864,22591348:cartonnette:3726:22591360,22591636:cartonnette:3726:22591667,22592221:cartonnette:3726:22592236,22592634:cartonnette:3726:22592678,22593197:cartonnette:3726:22593234,22593637:cartonnette:3726:22593651,22594215:cartonnette:3726:22594256,22594939:cartonnette:3726:22594948,22595293:cartonnette:3726:22595302,22596857:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.014560488363956393, 'nb_photo': 6465, 'list_port_cont': '22572526,22573128,22573368,22573782,22574443,22574824,22575324,22575768,22576309,22576607,22577093,22577646,22578162,22578591,22579112,22589211,22589347,22589757,22590368,22590744,22590872,22591365,22591666,22592235,22592681,22593229,22593652,22594255,22594947,22595309,22596865,22597384,22597865,22598416,22598749,22599226,22599846,22600268,22600826,22601403,22601900,22604794,22605140,22605723,22606074,22606906,22607995,22608557,22609417,22609808,22610457,22611030,22611703,22613025,22613771,22614383,22615197,22615958,22616557,22617301,22618022,22618595,22619082,22619813,22620541,22620880,22621326,22622042,22622505,22623233,22624060,22624879,22625739,22626320,22627179,22627847,22628433,22628943,22629379,22629924,22630623,22630891,22631551,22631972,22632913,22633451,22634226,22634753,22635246,22635601,22636129,22656520,22656778,22657129,22657384,22658139,22658632,22658917,22659337,22659927,22660410,22660892,22661480,22662012,22662610,22662985,22663764,22665503,22666114,22666596,22667074,22667558,22668074,2266886', 'assoc_port': '22572496:22572526,22573115:22573128,22573326:22573368,22573742:22573782,22574433:22574443,22574815:22574824,22575317:22575324,22575738:22575768,22576269:22576309,22576604:22576607,22577091:22577093,22577585:22577646,22578157:22578162,22578558:22578591,22579061:22579112,22589204:22589211,22589345:22589347,22589743:22589757,22590338:22590368,22590734:22590744,22590863:22590872,22591348:22591365,22591636:22591666,22592221:22592235,22592634:22592681,22593197:22593229,22593637:22593652,22594215:22594255,22594939:22594947,22595293:22595309,22596857:22596865,22597376:22597384,22597852:22597865,22598402:22598416,22598714:22598749,22599216:22599226,22599783:22599846,22600238:22600268,22600776:22600826,22601365:22601403,22601825:22601900,22604792:22604794,22605092:22605140,22605713:22605723,22606058:22606074,22606881:22606906,22607985:22607995,22608501:22608557,22609408:22609417,22609715:22609808,22610437:22610457,22610994:22611030,22611606:22611703,22613023:22613025,22613686:22613771,22614349:22614383,22615158:2261519', 'assoc_mat': '22572496:Carton_brun:3726:22572526,22573115:Carton_brun:3726:22573128,22573326:Carton_brun:3726:22573368,22573742:Carton_brun:3726:22573782,22574433:Carton_brun:3726:22574443,22574815:Carton_brun:3726:22574824,22575317:Carton_brun:3726:22575324,22575738:Carton_brun:3726:22575768,22576269:Carton_brun:3726:22576309,22576604:Carton_brun:3726:22576607,22577091:Carton_brun:3726:22577093,22577585:Carton_brun:3726:22577646,22578157:Carton_brun:3726:22578162,22578558:Carton_brun:3726:22578591,22579061:Carton_brun:3726:22579112,22589204:Carton_brun:3726:22589211,22589345:Carton_brun:3726:22589347,22589743:Carton_brun:3726:22589757,22590338:Carton_brun:3726:22590368,22590734:Carton_brun:3726:22590744,22590863:Carton_brun:3726:22590872,22591348:Carton_brun:3726:22591365,22591636:Carton_brun:3726:22591666,22592221:Carton_brun:3726:22592235,22592634:Carton_brun:3726:22592681,22593197:Carton_brun:3726:22593229,22593637:Carton_brun:3726:22593652,22594215:Carton_brun:3726:22594255,22594939:Carton_brun:3726:22594947,22595293:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007544476649318626, 'nb_photo': 7069, 'list_port_cont': '22572527,22573121,22573362,22573778,22574441,22574823,22575321,22575763,22576299,22576606,22577095,22577655,22578165,22578588,22579113,22589210,22589356,22589752,22590371,22590747,22590867,22591361,22591670,22592228,22592672,22593228,22593649,22594246,22594950,22595301,22596861,22597383,22597857,22598410,22598743,22599223,22599843,22600277,22600820,22601404,22601893,22604799,22605724,22606069,22606907,22607997,22608553,22609412,22609804,22610461,22611023,22611697,22613032,22613778,22614384,22615189,22615960,22616566,22617300,22618027,22618600,22619090,22619816,22620543,22620888,22621325,22622045,22622513,22623235,22624056,22624888,22625741,22626328,22627172,22627840,22628430,22628937,22629380,22629929,22630631,22630888,22631552,22631982,22632909,22633448,22634236,22634757,22635241,22635606,22636131,22656522,22656768,22657133,22657382,22658146,22658623,22658920,22659341,22659922,22660408,22660897,22661471,22662017,22662609,22662987,22663761,22665504,22666115,22666595,22667072,22667553,22668063,22668865,2266951', 'assoc_port': '22572496:22572527,22573115:22573121,22573326:22573362,22573742:22573778,22574433:22574441,22574815:22574823,22575317:22575321,22575738:22575763,22576269:22576299,22576604:22576606,22577091:22577095,22577585:22577655,22578157:22578165,22578558:22578588,22579061:22579113,22589204:22589210,22589345:22589356,22589743:22589752,22590338:22590371,22590734:22590747,22590863:22590867,22591348:22591361,22591636:22591670,22592221:22592228,22592634:22592672,22593197:22593228,22593637:22593649,22594215:22594246,22594939:22594950,22595293:22595301,22596857:22596861,22597376:22597383,22597852:22597857,22598402:22598410,22598714:22598743,22599216:22599223,22599783:22599843,22600238:22600277,22600776:22600820,22601365:22601404,22601825:22601893,22604792:22604799,22605713:22605724,22606058:22606069,22606881:22606907,22607985:22607997,22608501:22608553,22609408:22609412,22609715:22609804,22610437:22610461,22610994:22611023,22611606:22611697,22613023:22613032,22613686:22613778,22614349:22614384,22615158:22615189,22615897:2261596', 'assoc_mat': '22572496:Carton_gris:3726:22572527,22573115:Carton_gris:3726:22573121,22573326:Carton_gris:3726:22573362,22573742:Carton_gris:3726:22573778,22574433:Carton_gris:3726:22574441,22574815:Carton_gris:3726:22574823,22575317:Carton_gris:3726:22575321,22575738:Carton_gris:3726:22575763,22576269:Carton_gris:3726:22576299,22576604:Carton_gris:3726:22576606,22577091:Carton_gris:3726:22577095,22577585:Carton_gris:3726:22577655,22578157:Carton_gris:3726:22578165,22578558:Carton_gris:3726:22578588,22579061:Carton_gris:3726:22579113,22589204:Carton_gris:3726:22589210,22589345:Carton_gris:3726:22589356,22589743:Carton_gris:3726:22589752,22590338:Carton_gris:3726:22590371,22590734:Carton_gris:3726:22590747,22590863:Carton_gris:3726:22590867,22591348:Carton_gris:3726:22591361,22591636:Carton_gris:3726:22591670,22592221:Carton_gris:3726:22592228,22592634:Carton_gris:3726:22592672,22593197:Carton_gris:3726:22593228,22593637:Carton_gris:3726:22593649,22594215:Carton_gris:3726:22594246,22594939:Carton_gris:3726:22594950,22595293:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0018355330311349211, 'nb_photo': 1102, 'list_port_cont': '22575322,22575767,22576306,22576608,22577104,22577653,22579114,22589212,22589353,22589753,22590370,22591359,22591672,22592230,22592675,22593650,22594951,22595300,22596866,22597386,22597856,22598747,22599850,22600819,22601406,22601897,22604793,22605725,22606073,22608552,22609409,22610462,22611701,22613775,22614374,22615187,22616565,22618032,22618598,22619081,22619817,22620533,22620883,22621330,22622504,22623240,22624054,22624880,22627176,22627841,22628429,22628938,22629931,22630898,22631548,22631978,22632914,22633453,22634234,22634764,22635238,22636135,22656516,22657140,22658624,22659333,22660412,22660891,22661478,22662019,22662604,22662986,22663766,22665509,22666116,22666602,22667081,22667550,22668070,22668864,22669515,22669924,22670710,22671382,22674915,22675873,22676672,22677436,22679024,22679764,22680708,22681692,22682469,22683307,22687879,22688523,22690241,22690957,22692347,22693009,22693815,22694858,22703243,22704052,22704436,22705002,22705531,22706332,22707088,22707643,22708176,22708840,22709629,2271015', 'assoc_port': '22575317:22575322,22575738:22575767,22576269:22576306,22576604:22576608,22577091:22577104,22577585:22577653,22579061:22579114,22589204:22589212,22589345:22589353,22589743:22589753,22590338:22590370,22591348:22591359,22591636:22591672,22592221:22592230,22592634:22592675,22593637:22593650,22594939:22594951,22595293:22595300,22596857:22596866,22597376:22597386,22597852:22597856,22598714:22598747,22599783:22599850,22600776:22600819,22601365:22601406,22601825:22601897,22604792:22604793,22605713:22605725,22606058:22606073,22608501:22608552,22609408:22609409,22610437:22610462,22611606:22611701,22613686:22613775,22614349:22614374,22615158:22615187,22616551:22616565,22618017:22618032,22618470:22618598,22619074:22619081,22619744:22619817,22620531:22620533,22620848:22620883,22621300:22621330,22622472:22622504,22623210:22623240,22624019:22624054,22624848:22624880,22627137:22627176,22627814:22627841,22628404:22628429,22628933:22628938,22629887:22629931,22630857:22630898,22631507:22631548,22631970:22631978,22632867:2263291', 'assoc_mat': '22575317:kraft:3726:22575322,22575738:kraft:3726:22575767,22576269:kraft:3726:22576306,22576604:kraft:3726:22576608,22577091:kraft:3726:22577104,22577585:kraft:3726:22577653,22579061:kraft:3726:22579114,22589204:kraft:3726:22589212,22589345:kraft:3726:22589353,22589743:kraft:3726:22589753,22590338:kraft:3726:22590370,22591348:kraft:3726:22591359,22591636:kraft:3726:22591672,22592221:kraft:3726:22592230,22592634:kraft:3726:22592675,22593637:kraft:3726:22593650,22594939:kraft:3726:22594951,22595293:kraft:3726:22595300,22596857:kraft:3726:22596866,22597376:kraft:3726:22597386,22597852:kraft:3726:22597856,22598714:kraft:3726:22598747,22599783:kraft:3726:22599850,22600776:kraft:3726:22600819,22601365:kraft:3726:22601406,22601825:kraft:3726:22601897,22604792:kraft:3726:22604793,22605713:kraft:3726:22605725,22606058:kraft:3726:22606073,22608501:kraft:3726:22608552,22609408:kraft:3726:22609409,22610437:kraft:3726:22610462,22611606:kraft:3726:22611701,22613686:kraft:3726:22613775,22614349:kraft:3726:22614374,22615158:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0007788010285389047, 'nb_photo': 272, 'list_port_cont': '22573788,22574435,22577649,22579105,22590374,22590865,22592676,22594943,22595304,22596867,22598754,22601405,22610458,22618597,22619818,22622503,22625752,22630624,22630896,22633446,22634228,22634755,22635243,22658145,22658912,22659330,22660406,22661475,22662020,22662600,22662991,22666597,22669925,22675739,22676681,22677444,22682474,22687881,22689533,22690235,22692350,22693012,22703007,22704999,22705751,22707635,22710148,22710585,22717043,22718266,22720139,22720564,22721864,22723708,22724657,22725265,22725402,22726766,22740064,22741237,22742327,22743961,22744871,22745555,22745942,22747369,22748293,22750054,22750675,22751208,22752003,22752196,22752584,22753269,22755049,22755620,22756949,22759302,22759921,22761463,22761970,22763339,22769483,22771153,22772495,22774634,22779448,22780668,22809507,22810342,22810823,22811276,22811691,22813783,22814429,22820064,22820753,22822287,22828558,22830665,22831124,22831643,22832357,22833222,22834839,22836605,22837274,22840108,22842275,22842652,22847348,22851848,22853074,2285438', 'assoc_port': '22573742:22573788,22574433:22574435,22577585:22577649,22579061:22579105,22590338:22590374,22590863:22590865,22592634:22592676,22594939:22594943,22595293:22595304,22596857:22596867,22598714:22598754,22601365:22601405,22610437:22610458,22618470:22618597,22619744:22619818,22622472:22622503,22625733:22625752,22630596:22630624,22630857:22630896,22633414:22633446,22634144:22634228,22634720:22634755,22635212:22635243,22658111:22658145,22658886:22658912,22659324:22659330,22660372:22660406,22661429:22661475,22661981:22662020,22662597:22662600,22662926:22662991,22666582:22666597,22669909:22669925,22675633:22675739,22676642:22676681,22677428:22677444,22682426:22682474,22687701:22687881,22689449:22689533,22690184:22690235,22692320:22692350,22692960:22693012,22702995:22703007,22704969:22704999,22705714:22705751,22707600:22707635,22710140:22710148,22710502:22710585,22716945:22717043,22718167:22718266,22720089:22720139,22720474:22720564,22721783:22721864,22723569:22723708,22724626:22724657,22725167:22725402,22725184:2272526', 'assoc_mat': '22573742:metal:3726:22573788,22574433:metal:3726:22574435,22577585:metal:3726:22577649,22579061:metal:3726:22579105,22590338:metal:3726:22590374,22590863:metal:3726:22590865,22592634:metal:3726:22592676,22594939:metal:3726:22594943,22595293:metal:3726:22595304,22596857:metal:3726:22596867,22598714:metal:3726:22598754,22601365:metal:3726:22601405,22610437:metal:3726:22610458,22618470:metal:3726:22618597,22619744:metal:3726:22619818,22622472:metal:3726:22622503,22625733:metal:3726:22625752,22630596:metal:3726:22630624,22630857:metal:3726:22630896,22633414:metal:3726:22633446,22634144:metal:3726:22634228,22634720:metal:3726:22634755,22635212:metal:3726:22635243,22658111:metal:3726:22658145,22658886:metal:3726:22658912,22659324:metal:3726:22659330,22660372:metal:3726:22660406,22661429:metal:3726:22661475,22661981:metal:3726:22662020,22662597:metal:3726:22662600,22662926:metal:3726:22662991,22666582:metal:3726:22666597,22669909:metal:3726:22669925,22675633:metal:3726:22675739,22676642:metal:3726:22676681,22677428:'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.003856822478184073, 'nb_photo': 4449, 'list_port_cont': '22572529,22573120,22573365,22573781,22574438,22574831,22575330,22575773,22576302,22576615,22577098,22577656,22578166,22578589,22579111,22589208,22589351,22589749,22590375,22590740,22590873,22591356,22591668,22592233,22592674,22593238,22593647,22594247,22594949,22595299,22596862,22597382,22598406,22598750,22599222,22599854,22600273,22600828,22601400,22601891,22604801,22605142,22605715,22606903,22607996,22608551,22609419,22609815,22610459,22611028,22611699,22613033,22613777,22614381,22615188,22615954,22616558,22617309,22618025,22618594,22619089,22619810,22620540,22620879,22621331,22622038,22622507,22623236,22624050,22624884,22625750,22626319,22627169,22627851,22628431,22628935,22629376,22629935,22630627,22630890,22631547,22631981,22632912,22633450,22634233,22634762,22635247,22635607,22636134,22656517,22656770,22657137,22657383,22658147,22658627,22658916,22659332,22659928,22660411,22660899,22661472,22662022,22662608,22662989,22663763,22665508,22666119,22666603,22667077,22667554,22668067,22668862,22669524,2266992', 'assoc_port': '22572496:22572529,22573115:22573120,22573326:22573365,22573742:22573781,22574433:22574438,22574815:22574831,22575317:22575330,22575738:22575773,22576269:22576302,22576604:22576615,22577091:22577098,22577585:22577656,22578157:22578166,22578558:22578589,22579061:22579111,22589204:22589208,22589345:22589351,22589743:22589749,22590338:22590375,22590734:22590740,22590863:22590873,22591348:22591356,22591636:22591668,22592221:22592233,22592634:22592674,22593197:22593238,22593637:22593647,22594215:22594247,22594939:22594949,22595293:22595299,22596857:22596862,22597376:22597382,22598402:22598406,22598714:22598750,22599216:22599222,22599783:22599854,22600238:22600273,22600776:22600828,22601365:22601400,22601825:22601891,22604792:22604801,22605092:22605142,22605713:22605715,22606881:22606903,22607985:22607996,22608501:22608551,22609408:22609419,22609715:22609815,22610437:22610459,22610994:22611028,22611606:22611699,22613023:22613033,22613686:22613777,22614349:22614381,22615158:22615188,22615897:22615954,22616551:2261655', 'assoc_mat': '22572496:plastique:3726:22572529,22573115:plastique:3726:22573120,22573326:plastique:3726:22573365,22573742:plastique:3726:22573781,22574433:plastique:3726:22574438,22574815:plastique:3726:22574831,22575317:plastique:3726:22575330,22575738:plastique:3726:22575773,22576269:plastique:3726:22576302,22576604:plastique:3726:22576615,22577091:plastique:3726:22577098,22577585:plastique:3726:22577656,22578157:plastique:3726:22578166,22578558:plastique:3726:22578589,22579061:plastique:3726:22579111,22589204:plastique:3726:22589208,22589345:plastique:3726:22589351,22589743:plastique:3726:22589749,22590338:plastique:3726:22590375,22590734:plastique:3726:22590740,22590863:plastique:3726:22590873,22591348:plastique:3726:22591356,22591636:plastique:3726:22591668,22592221:plastique:3726:22592233,22592634:plastique:3726:22592674,22593197:plastique:3726:22593238,22593637:plastique:3726:22593647,22594215:plastique:3726:22594247,22594939:plastique:3726:22594949,22595293:plastique:3726:22595299,22596857:plastique:3726:22596862,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.01315606130266256, 'nb_photo': 11572, 'list_port_cont': '22572522,22573130,22573364,22573780,22574444,22574826,22575331,22575769,22576301,22576605,22577103,22577657,22578171,22578586,22579107,22589207,22589354,22589751,22590373,22590738,22590875,22591367,22591661,22592234,22592680,22593227,22593653,22594254,22594940,22595306,22596864,22597385,22597855,22598415,22598746,22599221,22599851,22600274,22600824,22601402,22601894,22604796,22605144,22605719,22606070,22606909,22607992,22608558,22609411,22609811,22610460,22611026,22611704,22613026,22613779,22614375,22615193,22615952,22616561,22617298,22618023,22618599,22619080,22619819,22620532,22620882,22621328,22622039,22622510,22623244,22624055,22624887,22625735,22626325,22627170,22627845,22628422,22628939,22629372,22629934,22630630,22630892,22631546,22631974,22632911,22633449,22634229,22634758,22635244,22635597,22636128,22656515,22656771,22657134,22657381,22658143,22658629,22658913,22659331,22659924,22660413,22660898,22661470,22662014,22662602,22662992,22663760,22665510,22666124,22666598,22667079,22667556,22668065,2266886', 'assoc_port': '22572496:22572522,22573115:22573130,22573326:22573364,22573742:22573780,22574433:22574444,22574815:22574826,22575317:22575331,22575738:22575769,22576269:22576301,22576604:22576605,22577091:22577103,22577585:22577657,22578157:22578171,22578558:22578586,22579061:22579107,22589204:22589207,22589345:22589354,22589743:22589751,22590338:22590373,22590734:22590738,22590863:22590875,22591348:22591367,22591636:22591661,22592221:22592234,22592634:22592680,22593197:22593227,22593637:22593653,22594215:22594254,22594939:22594940,22595293:22595306,22596857:22596864,22597376:22597385,22597852:22597855,22598402:22598415,22598714:22598746,22599216:22599221,22599783:22599851,22600238:22600274,22600776:22600824,22601365:22601402,22601825:22601894,22604792:22604796,22605092:22605144,22605713:22605719,22606058:22606070,22606881:22606909,22607985:22607992,22608501:22608558,22609408:22609411,22609715:22609811,22610437:22610460,22610994:22611026,22611606:22611704,22613023:22613026,22613686:22613779,22614349:22614375,22615158:2261519', 'assoc_mat': '22572496:Teint_Dans_La_Masse:3726:22572522,22573115:Teint_Dans_La_Masse:3726:22573130,22573326:Teint_Dans_La_Masse:3726:22573364,22573742:Teint_Dans_La_Masse:3726:22573780,22574433:Teint_Dans_La_Masse:3726:22574444,22574815:Teint_Dans_La_Masse:3726:22574826,22575317:Teint_Dans_La_Masse:3726:22575331,22575738:Teint_Dans_La_Masse:3726:22575769,22576269:Teint_Dans_La_Masse:3726:22576301,22576604:Teint_Dans_La_Masse:3726:22576605,22577091:Teint_Dans_La_Masse:3726:22577103,22577585:Teint_Dans_La_Masse:3726:22577657,22578157:Teint_Dans_La_Masse:3726:22578171,22578558:Teint_Dans_La_Masse:3726:22578586,22579061:Teint_Dans_La_Masse:3726:22579107,22589204:Teint_Dans_La_Masse:3726:22589207,22589345:Teint_Dans_La_Masse:3726:22589354,22589743:Teint_Dans_La_Masse:3726:22589751,22590338:Teint_Dans_La_Masse:3726:22590373,22590734:Teint_Dans_La_Masse:3726:22590738,22590863:Teint_Dans_La_Masse:3726:22590875,22591348:Teint_Dans_La_Masse:3726:22591367,22591636:Teint_Dans_La_Masse:3726:22591661,22592221:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 38285}}, 'hostname': (('jetson-73',),), 'impurety_average_per_hashtag': [(('JRM', '2025-05', 0.04592301469143381),)]} filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_05_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '0.42%', 4373], 'cartonnette': ['cartonnette', '0.54%', 7088], 'Carton_brun': ['Carton_brun', '1.46%', 6465], 'Carton_gris': ['Carton_gris', '0.75%', 7069], 'kraft': ['kraft', '0.18%', 1102], 'metal': ['metal', '0.08%', 272], 'plastique': ['plastique', '0.39%', 4449], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '1.32%', 11572]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm/sla_mensuel_arc_en_ciel_jrm_mois_05_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/arc_en_ciel_jrm 2.58user 2.93system 0:12.16elapsed 45%CPU (0avgtext+0avgdata 192436maxresident)k 20112inputs+432outputs (86major+68240minor)pagefaults 0swaps