python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20084 --dashboard_places=dechet_Valcor_v2 --rootfolder_sla=/data_4/data_log/job/memo/dechet_Valcor_v2 -v --mtr_id=1055 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : 2025-09 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (0, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (0, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 132 month : 09 mtr_id : 1055 dashboard_places : dechet_Valcor_v2 date : 2025-09 year : 2025 raspi : 20084 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'dechet_Valcor_v2' and date like '%2025-09%') and created_at like '%2025-09%'))); nb_day : (0, 30) after unwanted_material_data nb_day : (0, 30) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20084%' AND ms.result_str like '%2025/09%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 2123, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21230 seconds', 'coverage_times_pause': '0 days 42460 seconds', 'nb_photos_decision': 2126, 'nb_gray_level_ok': 2126, 'nb_dedup_ok': 1969, 'nb_two_criteria_ok': 1969, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 157, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1962, 'ratio_coverage': 0.24572043657912707}, 'dashboard_dict': {'nb_ptf_finished': 18, 'nb_images_finished': 79, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 79, 'last_update': '2025/09/21', 'portfolio_id': 27065468, 'last_run_id': 2335401, 'total_number_of_photos': 1967}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2027, 'nb_two_criteria_ok': 2027, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 94, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2023, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 107, 'nb_images_finished': 717, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 717, 'last_update': '2025/09/20', 'portfolio_id': 27023175, 'last_run_id': 2333317, 'total_number_of_photos': 2028}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 2037, 'nb_two_criteria_ok': 2037, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 82, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 558, 'last_update': '2025/09/20', 'portfolio_id': 26986794, 'last_run_id': 2333327, 'total_number_of_photos': 2037}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2006, 'nb_two_criteria_ok': 2006, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2000, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/09/18', 'portfolio_id': 26923742, 'last_run_id': 2319011, 'total_number_of_photos': 2005}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2020, 'nb_two_criteria_ok': 2020, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2017, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 74, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 442, 'last_update': '2025/09/17', 'portfolio_id': 26873513, 'last_run_id': 2310547, 'total_number_of_photos': 2022}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2303223, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2027, 'nb_two_criteria_ok': 2027, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 94, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2023, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 107, 'nb_images_finished': 717, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 717, 'last_update': '2025/09/20', 'portfolio_id': 27023175, 'last_run_id': 2332833, 'total_number_of_photos': 2028}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 2037, 'nb_two_criteria_ok': 2037, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 82, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 558, 'last_update': '2025/09/19', 'portfolio_id': 26986794, 'last_run_id': 2325153, 'total_number_of_photos': 2037}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2006, 'nb_two_criteria_ok': 2006, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2000, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/09/18', 'portfolio_id': 26923742, 'last_run_id': 2319011, 'total_number_of_photos': 2005}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2020, 'nb_two_criteria_ok': 2020, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2017, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 74, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 442, 'last_update': '2025/09/17', 'portfolio_id': 26873513, 'last_run_id': 2310547, 'total_number_of_photos': 2022}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2303223, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2119, 'nb_gray_level_ok': 2119, 'nb_dedup_ok': 2037, 'nb_two_criteria_ok': 2037, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 82, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 79, 'nb_images_finished': 558, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 558, 'last_update': '2025/09/19', 'portfolio_id': 26986794, 'last_run_id': 2325153, 'total_number_of_photos': 2037}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2006, 'nb_two_criteria_ok': 2006, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2000, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 407, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 407, 'last_update': '2025/09/18', 'portfolio_id': 26923742, 'last_run_id': 2319011, 'total_number_of_photos': 2005}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2020, 'nb_two_criteria_ok': 2020, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2017, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 74, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 442, 'last_update': '2025/09/17', 'portfolio_id': 26873513, 'last_run_id': 2310547, 'total_number_of_photos': 2022}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2303223, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2006, 'nb_two_criteria_ok': 2006, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 115, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2000, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 64, 'nb_images_finished': 378, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 29, 'nb_selected_images': 407, 'last_update': '2025/09/18', 'portfolio_id': 26923742, 'last_run_id': 2317485, 'total_number_of_photos': 2005}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2020, 'nb_two_criteria_ok': 2020, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2017, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 74, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 442, 'last_update': '2025/09/17', 'portfolio_id': 26873513, 'last_run_id': 2310547, 'total_number_of_photos': 2022}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2303223, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 57, 'nb_images_started': 340, 'nb_selected_images': 559, 'last_update': '2025/09/17', 'portfolio_id': 26741824, 'last_run_id': 2310569, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2122, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21220 seconds', 'coverage_times_pause': '0 days 42440 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2020, 'nb_two_criteria_ok': 2020, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 2017, 'ratio_coverage': 0.24560469449877892}, 'dashboard_dict': {'nb_ptf_finished': 74, 'nb_images_finished': 442, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 442, 'last_update': '2025/09/17', 'portfolio_id': 26873513, 'last_run_id': 2309579, 'total_number_of_photos': 2022}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2303223, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2118, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21180 seconds', 'coverage_times_pause': '0 days 42360 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2038, 'nb_two_criteria_ok': 2038, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2031, 'ratio_coverage': 0.2451417261773863}, 'dashboard_dict': {'nb_ptf_finished': 97, 'nb_images_finished': 730, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 730, 'last_update': '2025/09/16', 'portfolio_id': 26835681, 'last_run_id': 2301231, 'total_number_of_photos': 2036}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2295583, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2120, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21200 seconds', 'coverage_times_pause': '0 days 42400 seconds', 'nb_photos_decision': 2121, 'nb_gray_level_ok': 2121, 'nb_dedup_ok': 2041, 'nb_two_criteria_ok': 2041, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2036, 'ratio_coverage': 0.24537321033808263}, 'dashboard_dict': {'nb_ptf_finished': 14, 'nb_images_finished': 67, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 67, 'last_update': '2025/09/15', 'portfolio_id': 26834526, 'last_run_id': 2293577, 'total_number_of_photos': 2042}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2121, 'max_time_between_images': '0 days 140 seconds', 'coverage_pause': '0 days 21210 seconds', 'coverage_times_pause': '0 days 42420 seconds', 'nb_photos_decision': 2124, 'nb_gray_level_ok': 2124, 'nb_dedup_ok': 2021, 'nb_two_criteria_ok': 2021, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 103, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2014, 'ratio_coverage': 0.24548895241843077}, 'dashboard_dict': {'nb_ptf_finished': 12, 'nb_images_finished': 41, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 41, 'last_update': '2025/09/14', 'portfolio_id': 26821398, 'last_run_id': 2293263, 'total_number_of_photos': 2020}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2117, 'max_time_between_images': '0 days 139 seconds', 'coverage_pause': '0 days 21170 seconds', 'coverage_times_pause': '0 days 42340 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 2029, 'nb_two_criteria_ok': 2029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 89, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2024, 'ratio_coverage': 0.24502598409703816}, 'dashboard_dict': {'nb_ptf_finished': 68, 'nb_images_finished': 349, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 349, 'last_update': '2025/09/13', 'portfolio_id': 26774917, 'last_run_id': 2289833, 'total_number_of_photos': 2032}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 1971, 'max_time_between_images': '0 days 2900 seconds', 'coverage_pause': '0 days 19710 seconds', 'coverage_times_pause': '0 days 39420 seconds', 'nb_gray_level_ok': 0, 'nb_dedup_ok': 0, 'nb_two_criteria_ok': 0, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 52, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1915, 'ratio_coverage': 0.22812764036620795}, 'dashboard_dict': {'nb_ptf_finished': 13, 'nb_images_finished': 219, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 219, 'last_update': '2025/09/12', 'portfolio_id': 26741824, 'last_run_id': 2283097, 'total_number_of_photos': 1921}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2278543, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2083, 'max_time_between_images': '0 days 254 seconds', 'coverage_pause': '0 days 20830 seconds', 'coverage_times_pause': '0 days 41659 seconds', 'nb_photos_decision': 2084, 'nb_gray_level_ok': 2084, 'nb_dedup_ok': 2033, 'nb_two_criteria_ok': 2033, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 50, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 2028, 'ratio_coverage': 0.241090753365201}, 'dashboard_dict': {'nb_ptf_finished': 80, 'nb_images_finished': 581, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 581, 'last_update': '2025/09/11', 'portfolio_id': 26711112, 'last_run_id': 2277653, 'total_number_of_photos': 2034}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 5, 'nb_images_finished': 36, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 36, 'nb_images_started': 656, 'nb_selected_images': 692, 'last_update': '2025/09/10', 'portfolio_id': 26673019, 'last_run_id': 2270077, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/06', 'portfolio_id': 26519229, 'last_run_id': 2250767, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2065, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 20650 seconds', 'coverage_times_pause': '0 days 41299 seconds', 'nb_photos_decision': 2065, 'nb_gray_level_ok': 2065, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 83, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1978, 'ratio_coverage': 0.23900739591893425}, 'dashboard_dict': {'nb_ptf_finished': 3, 'nb_images_finished': 9, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 42, 'nb_selected_images': 51, 'last_update': '2025/09/09', 'portfolio_id': 26673019, 'last_run_id': 2264193, 'total_number_of_photos': 1982}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2263255, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/06', 'portfolio_id': 26519229, 'last_run_id': 2250767, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/05', 'portfolio_id': 26471136, 'last_run_id': 2243723, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2085, 'max_time_between_images': '0 days 161 seconds', 'coverage_pause': '0 days 20850 seconds', 'coverage_times_pause': '0 days 41699 seconds', 'nb_photos_decision': 2085, 'nb_gray_level_ok': 2085, 'nb_dedup_ok': 1929, 'nb_two_criteria_ok': 1929, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 156, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1922, 'ratio_coverage': 0.2413222375258973}, 'dashboard_dict': {'nb_ptf_finished': 76, 'nb_images_finished': 577, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 577, 'last_update': '2025/09/09', 'portfolio_id': 26625752, 'last_run_id': 2262517, 'total_number_of_photos': 1930}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/06', 'portfolio_id': 26519229, 'last_run_id': 2250767, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/05', 'portfolio_id': 26471136, 'last_run_id': 2243723, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/04', 'portfolio_id': 26422003, 'last_run_id': 2237645, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2100, 'max_time_between_images': '0 days 279 seconds', 'coverage_pause': '0 days 21000 seconds', 'coverage_times_pause': '0 days 42000 seconds', 'nb_photos_decision': 2097, 'nb_gray_level_ok': 2097, 'nb_dedup_ok': 1893, 'nb_two_criteria_ok': 1893, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 204, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_ok_for_neural_classification': 1, 'end_of_day_photos_uploaded': 1891, 'ratio_coverage': 0.24305836873111958}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 133, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 133, 'last_update': '2025/09/08', 'portfolio_id': 26618840, 'last_run_id': 2254603, 'total_number_of_photos': 1896}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/06', 'portfolio_id': 26519229, 'last_run_id': 2250767, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/05', 'portfolio_id': 26471136, 'last_run_id': 2243723, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/04', 'portfolio_id': 26422003, 'last_run_id': 2237645, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} No error ? {'log_dict': {'total_nb_images': 2088, 'max_time_between_images': '0 days 261 seconds', 'coverage_pause': '0 days 20880 seconds', 'coverage_times_pause': '0 days 41759 seconds', 'nb_photos_decision': 2087, 'nb_gray_level_ok': 2087, 'nb_dedup_ok': 1864, 'nb_two_criteria_ok': 1864, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 223, 'end_of_day_photos_nothing_done': 3, 'end_of_day_photos_uploaded': 1862, 'ratio_coverage': 0.24166946376694173}, 'dashboard_dict': {'nb_ptf_finished': 91, 'nb_images_finished': 784, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 784, 'last_update': '2025/09/07', 'portfolio_id': 26600249, 'last_run_id': 2253839, 'total_number_of_photos': 1863}} No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/06', 'portfolio_id': 26519229, 'last_run_id': 2250767, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/05', 'portfolio_id': 26471136, 'last_run_id': 2243723, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/04', 'portfolio_id': 26422003, 'last_run_id': 2237645, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2074, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 20740 seconds', 'coverage_times_pause': '0 days 41480 seconds', 'nb_photos_decision': 2077, 'nb_gray_level_ok': 2077, 'nb_dedup_ok': 1976, 'nb_two_criteria_ok': 1976, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 101, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1968, 'ratio_coverage': 0.24004907464206762}, 'dashboard_dict': {'nb_ptf_finished': 86, 'nb_images_finished': 738, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 738, 'last_update': '2025/09/06', 'portfolio_id': 26559151, 'last_run_id': 2250321, 'total_number_of_photos': 1974}} No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/05', 'portfolio_id': 26519229, 'last_run_id': 2242905, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/05', 'portfolio_id': 26471136, 'last_run_id': 2243723, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/04', 'portfolio_id': 26422003, 'last_run_id': 2237645, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2061, 'max_time_between_images': '0 days 322 seconds', 'coverage_pause': '0 days 20610 seconds', 'coverage_times_pause': '0 days 41220 seconds', 'nb_photos_decision': 2062, 'nb_gray_level_ok': 2062, 'nb_dedup_ok': 1982, 'nb_two_criteria_ok': 1982, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 80, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 3, 'end_of_day_photos_uploaded': 1977, 'ratio_coverage': 0.23854442759754163}, 'dashboard_dict': {'nb_ptf_finished': 71, 'nb_images_finished': 571, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 571, 'last_update': '2025/09/05', 'portfolio_id': 26519229, 'last_run_id': 2242905, 'total_number_of_photos': 1983}} No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/04', 'portfolio_id': 26471136, 'last_run_id': 2236971, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/04', 'portfolio_id': 26422003, 'last_run_id': 2237645, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2106, 'max_time_between_images': '0 days 159 seconds', 'coverage_pause': '0 days 21060 seconds', 'coverage_times_pause': '0 days 42120 seconds', 'nb_photos_decision': 2109, 'nb_gray_level_ok': 2109, 'nb_dedup_ok': 2069, 'nb_two_criteria_ok': 2069, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 40, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2063, 'ratio_coverage': 0.2437528212132085}, 'dashboard_dict': {'nb_ptf_finished': 93, 'nb_images_finished': 688, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 688, 'last_update': '2025/09/04', 'portfolio_id': 26471136, 'last_run_id': 2236971, 'total_number_of_photos': 2067}} No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/03', 'portfolio_id': 26422003, 'last_run_id': 2229517, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2110, 'max_time_between_images': '0 days 160 seconds', 'coverage_pause': '0 days 21100 seconds', 'coverage_times_pause': '0 days 42200 seconds', 'nb_photos_decision': 2111, 'nb_gray_level_ok': 2111, 'nb_dedup_ok': 2045, 'nb_two_criteria_ok': 2045, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 1, 'end_of_day_photos_duplicated': 66, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 2039, 'ratio_coverage': 0.2442157895346011}, 'dashboard_dict': {'nb_ptf_finished': 55, 'nb_images_finished': 231, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 231, 'last_update': '2025/09/03', 'portfolio_id': 26422003, 'last_run_id': 2229517, 'total_number_of_photos': 2045}} No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 2116, 'max_time_between_images': '0 days 157 seconds', 'coverage_pause': '0 days 21160 seconds', 'coverage_times_pause': '0 days 42320 seconds', 'nb_photos_decision': 2118, 'nb_gray_level_ok': 2118, 'nb_dedup_ok': 1960, 'nb_two_criteria_ok': 1960, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 158, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 1954, 'ratio_coverage': 0.24491024201669}, 'dashboard_dict': {'nb_ptf_finished': 59, 'nb_images_finished': 354, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 354, 'last_update': '2025/09/02', 'portfolio_id': 26381518, 'last_run_id': 2221863, 'total_number_of_photos': 1960}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-09-20 00:00:00 Found day : 2025-09-19 00:00:00 Found day : 2025-09-18 00:00:00 Found day : 2025-09-17 00:00:00 Found day : 2025-09-16 00:00:00 Found day : 2025-09-15 00:00:00 Found day : 2025-09-14 00:00:00 Found day : 2025-09-13 00:00:00 Found day : 2025-09-12 00:00:00 Found day : 2025-09-11 00:00:00 Found day : 2025-09-10 00:00:00 Found day : 2025-09-09 00:00:00 Found day : 2025-09-08 00:00:00 Found day : 2025-09-07 00:00:00 Found day : 2025-09-06 00:00:00 Found day : 2025-09-05 00:00:00 Found day : 2025-09-04 00:00:00 Found day : 2025-09-03 00:00:00 Found day : 2025-09-02 00:00:00 Found day : 2025-09-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-09-21 00:00:00,2025-09-22 00:00:00,2025-09-23 00:00:00,2025-09-24 00:00:00,2025-09-25 00:00:00,2025-09-26 00:00:00,2025-09-27 00:00:00,2025-09-28 00:00:00,2025-09-29 00:00:00,2025-09-30 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where ded.dashboard_place_id = 132 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), nombre_balle FROM MTRPhoto.dashboard_results dr, MTRPhoto.dashboard_entry_day ded where dr.hashtag = '_______truck' and ded.dashboard_place_id = 132 and month(ded.date) = 09 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 132 and mp.name like '%092025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-09-01 : dt_date_just_month_year : 2025-09-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "dechet_Valcor_v2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-09-01" AND ded.date <= "2025-09-30" apple3 {'test': {'mat': 'test', 'pht': 0, 'datou_carac_id': 370, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 538914404}, 'truck': {'mat': 'truck', 'pht': 4230, 'datou_carac_id': 4234, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (2221863,2237645,2243723,2250767,2250321,2253839,2254603,2263255,2270077,2278543,2310569,2289833,2293263,2295583,2303223,2310547,2319011,2333327,2333317,2335401) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (0,4230) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02528741819396792, 'nb_photo': 147587, 'list_port_cont': '26388083,26388119,26388308,26388383,26388554,26389679,26390065,26390484,26390539,26390909,26391238,26391314,26391346,26391749,26394313,26394414,26394617,26394779,26394860,26395164,26395232,26395946,26397208,26397641,26397697,26397973,26398143,26398242,26398537,26401678,26401857,26402653,26402708,26402887,26402966,26403029,26403101,26403368,26403841,26403936,26404280,26405115,26405658,26405908,26406235,26406793,26406867,26406995,26407746,26407972,26408085,26408213,26408327,26413040,26413100,26413279,26413322,26413440,26415578,26429305,26430720,26431448,26437104,26437150,26437261,26437439,26437611,26437797,26437821,26437875,26440440,26441780,26441870,26442849,26444860,26444934,26445065,26445115,26445163,26445289,26445315,26445333,26445407,26445454,26445527,26445562,26445610,26445705,26445953,26446002,26446477,26446941,26447033,26447270,26447421,26447606,26447717,26447869,26447915,26448003,26448360,26448734,26448820,26448861,26449544,26450495,26450509,26450633,26450753,26451699,26452614,26452663,26457405,2646857', 'assoc_port': '26387880:26388308,26387883:26388119,26387886:26388083,26388156:26388554,26388158:26388383,26389291:26389679,26390001:26390065,26390313:26390909,26390315:26390539,26390382:26390484,26391171:26391346,26391173:26391314,26391176:26391238,26391653:26391749,26393935:26394779,26393938:26394860,26393940:26394617,26393943:26394414,26393946:26394313,26395041:26395232,26395043:26395164,26395862:26395946,26397071:26398143,26397073:26398242,26397075:26397973,26397077:26397697,26397096:26397641,26397098:26397208,26397116:26398537,26401302:26403368,26401304:26403841,26401307:26402887,26401310:26402708,26401312:26402653,26401316:26403029,26401336:26401857,26401339:26401678,26402842:26403936,26402844:26403101,26402847:26402966,26404068:26405115,26404069:26404280,26405437:26406793,26405440:26406235,26405443:26405658,26405446:26405908,26406706:26406995,26406707:26406867,26407578:26408213,26407579:26408327,26407580:26408085,26407581:26407972,26407582:26407746,26412322:26413322,26412324:26413040,26412325:26413279,26412327:2641344', 'assoc_mat': '26387880:autre:4230:26388308,26387883:autre:4230:26388119,26387886:autre:4230:26388083,26388156:autre:4230:26388554,26388158:autre:4230:26388383,26389291:autre:4230:26389679,26390001:autre:4230:26390065,26390313:autre:4230:26390909,26390315:autre:4230:26390539,26390382:autre:4230:26390484,26391171:autre:4230:26391346,26391173:autre:4230:26391314,26391176:autre:4230:26391238,26391653:autre:4230:26391749,26393935:autre:4230:26394779,26393938:autre:4230:26394860,26393940:autre:4230:26394617,26393943:autre:4230:26394414,26393946:autre:4230:26394313,26395041:autre:4230:26395232,26395043:autre:4230:26395164,26395862:autre:4230:26395946,26397071:autre:4230:26398143,26397073:autre:4230:26398242,26397075:autre:4230:26397973,26397077:autre:4230:26397697,26397096:autre:4230:26397641,26397098:autre:4230:26397208,26397116:autre:4230:26398537,26401302:autre:4230:26403368,26401304:autre:4230:26403841,26401307:autre:4230:26402887,26401310:autre:4230:26402708,26401312:autre:4230:26402653,26401316:autre:4230:26403029,26401336:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026509142758858194, 'nb_photo': 175670, 'list_port_cont': '26388089,26388131,26388296,26388377,26388547,26389676,26390060,26390483,26390552,26390916,26391245,26391312,26391350,26391762,26394311,26394418,26394622,26394788,26394870,26395165,26395240,26395952,26397221,26397631,26397706,26397985,26398146,26398250,26398527,26401680,26401863,26402649,26402701,26402892,26402973,26403021,26403116,26403380,26403842,26403952,26404281,26405107,26405666,26405907,26406241,26406807,26406870,26406990,26407760,26407974,26408077,26408210,26408332,26413035,26413089,26413281,26413323,26413438,26415583,26429306,26430731,26431441,26437101,26437149,26437277,26437443,26437606,26437794,26437837,26437876,26440451,26441790,26441867,26442850,26444862,26444931,26445064,26445129,26445158,26445284,26445323,26445337,26445417,26445465,26445530,26445565,26445622,26445720,26445960,26446005,26446488,26446940,26447034,26447280,26447429,26447608,26447718,26447871,26447919,26448015,26448357,26448744,26448833,26448874,26449543,26450493,26450516,26450630,26450748,26451701,26452606,26452669,26457410,2646858', 'assoc_port': '26387880:26388296,26387883:26388131,26387886:26388089,26388156:26388547,26388158:26388377,26389291:26389676,26390001:26390060,26390313:26390916,26390315:26390552,26390382:26390483,26391171:26391350,26391173:26391312,26391176:26391245,26391653:26391762,26393935:26394788,26393938:26394870,26393940:26394622,26393943:26394418,26393946:26394311,26395041:26395240,26395043:26395165,26395862:26395952,26397071:26398146,26397073:26398250,26397075:26397985,26397077:26397706,26397096:26397631,26397098:26397221,26397116:26398527,26401302:26403380,26401304:26403842,26401307:26402892,26401310:26402701,26401312:26402649,26401316:26403021,26401336:26401863,26401339:26401680,26402842:26403952,26402844:26403116,26402847:26402973,26404068:26405107,26404069:26404281,26405437:26406807,26405440:26406241,26405443:26405666,26405446:26405907,26406706:26406990,26406707:26406870,26407578:26408210,26407579:26408332,26407580:26408077,26407581:26407974,26407582:26407760,26412322:26413323,26412324:26413035,26412325:26413281,26412327:2641343', 'assoc_mat': '26387880:carton:4230:26388296,26387883:carton:4230:26388131,26387886:carton:4230:26388089,26388156:carton:4230:26388547,26388158:carton:4230:26388377,26389291:carton:4230:26389676,26390001:carton:4230:26390060,26390313:carton:4230:26390916,26390315:carton:4230:26390552,26390382:carton:4230:26390483,26391171:carton:4230:26391350,26391173:carton:4230:26391312,26391176:carton:4230:26391245,26391653:carton:4230:26391762,26393935:carton:4230:26394788,26393938:carton:4230:26394870,26393940:carton:4230:26394622,26393943:carton:4230:26394418,26393946:carton:4230:26394311,26395041:carton:4230:26395240,26395043:carton:4230:26395165,26395862:carton:4230:26395952,26397071:carton:4230:26398146,26397073:carton:4230:26398250,26397075:carton:4230:26397985,26397077:carton:4230:26397706,26397096:carton:4230:26397631,26397098:carton:4230:26397221,26397116:carton:4230:26398527,26401302:carton:4230:26403380,26401304:carton:4230:26403842,26401307:carton:4230:26402892,26401310:carton:4230:26402701,26401312:carton:4230:26402649,2640'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.006085949094165609, 'nb_photo': 7766, 'list_port_cont': '26388086,26388301,26388376,26388544,26389677,26390479,26390542,26390911,26391237,26391313,26391354,26391746,26394319,26394623,26394782,26394859,26395170,26395242,26395947,26397978,26398148,26398531,26401670,26402663,26402698,26402896,26402970,26403013,26403118,26403844,26403940,26404275,26405120,26405906,26406232,26406800,26406856,26407000,26407740,26407980,26408075,26408333,26413087,26413283,26413447,26429303,26430722,26431443,26437097,26437148,26437427,26437603,26437783,26437874,26441781,26442839,26444861,26445077,26445112,26445164,26445321,26445336,26445466,26445615,26445721,26445957,26446476,26446924,26447601,26447870,26447925,26448008,26448353,26448743,26448836,26448868,26449530,26450494,26450506,26450632,26450736,26451694,26452619,26452665,26468591,26479710,26479915,26480260,26480364,26483834,26483957,26484143,26484380,26484446,26484648,26484711,26484759,26485274,26485412,26485678,26485989,26486102,26486167,26486310,26486695,26487876,26488504,26488644,26488786,26488892,26488929,26489046,26489311,2648954', 'assoc_port': '26387880:26388301,26387886:26388086,26388156:26388544,26388158:26388376,26389291:26389677,26390313:26390911,26390315:26390542,26390382:26390479,26391171:26391354,26391173:26391313,26391176:26391237,26391653:26391746,26393935:26394782,26393938:26394859,26393940:26394623,26393946:26394319,26395041:26395242,26395043:26395170,26395862:26395947,26397071:26398148,26397075:26397978,26397116:26398531,26401304:26403844,26401307:26402896,26401310:26402698,26401312:26402663,26401316:26403013,26401339:26401670,26402842:26403940,26402844:26403118,26402847:26402970,26404068:26405120,26404069:26404275,26405437:26406800,26405440:26406232,26405446:26405906,26406706:26407000,26406707:26406856,26407579:26408333,26407580:26408075,26407581:26407980,26407582:26407740,26412325:26413283,26412327:26413447,26412328:26413087,26429205:26429303,26430496:26430722,26431342:26431443,26436971:26437874,26436973:26437783,26436974:26437603,26436975:26437427,26436977:26437097,26436988:26437148,26441388:26441781,26442694:26442839,26444606:2644835', 'assoc_mat': '26387880:metal:4230:26388301,26387886:metal:4230:26388086,26388156:metal:4230:26388544,26388158:metal:4230:26388376,26389291:metal:4230:26389677,26390313:metal:4230:26390911,26390315:metal:4230:26390542,26390382:metal:4230:26390479,26391171:metal:4230:26391354,26391173:metal:4230:26391313,26391176:metal:4230:26391237,26391653:metal:4230:26391746,26393935:metal:4230:26394782,26393938:metal:4230:26394859,26393940:metal:4230:26394623,26393946:metal:4230:26394319,26395041:metal:4230:26395242,26395043:metal:4230:26395170,26395862:metal:4230:26395947,26397071:metal:4230:26398148,26397075:metal:4230:26397978,26397116:metal:4230:26398531,26401304:metal:4230:26403844,26401307:metal:4230:26402896,26401310:metal:4230:26402698,26401312:metal:4230:26402663,26401316:metal:4230:26403013,26401339:metal:4230:26401670,26402842:metal:4230:26403940,26402844:metal:4230:26403118,26402847:metal:4230:26402970,26404068:metal:4230:26405120,26404069:metal:4230:26404275,26405437:metal:4230:26406800,26405440:metal:4230:26406232,26405446:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10970667183611786, 'nb_photo': 471517, 'list_port_cont': '26388084,26388128,26388306,26388391,26388556,26389674,26390067,26390493,26390549,26390921,26391249,26391310,26391357,26391753,26394310,26394416,26394628,26394791,26394874,26395167,26395229,26395954,26397223,26397647,26397701,26397981,26398151,26398241,26398538,26401679,26401861,26402659,26402713,26402893,26402978,26403017,26403108,26403382,26403837,26403953,26404273,26405118,26405673,26405911,26406239,26406808,26406864,26406998,26407748,26407983,26408082,26408205,26408329,26413032,26413101,26413285,26413327,26413452,26415591,26429307,26430730,26431439,26437102,26437161,26437275,26437441,26437610,26437786,26437836,26437872,26440446,26441793,26441866,26442848,26444865,26444946,26445076,26445127,26445168,26445281,26445327,26445346,26445415,26445468,26445531,26445557,26445621,26445711,26445962,26446018,26446483,26446929,26447032,26447281,26447427,26447600,26447726,26447865,26447927,26448020,26448364,26448739,26448826,26448876,26449541,26450499,26450507,26450639,26450751,26451705,26452610,26452668,26457409,2646859', 'assoc_port': '26387880:26388306,26387883:26388128,26387886:26388084,26388156:26388556,26388158:26388391,26389291:26389674,26390001:26390067,26390313:26390921,26390315:26390549,26390382:26390493,26391171:26391357,26391173:26391310,26391176:26391249,26391653:26391753,26393935:26394791,26393938:26394874,26393940:26394628,26393943:26394416,26393946:26394310,26395041:26395229,26395043:26395167,26395862:26395954,26397071:26398151,26397073:26398241,26397075:26397981,26397077:26397701,26397096:26397647,26397098:26397223,26397116:26398538,26401302:26403382,26401304:26403837,26401307:26402893,26401310:26402713,26401312:26402659,26401316:26403017,26401336:26401861,26401339:26401679,26402842:26403953,26402844:26403108,26402847:26402978,26404068:26405118,26404069:26404273,26405437:26406808,26405440:26406239,26405443:26405673,26405446:26405911,26406706:26406998,26406707:26406864,26407578:26408205,26407579:26408329,26407580:26408082,26407581:26407983,26407582:26407748,26412322:26413327,26412324:26413032,26412325:26413285,26412327:2641345', 'assoc_mat': '26387880:papier:4230:26388306,26387883:papier:4230:26388128,26387886:papier:4230:26388084,26388156:papier:4230:26388556,26388158:papier:4230:26388391,26389291:papier:4230:26389674,26390001:papier:4230:26390067,26390313:papier:4230:26390921,26390315:papier:4230:26390549,26390382:papier:4230:26390493,26391171:papier:4230:26391357,26391173:papier:4230:26391310,26391176:papier:4230:26391249,26391653:papier:4230:26391753,26393935:papier:4230:26394791,26393938:papier:4230:26394874,26393940:papier:4230:26394628,26393943:papier:4230:26394416,26393946:papier:4230:26394310,26395041:papier:4230:26395229,26395043:papier:4230:26395167,26395862:papier:4230:26395954,26397071:papier:4230:26398151,26397073:papier:4230:26398241,26397075:papier:4230:26397981,26397077:papier:4230:26397701,26397096:papier:4230:26397647,26397098:papier:4230:26397223,26397116:papier:4230:26398538,26401302:papier:4230:26403382,26401304:papier:4230:26403837,26401307:papier:4230:26402893,26401310:papier:4230:26402713,26401312:papier:4230:26402659,2640'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.001263730155304897, 'nb_photo': 1973, 'list_port_cont': '26388311,26391758,26394865,26397209,26397696,26398530,26402714,26402897,26402974,26403113,26403838,26403951,26405119,26406806,26406861,26413102,26429302,26430716,26431445,26437438,26437799,26437871,26441784,26444866,26445066,26445618,26447727,26447875,26452671,26468587,26483845,26483958,26484145,26486104,26487811,26488524,26488657,26488785,26488928,26489541,26489639,26489784,26489974,26490023,26491798,26491914,26492063,26492381,26494335,26494460,26494786,26495643,26495990,26496071,26496821,26497592,26498207,26498306,26499018,26500045,26500211,26503061,26503429,26503608,26503704,26503849,26504034,26510075,26510487,26510590,26510789,26513139,26513235,26513346,26513459,26513674,26516840,26529107,26531588,26532411,26532520,26532732,26532903,26535263,26535406,26535448,26537746,26538247,26538702,26538834,26539195,26541074,26541112,26544255,26545172,26545288,26545580,26569228,26569385,26571148,26571286,26571613,26572938,26575328,26575928,26576048,26576452,26576506,26576558,26576716,26576849,26577023,26577103,2657713', 'assoc_port': '26387880:26388311,26391653:26391758,26393938:26394865,26397077:26397696,26397098:26397209,26397116:26398530,26401304:26403838,26401307:26402897,26401310:26402714,26402842:26403951,26402844:26403113,26402847:26402974,26404068:26405119,26405437:26406806,26406707:26406861,26412328:26413102,26429205:26429302,26430496:26430716,26431342:26431445,26436971:26437871,26436973:26437799,26436975:26437438,26441388:26441784,26444617:26445618,26444674:26445066,26444677:26444866,26445671:26452671,26447554:26447727,26447557:26447875,26451267:26468587,26483518:26486104,26483562:26483845,26483566:26483958,26483569:26484145,26487472:26489784,26487475:26490023,26487477:26489974,26487479:26489639,26487481:26489541,26487483:26488928,26487485:26488524,26487487:26488657,26487488:26488785,26487492:26487811,26491214:26513674,26491215:26492063,26491223:26495990,26491225:26491914,26491228:26492381,26491231:26500211,26491233:26491798,26492185:26516840,26494008:26494786,26494010:26513346,26494012:26495643,26494022:26513235,26494024:2649830', 'assoc_mat': '26387880:pehd:4230:26388311,26391653:pehd:4230:26391758,26393938:pehd:4230:26394865,26397077:pehd:4230:26397696,26397098:pehd:4230:26397209,26397116:pehd:4230:26398530,26401304:pehd:4230:26403838,26401307:pehd:4230:26402897,26401310:pehd:4230:26402714,26402842:pehd:4230:26403951,26402844:pehd:4230:26403113,26402847:pehd:4230:26402974,26404068:pehd:4230:26405119,26405437:pehd:4230:26406806,26406707:pehd:4230:26406861,26412328:pehd:4230:26413102,26429205:pehd:4230:26429302,26430496:pehd:4230:26430716,26431342:pehd:4230:26431445,26436971:pehd:4230:26437871,26436973:pehd:4230:26437799,26436975:pehd:4230:26437438,26441388:pehd:4230:26441784,26444617:pehd:4230:26445618,26444674:pehd:4230:26445066,26444677:pehd:4230:26444866,26445671:pehd:4230:26452671,26447554:pehd:4230:26447727,26447557:pehd:4230:26447875,26451267:pehd:4230:26468587,26483518:pehd:4230:26486104,26483562:pehd:4230:26483845,26483566:pehd:4230:26483958,26483569:pehd:4230:26484145,26487472:pehd:4230:26489784,26487475:pehd:4230:26490023,26487477:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.010880649466079126, 'nb_photo': 86361, 'list_port_cont': '26388088,26388126,26388309,26388372,26388555,26389680,26390057,26390486,26390550,26390910,26391248,26391308,26391347,26391752,26394320,26394419,26394618,26394785,26394872,26395178,26395237,26395948,26397217,26397646,26397705,26397984,26398149,26398251,26398528,26401675,26401865,26402661,26402709,26402888,26402972,26403024,26403117,26403376,26403830,26403943,26404277,26405121,26405675,26405902,26406245,26406803,26406872,26406991,26407754,26407982,26408087,26408203,26408322,26413037,26413096,26413284,26413329,26413451,26415584,26429301,26430718,26431440,26437110,26437160,26437276,26437436,26437608,26437793,26437833,26437877,26440441,26441783,26441862,26442846,26444858,26444944,26445075,26445122,26445161,26445292,26445326,26445348,26445413,26445458,26445523,26445556,26445620,26445717,26445952,26446019,26446490,26446939,26447036,26447283,26447424,26447603,26447723,26447876,26447929,26448019,26448358,26448746,26448832,26448875,26449545,26450496,26450518,26450637,26450744,26451710,26452616,26452666,26457413,2646858', 'assoc_port': '26387880:26388309,26387883:26388126,26387886:26388088,26388156:26388555,26388158:26388372,26389291:26389680,26390001:26390057,26390313:26390910,26390315:26390550,26390382:26390486,26391171:26391347,26391173:26391308,26391176:26391248,26391653:26391752,26393935:26394785,26393938:26394872,26393940:26394618,26393943:26394419,26393946:26394320,26395041:26395237,26395043:26395178,26395862:26395948,26397071:26398149,26397073:26398251,26397075:26397984,26397077:26397705,26397096:26397646,26397098:26397217,26397116:26398528,26401302:26403376,26401304:26403830,26401307:26402888,26401310:26402709,26401312:26402661,26401316:26403024,26401336:26401865,26401339:26401675,26402842:26403943,26402844:26403117,26402847:26402972,26404068:26405121,26404069:26404277,26405437:26406803,26405440:26406245,26405443:26405675,26405446:26405902,26406706:26406991,26406707:26406872,26407578:26408203,26407579:26408322,26407580:26408087,26407581:26407982,26407582:26407754,26412322:26413329,26412324:26413037,26412325:26413284,26412327:2641345', 'assoc_mat': '26387880:pet_clair:4230:26388309,26387883:pet_clair:4230:26388126,26387886:pet_clair:4230:26388088,26388156:pet_clair:4230:26388555,26388158:pet_clair:4230:26388372,26389291:pet_clair:4230:26389680,26390001:pet_clair:4230:26390057,26390313:pet_clair:4230:26390910,26390315:pet_clair:4230:26390550,26390382:pet_clair:4230:26390486,26391171:pet_clair:4230:26391347,26391173:pet_clair:4230:26391308,26391176:pet_clair:4230:26391248,26391653:pet_clair:4230:26391752,26393935:pet_clair:4230:26394785,26393938:pet_clair:4230:26394872,26393940:pet_clair:4230:26394618,26393943:pet_clair:4230:26394419,26393946:pet_clair:4230:26394320,26395041:pet_clair:4230:26395237,26395043:pet_clair:4230:26395178,26395862:pet_clair:4230:26395948,26397071:pet_clair:4230:26398149,26397073:pet_clair:4230:26398251,26397075:pet_clair:4230:26397984,26397077:pet_clair:4230:26397705,26397096:pet_clair:4230:26397646,26397098:pet_clair:4230:26397217,26397116:pet_clair:4230:26398528,26401302:pet_clair:4230:26403376,26401304:pet_clair:4230:26403830,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0017838803725459, 'nb_photo': 1433, 'list_port_cont': '26388090,26388134,26388299,26391246,26391303,26394873,26395953,26398147,26398249,26401671,26401862,26402894,26402971,26403843,26403947,26405112,26405900,26406243,26406809,26407762,26407968,26408206,26408335,26413450,26430727,26437106,26437156,26437442,26437607,26437798,26437870,26440450,26444947,26445068,26447428,26447712,26447877,26450645,26451702,26452667,26468589,26483847,26483955,26484144,26484647,26484719,26485688,26486111,26486442,26486702,26487805,26487871,26488790,26489545,26489632,26489787,26489967,26490028,26491659,26491796,26491905,26492075,26492377,26494321,26494468,26494533,26494781,26495648,26496069,26496824,26497586,26498210,26498309,26498579,26499990,26500039,26503378,26503525,26504032,26510323,26510907,26511512,26512163,26512608,26513142,26513240,26513350,26513452,26513675,26516837,26529112,26531594,26534666,26535274,26535454,26538475,26538704,26539111,26539953,26540292,26540891,26541075,26541108,26541228,26543284,26543869,26544710,26545170,26545584,26546133,26552412,26568241,26570711,2657128', 'assoc_port': '26387880:26388299,26387883:26388134,26387886:26388090,26391173:26391303,26391176:26391246,26393938:26394873,26395862:26395953,26397071:26398147,26397073:26398249,26401304:26403843,26401307:26402894,26401336:26401862,26401339:26401671,26402842:26403947,26402847:26402971,26404068:26405112,26405437:26406809,26405440:26406243,26405446:26405900,26407578:26408206,26407579:26408335,26407581:26407968,26407582:26407762,26412327:26413450,26430496:26430727,26436971:26437870,26436973:26437798,26436974:26437607,26436975:26437442,26436977:26437106,26436988:26437156,26440347:26440450,26444671:26444947,26444674:26445068,26445668:26447428,26445671:26452667,26447554:26447712,26447557:26447877,26449901:26450645,26451264:26451702,26451267:26468589,26483485:26486702,26483513:26486442,26483518:26486111,26483526:26484719,26483556:26484647,26483562:26483847,26483566:26483955,26483569:26484144,26485012:26485688,26487472:26489787,26487475:26490028,26487477:26489967,26487479:26489632,26487481:26489545,26487488:26488790,26487490:2648787', 'assoc_mat': '26387880:pet_fonce:4230:26388299,26387883:pet_fonce:4230:26388134,26387886:pet_fonce:4230:26388090,26391173:pet_fonce:4230:26391303,26391176:pet_fonce:4230:26391246,26393938:pet_fonce:4230:26394873,26395862:pet_fonce:4230:26395953,26397071:pet_fonce:4230:26398147,26397073:pet_fonce:4230:26398249,26401304:pet_fonce:4230:26403843,26401307:pet_fonce:4230:26402894,26401336:pet_fonce:4230:26401862,26401339:pet_fonce:4230:26401671,26402842:pet_fonce:4230:26403947,26402847:pet_fonce:4230:26402971,26404068:pet_fonce:4230:26405112,26405437:pet_fonce:4230:26406809,26405440:pet_fonce:4230:26406243,26405446:pet_fonce:4230:26405900,26407578:pet_fonce:4230:26408206,26407579:pet_fonce:4230:26408335,26407581:pet_fonce:4230:26407968,26407582:pet_fonce:4230:26407762,26412327:pet_fonce:4230:26413450,26430496:pet_fonce:4230:26430727,26436971:pet_fonce:4230:26437870,26436973:pet_fonce:4230:26437798,26436974:pet_fonce:4230:26437607,26436975:pet_fonce:4230:26437442,26436977:pet_fonce:4230:26437106,26436988:pet_fonce:4230:26437156,2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(2221863,2237645,2243723,2250767,2250321,2253839,2254603,2263255,2270077,2278543,2310569,2289833,2293263,2295583,2303223,2310547,2319011,2333327,2333317,2335401)); after get_hostname_from_raspi hasthag : truck hasthag that could be used but not yet : _______refus SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______truck' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1055) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=132 and date >='2025-09-01' and date <= '2025-09-30') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((8946,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 8946),), 'material_dict': {'truck': 8946}, 'coverage_data': (('2025/09/20/', 0.24572), ('2025/09/19/', 0.245489), ('2025/09/18/', 0.245026), ('2025/09/17/', 0.245142), ('2025/09/16/', 0.245605), ('2025/09/15/', 0.245142), ('2025/09/14/', 0.245373), ('2025/09/13/', 0.245489), ('2025/09/12/', 0.245026), ('2025/09/11/', 0.228128), ('2025/09/10/', 0.241091), ('2025/09/09/', 0.239007), ('2025/09/08/', 0.241322), ('2025/09/07/', 0.243058), ('2025/09/06/', 0.241669), ('2025/09/05/', 0.240049), ('2025/09/04/', 0.238544), ('2025/09/03/', 0.243753), ('2025/09/02/', 0.244216), ('2025/09/01/', 0.24491)), 'impurety_average_data': ((datetime.date(2025, 9, 1), 0.1552017312537881, 6), (datetime.date(2025, 9, 2), 0.16471219526209202, 2), (datetime.date(2025, 9, 3), 0.18377363694590113, 2), (datetime.date(2025, 9, 4), 0.1736069699957586, 7), (datetime.date(2025, 9, 5), 0.18128884148413335, 10), (datetime.date(2025, 9, 6), 0.22863492161408816, 2), (datetime.date(2025, 9, 7), 0.15431694042082972, 6), (datetime.date(2025, 9, 8), 0.18295958512049326, 2), (datetime.date(2025, 9, 9), 0.18053673250643892, 2), (datetime.date(2025, 9, 10), 0.1703095922934771, 4), (datetime.date(2025, 9, 11), 0.1867896697644957, 2), (datetime.date(2025, 9, 12), 0.19222573768857024, 2), (datetime.date(2025, 9, 13), 0.16755800283988204, 2), (datetime.date(2025, 9, 14), 0.0968343917413466, 2), (datetime.date(2025, 9, 15), 0.1464269536586346, 5), (datetime.date(2025, 9, 16), 0.17955871669847134, 2), (datetime.date(2025, 9, 17), 0.17368311047152674, 3), (datetime.date(2025, 9, 18), 0.16903272592709423, 7), (datetime.date(2025, 9, 19), 0.16222428482562382, 8), (datetime.date(2025, 9, 20), 0.16237311835078927, 3)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 9, 1), 0.1552017312537881, 6), (datetime.date(2025, 9, 2), 0.16471219526209202, 2), (datetime.date(2025, 9, 3), 0.18377363694590113, 2), (datetime.date(2025, 9, 4), 0.1736069699957586, 7), (datetime.date(2025, 9, 5), 0.18128884148413335, 10), (datetime.date(2025, 9, 6), 0.22863492161408816, 2), (datetime.date(2025, 9, 7), 0.15431694042082972, 6), (datetime.date(2025, 9, 8), 0.18295958512049326, 2), (datetime.date(2025, 9, 9), 0.18053673250643892, 2), (datetime.date(2025, 9, 10), 0.1703095922934771, 4), (datetime.date(2025, 9, 11), 0.1867896697644957, 2), (datetime.date(2025, 9, 12), 0.19222573768857024, 2), (datetime.date(2025, 9, 13), 0.16755800283988204, 2), (datetime.date(2025, 9, 14), 0.0968343917413466, 2), (datetime.date(2025, 9, 15), 0.1464269536586346, 5), (datetime.date(2025, 9, 16), 0.17955871669847134, 2), (datetime.date(2025, 9, 17), 0.17368311047152674, 3), (datetime.date(2025, 9, 18), 0.16903272592709423, 7), (datetime.date(2025, 9, 19), 0.16222428482562382, 8), (datetime.date(2025, 9, 20), 0.16237311835078927, 3))}, 'quality_array': [['-7.2980256317995265', '01092025'], ['-7.29952252605813', '02092025'], ['-7.175730886457139', '03092025'], ['-7.241689054835383', '04092025'], ['-7.246065495855396', '05092025'], ['-7.385405723299512', '06092025'], ['-7.104757200482503', '07092025'], ['-7.222787724948354', '08092025'], ['-7.5692024844542045', '09092025'], ['-7.433611193808795', '10092025'], ['-7.486496143649586', '11092025'], ['-7.129505969126315', '12092025'], ['-7.4122306671873455', '13092025'], ['-6.227791133565665', '14092025'], ['-7.203307195503365', '15092025'], ['-7.408506463391629', '16092025'], ['-7.515814731403351', '17092025'], ['-7.382309811010424', '18092025'], ['-7.438637193334269', '19092025'], ['-7.58106381408741', '20092025']], 'number_of_batch': ((1290,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02528741819396792, 'nb_photo': 147587, 'list_port_cont': '26388083,26388119,26388308,26388383,26388554,26389679,26390065,26390484,26390539,26390909,26391238,26391314,26391346,26391749,26394313,26394414,26394617,26394779,26394860,26395164,26395232,26395946,26397208,26397641,26397697,26397973,26398143,26398242,26398537,26401678,26401857,26402653,26402708,26402887,26402966,26403029,26403101,26403368,26403841,26403936,26404280,26405115,26405658,26405908,26406235,26406793,26406867,26406995,26407746,26407972,26408085,26408213,26408327,26413040,26413100,26413279,26413322,26413440,26415578,26429305,26430720,26431448,26437104,26437150,26437261,26437439,26437611,26437797,26437821,26437875,26440440,26441780,26441870,26442849,26444860,26444934,26445065,26445115,26445163,26445289,26445315,26445333,26445407,26445454,26445527,26445562,26445610,26445705,26445953,26446002,26446477,26446941,26447033,26447270,26447421,26447606,26447717,26447869,26447915,26448003,26448360,26448734,26448820,26448861,26449544,26450495,26450509,26450633,26450753,26451699,26452614,26452663,26457405,2646857', 'assoc_port': '26387880:26388308,26387883:26388119,26387886:26388083,26388156:26388554,26388158:26388383,26389291:26389679,26390001:26390065,26390313:26390909,26390315:26390539,26390382:26390484,26391171:26391346,26391173:26391314,26391176:26391238,26391653:26391749,26393935:26394779,26393938:26394860,26393940:26394617,26393943:26394414,26393946:26394313,26395041:26395232,26395043:26395164,26395862:26395946,26397071:26398143,26397073:26398242,26397075:26397973,26397077:26397697,26397096:26397641,26397098:26397208,26397116:26398537,26401302:26403368,26401304:26403841,26401307:26402887,26401310:26402708,26401312:26402653,26401316:26403029,26401336:26401857,26401339:26401678,26402842:26403936,26402844:26403101,26402847:26402966,26404068:26405115,26404069:26404280,26405437:26406793,26405440:26406235,26405443:26405658,26405446:26405908,26406706:26406995,26406707:26406867,26407578:26408213,26407579:26408327,26407580:26408085,26407581:26407972,26407582:26407746,26412322:26413322,26412324:26413040,26412325:26413279,26412327:2641344', 'assoc_mat': '26387880:autre:4230:26388308,26387883:autre:4230:26388119,26387886:autre:4230:26388083,26388156:autre:4230:26388554,26388158:autre:4230:26388383,26389291:autre:4230:26389679,26390001:autre:4230:26390065,26390313:autre:4230:26390909,26390315:autre:4230:26390539,26390382:autre:4230:26390484,26391171:autre:4230:26391346,26391173:autre:4230:26391314,26391176:autre:4230:26391238,26391653:autre:4230:26391749,26393935:autre:4230:26394779,26393938:autre:4230:26394860,26393940:autre:4230:26394617,26393943:autre:4230:26394414,26393946:autre:4230:26394313,26395041:autre:4230:26395232,26395043:autre:4230:26395164,26395862:autre:4230:26395946,26397071:autre:4230:26398143,26397073:autre:4230:26398242,26397075:autre:4230:26397973,26397077:autre:4230:26397697,26397096:autre:4230:26397641,26397098:autre:4230:26397208,26397116:autre:4230:26398537,26401302:autre:4230:26403368,26401304:autre:4230:26403841,26401307:autre:4230:26402887,26401310:autre:4230:26402708,26401312:autre:4230:26402653,26401316:autre:4230:26403029,26401336:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026509142758858194, 'nb_photo': 175670, 'list_port_cont': '26388089,26388131,26388296,26388377,26388547,26389676,26390060,26390483,26390552,26390916,26391245,26391312,26391350,26391762,26394311,26394418,26394622,26394788,26394870,26395165,26395240,26395952,26397221,26397631,26397706,26397985,26398146,26398250,26398527,26401680,26401863,26402649,26402701,26402892,26402973,26403021,26403116,26403380,26403842,26403952,26404281,26405107,26405666,26405907,26406241,26406807,26406870,26406990,26407760,26407974,26408077,26408210,26408332,26413035,26413089,26413281,26413323,26413438,26415583,26429306,26430731,26431441,26437101,26437149,26437277,26437443,26437606,26437794,26437837,26437876,26440451,26441790,26441867,26442850,26444862,26444931,26445064,26445129,26445158,26445284,26445323,26445337,26445417,26445465,26445530,26445565,26445622,26445720,26445960,26446005,26446488,26446940,26447034,26447280,26447429,26447608,26447718,26447871,26447919,26448015,26448357,26448744,26448833,26448874,26449543,26450493,26450516,26450630,26450748,26451701,26452606,26452669,26457410,2646858', 'assoc_port': '26387880:26388296,26387883:26388131,26387886:26388089,26388156:26388547,26388158:26388377,26389291:26389676,26390001:26390060,26390313:26390916,26390315:26390552,26390382:26390483,26391171:26391350,26391173:26391312,26391176:26391245,26391653:26391762,26393935:26394788,26393938:26394870,26393940:26394622,26393943:26394418,26393946:26394311,26395041:26395240,26395043:26395165,26395862:26395952,26397071:26398146,26397073:26398250,26397075:26397985,26397077:26397706,26397096:26397631,26397098:26397221,26397116:26398527,26401302:26403380,26401304:26403842,26401307:26402892,26401310:26402701,26401312:26402649,26401316:26403021,26401336:26401863,26401339:26401680,26402842:26403952,26402844:26403116,26402847:26402973,26404068:26405107,26404069:26404281,26405437:26406807,26405440:26406241,26405443:26405666,26405446:26405907,26406706:26406990,26406707:26406870,26407578:26408210,26407579:26408332,26407580:26408077,26407581:26407974,26407582:26407760,26412322:26413323,26412324:26413035,26412325:26413281,26412327:2641343', 'assoc_mat': '26387880:carton:4230:26388296,26387883:carton:4230:26388131,26387886:carton:4230:26388089,26388156:carton:4230:26388547,26388158:carton:4230:26388377,26389291:carton:4230:26389676,26390001:carton:4230:26390060,26390313:carton:4230:26390916,26390315:carton:4230:26390552,26390382:carton:4230:26390483,26391171:carton:4230:26391350,26391173:carton:4230:26391312,26391176:carton:4230:26391245,26391653:carton:4230:26391762,26393935:carton:4230:26394788,26393938:carton:4230:26394870,26393940:carton:4230:26394622,26393943:carton:4230:26394418,26393946:carton:4230:26394311,26395041:carton:4230:26395240,26395043:carton:4230:26395165,26395862:carton:4230:26395952,26397071:carton:4230:26398146,26397073:carton:4230:26398250,26397075:carton:4230:26397985,26397077:carton:4230:26397706,26397096:carton:4230:26397631,26397098:carton:4230:26397221,26397116:carton:4230:26398527,26401302:carton:4230:26403380,26401304:carton:4230:26403842,26401307:carton:4230:26402892,26401310:carton:4230:26402701,26401312:carton:4230:26402649,2640'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.006085949094165609, 'nb_photo': 7766, 'list_port_cont': '26388086,26388301,26388376,26388544,26389677,26390479,26390542,26390911,26391237,26391313,26391354,26391746,26394319,26394623,26394782,26394859,26395170,26395242,26395947,26397978,26398148,26398531,26401670,26402663,26402698,26402896,26402970,26403013,26403118,26403844,26403940,26404275,26405120,26405906,26406232,26406800,26406856,26407000,26407740,26407980,26408075,26408333,26413087,26413283,26413447,26429303,26430722,26431443,26437097,26437148,26437427,26437603,26437783,26437874,26441781,26442839,26444861,26445077,26445112,26445164,26445321,26445336,26445466,26445615,26445721,26445957,26446476,26446924,26447601,26447870,26447925,26448008,26448353,26448743,26448836,26448868,26449530,26450494,26450506,26450632,26450736,26451694,26452619,26452665,26468591,26479710,26479915,26480260,26480364,26483834,26483957,26484143,26484380,26484446,26484648,26484711,26484759,26485274,26485412,26485678,26485989,26486102,26486167,26486310,26486695,26487876,26488504,26488644,26488786,26488892,26488929,26489046,26489311,2648954', 'assoc_port': '26387880:26388301,26387886:26388086,26388156:26388544,26388158:26388376,26389291:26389677,26390313:26390911,26390315:26390542,26390382:26390479,26391171:26391354,26391173:26391313,26391176:26391237,26391653:26391746,26393935:26394782,26393938:26394859,26393940:26394623,26393946:26394319,26395041:26395242,26395043:26395170,26395862:26395947,26397071:26398148,26397075:26397978,26397116:26398531,26401304:26403844,26401307:26402896,26401310:26402698,26401312:26402663,26401316:26403013,26401339:26401670,26402842:26403940,26402844:26403118,26402847:26402970,26404068:26405120,26404069:26404275,26405437:26406800,26405440:26406232,26405446:26405906,26406706:26407000,26406707:26406856,26407579:26408333,26407580:26408075,26407581:26407980,26407582:26407740,26412325:26413283,26412327:26413447,26412328:26413087,26429205:26429303,26430496:26430722,26431342:26431443,26436971:26437874,26436973:26437783,26436974:26437603,26436975:26437427,26436977:26437097,26436988:26437148,26441388:26441781,26442694:26442839,26444606:2644835', 'assoc_mat': '26387880:metal:4230:26388301,26387886:metal:4230:26388086,26388156:metal:4230:26388544,26388158:metal:4230:26388376,26389291:metal:4230:26389677,26390313:metal:4230:26390911,26390315:metal:4230:26390542,26390382:metal:4230:26390479,26391171:metal:4230:26391354,26391173:metal:4230:26391313,26391176:metal:4230:26391237,26391653:metal:4230:26391746,26393935:metal:4230:26394782,26393938:metal:4230:26394859,26393940:metal:4230:26394623,26393946:metal:4230:26394319,26395041:metal:4230:26395242,26395043:metal:4230:26395170,26395862:metal:4230:26395947,26397071:metal:4230:26398148,26397075:metal:4230:26397978,26397116:metal:4230:26398531,26401304:metal:4230:26403844,26401307:metal:4230:26402896,26401310:metal:4230:26402698,26401312:metal:4230:26402663,26401316:metal:4230:26403013,26401339:metal:4230:26401670,26402842:metal:4230:26403940,26402844:metal:4230:26403118,26402847:metal:4230:26402970,26404068:metal:4230:26405120,26404069:metal:4230:26404275,26405437:metal:4230:26406800,26405440:metal:4230:26406232,26405446:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10970667183611786, 'nb_photo': 471517, 'list_port_cont': '26388084,26388128,26388306,26388391,26388556,26389674,26390067,26390493,26390549,26390921,26391249,26391310,26391357,26391753,26394310,26394416,26394628,26394791,26394874,26395167,26395229,26395954,26397223,26397647,26397701,26397981,26398151,26398241,26398538,26401679,26401861,26402659,26402713,26402893,26402978,26403017,26403108,26403382,26403837,26403953,26404273,26405118,26405673,26405911,26406239,26406808,26406864,26406998,26407748,26407983,26408082,26408205,26408329,26413032,26413101,26413285,26413327,26413452,26415591,26429307,26430730,26431439,26437102,26437161,26437275,26437441,26437610,26437786,26437836,26437872,26440446,26441793,26441866,26442848,26444865,26444946,26445076,26445127,26445168,26445281,26445327,26445346,26445415,26445468,26445531,26445557,26445621,26445711,26445962,26446018,26446483,26446929,26447032,26447281,26447427,26447600,26447726,26447865,26447927,26448020,26448364,26448739,26448826,26448876,26449541,26450499,26450507,26450639,26450751,26451705,26452610,26452668,26457409,2646859', 'assoc_port': '26387880:26388306,26387883:26388128,26387886:26388084,26388156:26388556,26388158:26388391,26389291:26389674,26390001:26390067,26390313:26390921,26390315:26390549,26390382:26390493,26391171:26391357,26391173:26391310,26391176:26391249,26391653:26391753,26393935:26394791,26393938:26394874,26393940:26394628,26393943:26394416,26393946:26394310,26395041:26395229,26395043:26395167,26395862:26395954,26397071:26398151,26397073:26398241,26397075:26397981,26397077:26397701,26397096:26397647,26397098:26397223,26397116:26398538,26401302:26403382,26401304:26403837,26401307:26402893,26401310:26402713,26401312:26402659,26401316:26403017,26401336:26401861,26401339:26401679,26402842:26403953,26402844:26403108,26402847:26402978,26404068:26405118,26404069:26404273,26405437:26406808,26405440:26406239,26405443:26405673,26405446:26405911,26406706:26406998,26406707:26406864,26407578:26408205,26407579:26408329,26407580:26408082,26407581:26407983,26407582:26407748,26412322:26413327,26412324:26413032,26412325:26413285,26412327:2641345', 'assoc_mat': '26387880:papier:4230:26388306,26387883:papier:4230:26388128,26387886:papier:4230:26388084,26388156:papier:4230:26388556,26388158:papier:4230:26388391,26389291:papier:4230:26389674,26390001:papier:4230:26390067,26390313:papier:4230:26390921,26390315:papier:4230:26390549,26390382:papier:4230:26390493,26391171:papier:4230:26391357,26391173:papier:4230:26391310,26391176:papier:4230:26391249,26391653:papier:4230:26391753,26393935:papier:4230:26394791,26393938:papier:4230:26394874,26393940:papier:4230:26394628,26393943:papier:4230:26394416,26393946:papier:4230:26394310,26395041:papier:4230:26395229,26395043:papier:4230:26395167,26395862:papier:4230:26395954,26397071:papier:4230:26398151,26397073:papier:4230:26398241,26397075:papier:4230:26397981,26397077:papier:4230:26397701,26397096:papier:4230:26397647,26397098:papier:4230:26397223,26397116:papier:4230:26398538,26401302:papier:4230:26403382,26401304:papier:4230:26403837,26401307:papier:4230:26402893,26401310:papier:4230:26402713,26401312:papier:4230:26402659,2640'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.001263730155304897, 'nb_photo': 1973, 'list_port_cont': '26388311,26391758,26394865,26397209,26397696,26398530,26402714,26402897,26402974,26403113,26403838,26403951,26405119,26406806,26406861,26413102,26429302,26430716,26431445,26437438,26437799,26437871,26441784,26444866,26445066,26445618,26447727,26447875,26452671,26468587,26483845,26483958,26484145,26486104,26487811,26488524,26488657,26488785,26488928,26489541,26489639,26489784,26489974,26490023,26491798,26491914,26492063,26492381,26494335,26494460,26494786,26495643,26495990,26496071,26496821,26497592,26498207,26498306,26499018,26500045,26500211,26503061,26503429,26503608,26503704,26503849,26504034,26510075,26510487,26510590,26510789,26513139,26513235,26513346,26513459,26513674,26516840,26529107,26531588,26532411,26532520,26532732,26532903,26535263,26535406,26535448,26537746,26538247,26538702,26538834,26539195,26541074,26541112,26544255,26545172,26545288,26545580,26569228,26569385,26571148,26571286,26571613,26572938,26575328,26575928,26576048,26576452,26576506,26576558,26576716,26576849,26577023,26577103,2657713', 'assoc_port': '26387880:26388311,26391653:26391758,26393938:26394865,26397077:26397696,26397098:26397209,26397116:26398530,26401304:26403838,26401307:26402897,26401310:26402714,26402842:26403951,26402844:26403113,26402847:26402974,26404068:26405119,26405437:26406806,26406707:26406861,26412328:26413102,26429205:26429302,26430496:26430716,26431342:26431445,26436971:26437871,26436973:26437799,26436975:26437438,26441388:26441784,26444617:26445618,26444674:26445066,26444677:26444866,26445671:26452671,26447554:26447727,26447557:26447875,26451267:26468587,26483518:26486104,26483562:26483845,26483566:26483958,26483569:26484145,26487472:26489784,26487475:26490023,26487477:26489974,26487479:26489639,26487481:26489541,26487483:26488928,26487485:26488524,26487487:26488657,26487488:26488785,26487492:26487811,26491214:26513674,26491215:26492063,26491223:26495990,26491225:26491914,26491228:26492381,26491231:26500211,26491233:26491798,26492185:26516840,26494008:26494786,26494010:26513346,26494012:26495643,26494022:26513235,26494024:2649830', 'assoc_mat': '26387880:pehd:4230:26388311,26391653:pehd:4230:26391758,26393938:pehd:4230:26394865,26397077:pehd:4230:26397696,26397098:pehd:4230:26397209,26397116:pehd:4230:26398530,26401304:pehd:4230:26403838,26401307:pehd:4230:26402897,26401310:pehd:4230:26402714,26402842:pehd:4230:26403951,26402844:pehd:4230:26403113,26402847:pehd:4230:26402974,26404068:pehd:4230:26405119,26405437:pehd:4230:26406806,26406707:pehd:4230:26406861,26412328:pehd:4230:26413102,26429205:pehd:4230:26429302,26430496:pehd:4230:26430716,26431342:pehd:4230:26431445,26436971:pehd:4230:26437871,26436973:pehd:4230:26437799,26436975:pehd:4230:26437438,26441388:pehd:4230:26441784,26444617:pehd:4230:26445618,26444674:pehd:4230:26445066,26444677:pehd:4230:26444866,26445671:pehd:4230:26452671,26447554:pehd:4230:26447727,26447557:pehd:4230:26447875,26451267:pehd:4230:26468587,26483518:pehd:4230:26486104,26483562:pehd:4230:26483845,26483566:pehd:4230:26483958,26483569:pehd:4230:26484145,26487472:pehd:4230:26489784,26487475:pehd:4230:26490023,26487477:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.010880649466079126, 'nb_photo': 86361, 'list_port_cont': '26388088,26388126,26388309,26388372,26388555,26389680,26390057,26390486,26390550,26390910,26391248,26391308,26391347,26391752,26394320,26394419,26394618,26394785,26394872,26395178,26395237,26395948,26397217,26397646,26397705,26397984,26398149,26398251,26398528,26401675,26401865,26402661,26402709,26402888,26402972,26403024,26403117,26403376,26403830,26403943,26404277,26405121,26405675,26405902,26406245,26406803,26406872,26406991,26407754,26407982,26408087,26408203,26408322,26413037,26413096,26413284,26413329,26413451,26415584,26429301,26430718,26431440,26437110,26437160,26437276,26437436,26437608,26437793,26437833,26437877,26440441,26441783,26441862,26442846,26444858,26444944,26445075,26445122,26445161,26445292,26445326,26445348,26445413,26445458,26445523,26445556,26445620,26445717,26445952,26446019,26446490,26446939,26447036,26447283,26447424,26447603,26447723,26447876,26447929,26448019,26448358,26448746,26448832,26448875,26449545,26450496,26450518,26450637,26450744,26451710,26452616,26452666,26457413,2646858', 'assoc_port': '26387880:26388309,26387883:26388126,26387886:26388088,26388156:26388555,26388158:26388372,26389291:26389680,26390001:26390057,26390313:26390910,26390315:26390550,26390382:26390486,26391171:26391347,26391173:26391308,26391176:26391248,26391653:26391752,26393935:26394785,26393938:26394872,26393940:26394618,26393943:26394419,26393946:26394320,26395041:26395237,26395043:26395178,26395862:26395948,26397071:26398149,26397073:26398251,26397075:26397984,26397077:26397705,26397096:26397646,26397098:26397217,26397116:26398528,26401302:26403376,26401304:26403830,26401307:26402888,26401310:26402709,26401312:26402661,26401316:26403024,26401336:26401865,26401339:26401675,26402842:26403943,26402844:26403117,26402847:26402972,26404068:26405121,26404069:26404277,26405437:26406803,26405440:26406245,26405443:26405675,26405446:26405902,26406706:26406991,26406707:26406872,26407578:26408203,26407579:26408322,26407580:26408087,26407581:26407982,26407582:26407754,26412322:26413329,26412324:26413037,26412325:26413284,26412327:2641345', 'assoc_mat': '26387880:pet_clair:4230:26388309,26387883:pet_clair:4230:26388126,26387886:pet_clair:4230:26388088,26388156:pet_clair:4230:26388555,26388158:pet_clair:4230:26388372,26389291:pet_clair:4230:26389680,26390001:pet_clair:4230:26390057,26390313:pet_clair:4230:26390910,26390315:pet_clair:4230:26390550,26390382:pet_clair:4230:26390486,26391171:pet_clair:4230:26391347,26391173:pet_clair:4230:26391308,26391176:pet_clair:4230:26391248,26391653:pet_clair:4230:26391752,26393935:pet_clair:4230:26394785,26393938:pet_clair:4230:26394872,26393940:pet_clair:4230:26394618,26393943:pet_clair:4230:26394419,26393946:pet_clair:4230:26394320,26395041:pet_clair:4230:26395237,26395043:pet_clair:4230:26395178,26395862:pet_clair:4230:26395948,26397071:pet_clair:4230:26398149,26397073:pet_clair:4230:26398251,26397075:pet_clair:4230:26397984,26397077:pet_clair:4230:26397705,26397096:pet_clair:4230:26397646,26397098:pet_clair:4230:26397217,26397116:pet_clair:4230:26398528,26401302:pet_clair:4230:26403376,26401304:pet_clair:4230:26403830,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0017838803725459, 'nb_photo': 1433, 'list_port_cont': '26388090,26388134,26388299,26391246,26391303,26394873,26395953,26398147,26398249,26401671,26401862,26402894,26402971,26403843,26403947,26405112,26405900,26406243,26406809,26407762,26407968,26408206,26408335,26413450,26430727,26437106,26437156,26437442,26437607,26437798,26437870,26440450,26444947,26445068,26447428,26447712,26447877,26450645,26451702,26452667,26468589,26483847,26483955,26484144,26484647,26484719,26485688,26486111,26486442,26486702,26487805,26487871,26488790,26489545,26489632,26489787,26489967,26490028,26491659,26491796,26491905,26492075,26492377,26494321,26494468,26494533,26494781,26495648,26496069,26496824,26497586,26498210,26498309,26498579,26499990,26500039,26503378,26503525,26504032,26510323,26510907,26511512,26512163,26512608,26513142,26513240,26513350,26513452,26513675,26516837,26529112,26531594,26534666,26535274,26535454,26538475,26538704,26539111,26539953,26540292,26540891,26541075,26541108,26541228,26543284,26543869,26544710,26545170,26545584,26546133,26552412,26568241,26570711,2657128', 'assoc_port': '26387880:26388299,26387883:26388134,26387886:26388090,26391173:26391303,26391176:26391246,26393938:26394873,26395862:26395953,26397071:26398147,26397073:26398249,26401304:26403843,26401307:26402894,26401336:26401862,26401339:26401671,26402842:26403947,26402847:26402971,26404068:26405112,26405437:26406809,26405440:26406243,26405446:26405900,26407578:26408206,26407579:26408335,26407581:26407968,26407582:26407762,26412327:26413450,26430496:26430727,26436971:26437870,26436973:26437798,26436974:26437607,26436975:26437442,26436977:26437106,26436988:26437156,26440347:26440450,26444671:26444947,26444674:26445068,26445668:26447428,26445671:26452667,26447554:26447712,26447557:26447877,26449901:26450645,26451264:26451702,26451267:26468589,26483485:26486702,26483513:26486442,26483518:26486111,26483526:26484719,26483556:26484647,26483562:26483847,26483566:26483955,26483569:26484144,26485012:26485688,26487472:26489787,26487475:26490028,26487477:26489967,26487479:26489632,26487481:26489545,26487488:26488790,26487490:2648787', 'assoc_mat': '26387880:pet_fonce:4230:26388299,26387883:pet_fonce:4230:26388134,26387886:pet_fonce:4230:26388090,26391173:pet_fonce:4230:26391303,26391176:pet_fonce:4230:26391246,26393938:pet_fonce:4230:26394873,26395862:pet_fonce:4230:26395953,26397071:pet_fonce:4230:26398147,26397073:pet_fonce:4230:26398249,26401304:pet_fonce:4230:26403843,26401307:pet_fonce:4230:26402894,26401336:pet_fonce:4230:26401862,26401339:pet_fonce:4230:26401671,26402842:pet_fonce:4230:26403947,26402847:pet_fonce:4230:26402971,26404068:pet_fonce:4230:26405112,26405437:pet_fonce:4230:26406809,26405440:pet_fonce:4230:26406243,26405446:pet_fonce:4230:26405900,26407578:pet_fonce:4230:26408206,26407579:pet_fonce:4230:26408335,26407581:pet_fonce:4230:26407968,26407582:pet_fonce:4230:26407762,26412327:pet_fonce:4230:26413450,26430496:pet_fonce:4230:26430727,26436971:pet_fonce:4230:26437870,26436973:pet_fonce:4230:26437798,26436974:pet_fonce:4230:26437607,26436975:pet_fonce:4230:26437442,26436977:pet_fonce:4230:26437106,26436988:pet_fonce:4230:26437156,2'}), 'main_stat': {'nb_photos': 8946}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'host': 'marlene.fotonower.com', 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((8946,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 8946),), 'material_dict': {'truck': 8946}, 'coverage_data': (('2025/09/20/', 0.24572), ('2025/09/19/', 0.245489), ('2025/09/18/', 0.245026), ('2025/09/17/', 0.245142), ('2025/09/16/', 0.245605), ('2025/09/15/', 0.245142), ('2025/09/14/', 0.245373), ('2025/09/13/', 0.245489), ('2025/09/12/', 0.245026), ('2025/09/11/', 0.228128), ('2025/09/10/', 0.241091), ('2025/09/09/', 0.239007), ('2025/09/08/', 0.241322), ('2025/09/07/', 0.243058), ('2025/09/06/', 0.241669), ('2025/09/05/', 0.240049), ('2025/09/04/', 0.238544), ('2025/09/03/', 0.243753), ('2025/09/02/', 0.244216), ('2025/09/01/', 0.24491)), 'impurety_average_data': ((datetime.date(2025, 9, 1), 0.1552017312537881, 6), (datetime.date(2025, 9, 2), 0.16471219526209202, 2), (datetime.date(2025, 9, 3), 0.18377363694590113, 2), (datetime.date(2025, 9, 4), 0.1736069699957586, 7), (datetime.date(2025, 9, 5), 0.18128884148413335, 10), (datetime.date(2025, 9, 6), 0.22863492161408816, 2), (datetime.date(2025, 9, 7), 0.15431694042082972, 6), (datetime.date(2025, 9, 8), 0.18295958512049326, 2), (datetime.date(2025, 9, 9), 0.18053673250643892, 2), (datetime.date(2025, 9, 10), 0.1703095922934771, 4), (datetime.date(2025, 9, 11), 0.1867896697644957, 2), (datetime.date(2025, 9, 12), 0.19222573768857024, 2), (datetime.date(2025, 9, 13), 0.16755800283988204, 2), (datetime.date(2025, 9, 14), 0.0968343917413466, 2), (datetime.date(2025, 9, 15), 0.1464269536586346, 5), (datetime.date(2025, 9, 16), 0.17955871669847134, 2), (datetime.date(2025, 9, 17), 0.17368311047152674, 3), (datetime.date(2025, 9, 18), 0.16903272592709423, 7), (datetime.date(2025, 9, 19), 0.16222428482562382, 8), (datetime.date(2025, 9, 20), 0.16237311835078927, 3)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 9, 1), 0.1552017312537881, 6), (datetime.date(2025, 9, 2), 0.16471219526209202, 2), (datetime.date(2025, 9, 3), 0.18377363694590113, 2), (datetime.date(2025, 9, 4), 0.1736069699957586, 7), (datetime.date(2025, 9, 5), 0.18128884148413335, 10), (datetime.date(2025, 9, 6), 0.22863492161408816, 2), (datetime.date(2025, 9, 7), 0.15431694042082972, 6), (datetime.date(2025, 9, 8), 0.18295958512049326, 2), (datetime.date(2025, 9, 9), 0.18053673250643892, 2), (datetime.date(2025, 9, 10), 0.1703095922934771, 4), (datetime.date(2025, 9, 11), 0.1867896697644957, 2), (datetime.date(2025, 9, 12), 0.19222573768857024, 2), (datetime.date(2025, 9, 13), 0.16755800283988204, 2), (datetime.date(2025, 9, 14), 0.0968343917413466, 2), (datetime.date(2025, 9, 15), 0.1464269536586346, 5), (datetime.date(2025, 9, 16), 0.17955871669847134, 2), (datetime.date(2025, 9, 17), 0.17368311047152674, 3), (datetime.date(2025, 9, 18), 0.16903272592709423, 7), (datetime.date(2025, 9, 19), 0.16222428482562382, 8), (datetime.date(2025, 9, 20), 0.16237311835078927, 3))}, 'quality_array': [['-7.2980256317995265', '01092025'], ['-7.29952252605813', '02092025'], ['-7.175730886457139', '03092025'], ['-7.241689054835383', '04092025'], ['-7.246065495855396', '05092025'], ['-7.385405723299512', '06092025'], ['-7.104757200482503', '07092025'], ['-7.222787724948354', '08092025'], ['-7.5692024844542045', '09092025'], ['-7.433611193808795', '10092025'], ['-7.486496143649586', '11092025'], ['-7.129505969126315', '12092025'], ['-7.4122306671873455', '13092025'], ['-6.227791133565665', '14092025'], ['-7.203307195503365', '15092025'], ['-7.408506463391629', '16092025'], ['-7.515814731403351', '17092025'], ['-7.382309811010424', '18092025'], ['-7.438637193334269', '19092025'], ['-7.58106381408741', '20092025']], 'number_of_batch': ((1290,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.02528741819396792, 'nb_photo': 147587, 'list_port_cont': '26388083,26388119,26388308,26388383,26388554,26389679,26390065,26390484,26390539,26390909,26391238,26391314,26391346,26391749,26394313,26394414,26394617,26394779,26394860,26395164,26395232,26395946,26397208,26397641,26397697,26397973,26398143,26398242,26398537,26401678,26401857,26402653,26402708,26402887,26402966,26403029,26403101,26403368,26403841,26403936,26404280,26405115,26405658,26405908,26406235,26406793,26406867,26406995,26407746,26407972,26408085,26408213,26408327,26413040,26413100,26413279,26413322,26413440,26415578,26429305,26430720,26431448,26437104,26437150,26437261,26437439,26437611,26437797,26437821,26437875,26440440,26441780,26441870,26442849,26444860,26444934,26445065,26445115,26445163,26445289,26445315,26445333,26445407,26445454,26445527,26445562,26445610,26445705,26445953,26446002,26446477,26446941,26447033,26447270,26447421,26447606,26447717,26447869,26447915,26448003,26448360,26448734,26448820,26448861,26449544,26450495,26450509,26450633,26450753,26451699,26452614,26452663,26457405,2646857', 'assoc_port': '26387880:26388308,26387883:26388119,26387886:26388083,26388156:26388554,26388158:26388383,26389291:26389679,26390001:26390065,26390313:26390909,26390315:26390539,26390382:26390484,26391171:26391346,26391173:26391314,26391176:26391238,26391653:26391749,26393935:26394779,26393938:26394860,26393940:26394617,26393943:26394414,26393946:26394313,26395041:26395232,26395043:26395164,26395862:26395946,26397071:26398143,26397073:26398242,26397075:26397973,26397077:26397697,26397096:26397641,26397098:26397208,26397116:26398537,26401302:26403368,26401304:26403841,26401307:26402887,26401310:26402708,26401312:26402653,26401316:26403029,26401336:26401857,26401339:26401678,26402842:26403936,26402844:26403101,26402847:26402966,26404068:26405115,26404069:26404280,26405437:26406793,26405440:26406235,26405443:26405658,26405446:26405908,26406706:26406995,26406707:26406867,26407578:26408213,26407579:26408327,26407580:26408085,26407581:26407972,26407582:26407746,26412322:26413322,26412324:26413040,26412325:26413279,26412327:2641344', 'assoc_mat': '26387880:autre:4230:26388308,26387883:autre:4230:26388119,26387886:autre:4230:26388083,26388156:autre:4230:26388554,26388158:autre:4230:26388383,26389291:autre:4230:26389679,26390001:autre:4230:26390065,26390313:autre:4230:26390909,26390315:autre:4230:26390539,26390382:autre:4230:26390484,26391171:autre:4230:26391346,26391173:autre:4230:26391314,26391176:autre:4230:26391238,26391653:autre:4230:26391749,26393935:autre:4230:26394779,26393938:autre:4230:26394860,26393940:autre:4230:26394617,26393943:autre:4230:26394414,26393946:autre:4230:26394313,26395041:autre:4230:26395232,26395043:autre:4230:26395164,26395862:autre:4230:26395946,26397071:autre:4230:26398143,26397073:autre:4230:26398242,26397075:autre:4230:26397973,26397077:autre:4230:26397697,26397096:autre:4230:26397641,26397098:autre:4230:26397208,26397116:autre:4230:26398537,26401302:autre:4230:26403368,26401304:autre:4230:26403841,26401307:autre:4230:26402887,26401310:autre:4230:26402708,26401312:autre:4230:26402653,26401316:autre:4230:26403029,26401336:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.026509142758858194, 'nb_photo': 175670, 'list_port_cont': '26388089,26388131,26388296,26388377,26388547,26389676,26390060,26390483,26390552,26390916,26391245,26391312,26391350,26391762,26394311,26394418,26394622,26394788,26394870,26395165,26395240,26395952,26397221,26397631,26397706,26397985,26398146,26398250,26398527,26401680,26401863,26402649,26402701,26402892,26402973,26403021,26403116,26403380,26403842,26403952,26404281,26405107,26405666,26405907,26406241,26406807,26406870,26406990,26407760,26407974,26408077,26408210,26408332,26413035,26413089,26413281,26413323,26413438,26415583,26429306,26430731,26431441,26437101,26437149,26437277,26437443,26437606,26437794,26437837,26437876,26440451,26441790,26441867,26442850,26444862,26444931,26445064,26445129,26445158,26445284,26445323,26445337,26445417,26445465,26445530,26445565,26445622,26445720,26445960,26446005,26446488,26446940,26447034,26447280,26447429,26447608,26447718,26447871,26447919,26448015,26448357,26448744,26448833,26448874,26449543,26450493,26450516,26450630,26450748,26451701,26452606,26452669,26457410,2646858', 'assoc_port': '26387880:26388296,26387883:26388131,26387886:26388089,26388156:26388547,26388158:26388377,26389291:26389676,26390001:26390060,26390313:26390916,26390315:26390552,26390382:26390483,26391171:26391350,26391173:26391312,26391176:26391245,26391653:26391762,26393935:26394788,26393938:26394870,26393940:26394622,26393943:26394418,26393946:26394311,26395041:26395240,26395043:26395165,26395862:26395952,26397071:26398146,26397073:26398250,26397075:26397985,26397077:26397706,26397096:26397631,26397098:26397221,26397116:26398527,26401302:26403380,26401304:26403842,26401307:26402892,26401310:26402701,26401312:26402649,26401316:26403021,26401336:26401863,26401339:26401680,26402842:26403952,26402844:26403116,26402847:26402973,26404068:26405107,26404069:26404281,26405437:26406807,26405440:26406241,26405443:26405666,26405446:26405907,26406706:26406990,26406707:26406870,26407578:26408210,26407579:26408332,26407580:26408077,26407581:26407974,26407582:26407760,26412322:26413323,26412324:26413035,26412325:26413281,26412327:2641343', 'assoc_mat': '26387880:carton:4230:26388296,26387883:carton:4230:26388131,26387886:carton:4230:26388089,26388156:carton:4230:26388547,26388158:carton:4230:26388377,26389291:carton:4230:26389676,26390001:carton:4230:26390060,26390313:carton:4230:26390916,26390315:carton:4230:26390552,26390382:carton:4230:26390483,26391171:carton:4230:26391350,26391173:carton:4230:26391312,26391176:carton:4230:26391245,26391653:carton:4230:26391762,26393935:carton:4230:26394788,26393938:carton:4230:26394870,26393940:carton:4230:26394622,26393943:carton:4230:26394418,26393946:carton:4230:26394311,26395041:carton:4230:26395240,26395043:carton:4230:26395165,26395862:carton:4230:26395952,26397071:carton:4230:26398146,26397073:carton:4230:26398250,26397075:carton:4230:26397985,26397077:carton:4230:26397706,26397096:carton:4230:26397631,26397098:carton:4230:26397221,26397116:carton:4230:26398527,26401302:carton:4230:26403380,26401304:carton:4230:26403842,26401307:carton:4230:26402892,26401310:carton:4230:26402701,26401312:carton:4230:26402649,2640'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.006085949094165609, 'nb_photo': 7766, 'list_port_cont': '26388086,26388301,26388376,26388544,26389677,26390479,26390542,26390911,26391237,26391313,26391354,26391746,26394319,26394623,26394782,26394859,26395170,26395242,26395947,26397978,26398148,26398531,26401670,26402663,26402698,26402896,26402970,26403013,26403118,26403844,26403940,26404275,26405120,26405906,26406232,26406800,26406856,26407000,26407740,26407980,26408075,26408333,26413087,26413283,26413447,26429303,26430722,26431443,26437097,26437148,26437427,26437603,26437783,26437874,26441781,26442839,26444861,26445077,26445112,26445164,26445321,26445336,26445466,26445615,26445721,26445957,26446476,26446924,26447601,26447870,26447925,26448008,26448353,26448743,26448836,26448868,26449530,26450494,26450506,26450632,26450736,26451694,26452619,26452665,26468591,26479710,26479915,26480260,26480364,26483834,26483957,26484143,26484380,26484446,26484648,26484711,26484759,26485274,26485412,26485678,26485989,26486102,26486167,26486310,26486695,26487876,26488504,26488644,26488786,26488892,26488929,26489046,26489311,2648954', 'assoc_port': '26387880:26388301,26387886:26388086,26388156:26388544,26388158:26388376,26389291:26389677,26390313:26390911,26390315:26390542,26390382:26390479,26391171:26391354,26391173:26391313,26391176:26391237,26391653:26391746,26393935:26394782,26393938:26394859,26393940:26394623,26393946:26394319,26395041:26395242,26395043:26395170,26395862:26395947,26397071:26398148,26397075:26397978,26397116:26398531,26401304:26403844,26401307:26402896,26401310:26402698,26401312:26402663,26401316:26403013,26401339:26401670,26402842:26403940,26402844:26403118,26402847:26402970,26404068:26405120,26404069:26404275,26405437:26406800,26405440:26406232,26405446:26405906,26406706:26407000,26406707:26406856,26407579:26408333,26407580:26408075,26407581:26407980,26407582:26407740,26412325:26413283,26412327:26413447,26412328:26413087,26429205:26429303,26430496:26430722,26431342:26431443,26436971:26437874,26436973:26437783,26436974:26437603,26436975:26437427,26436977:26437097,26436988:26437148,26441388:26441781,26442694:26442839,26444606:2644835', 'assoc_mat': '26387880:metal:4230:26388301,26387886:metal:4230:26388086,26388156:metal:4230:26388544,26388158:metal:4230:26388376,26389291:metal:4230:26389677,26390313:metal:4230:26390911,26390315:metal:4230:26390542,26390382:metal:4230:26390479,26391171:metal:4230:26391354,26391173:metal:4230:26391313,26391176:metal:4230:26391237,26391653:metal:4230:26391746,26393935:metal:4230:26394782,26393938:metal:4230:26394859,26393940:metal:4230:26394623,26393946:metal:4230:26394319,26395041:metal:4230:26395242,26395043:metal:4230:26395170,26395862:metal:4230:26395947,26397071:metal:4230:26398148,26397075:metal:4230:26397978,26397116:metal:4230:26398531,26401304:metal:4230:26403844,26401307:metal:4230:26402896,26401310:metal:4230:26402698,26401312:metal:4230:26402663,26401316:metal:4230:26403013,26401339:metal:4230:26401670,26402842:metal:4230:26403940,26402844:metal:4230:26403118,26402847:metal:4230:26402970,26404068:metal:4230:26405120,26404069:metal:4230:26404275,26405437:metal:4230:26406800,26405440:metal:4230:26406232,26405446:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10970667183611786, 'nb_photo': 471517, 'list_port_cont': '26388084,26388128,26388306,26388391,26388556,26389674,26390067,26390493,26390549,26390921,26391249,26391310,26391357,26391753,26394310,26394416,26394628,26394791,26394874,26395167,26395229,26395954,26397223,26397647,26397701,26397981,26398151,26398241,26398538,26401679,26401861,26402659,26402713,26402893,26402978,26403017,26403108,26403382,26403837,26403953,26404273,26405118,26405673,26405911,26406239,26406808,26406864,26406998,26407748,26407983,26408082,26408205,26408329,26413032,26413101,26413285,26413327,26413452,26415591,26429307,26430730,26431439,26437102,26437161,26437275,26437441,26437610,26437786,26437836,26437872,26440446,26441793,26441866,26442848,26444865,26444946,26445076,26445127,26445168,26445281,26445327,26445346,26445415,26445468,26445531,26445557,26445621,26445711,26445962,26446018,26446483,26446929,26447032,26447281,26447427,26447600,26447726,26447865,26447927,26448020,26448364,26448739,26448826,26448876,26449541,26450499,26450507,26450639,26450751,26451705,26452610,26452668,26457409,2646859', 'assoc_port': '26387880:26388306,26387883:26388128,26387886:26388084,26388156:26388556,26388158:26388391,26389291:26389674,26390001:26390067,26390313:26390921,26390315:26390549,26390382:26390493,26391171:26391357,26391173:26391310,26391176:26391249,26391653:26391753,26393935:26394791,26393938:26394874,26393940:26394628,26393943:26394416,26393946:26394310,26395041:26395229,26395043:26395167,26395862:26395954,26397071:26398151,26397073:26398241,26397075:26397981,26397077:26397701,26397096:26397647,26397098:26397223,26397116:26398538,26401302:26403382,26401304:26403837,26401307:26402893,26401310:26402713,26401312:26402659,26401316:26403017,26401336:26401861,26401339:26401679,26402842:26403953,26402844:26403108,26402847:26402978,26404068:26405118,26404069:26404273,26405437:26406808,26405440:26406239,26405443:26405673,26405446:26405911,26406706:26406998,26406707:26406864,26407578:26408205,26407579:26408329,26407580:26408082,26407581:26407983,26407582:26407748,26412322:26413327,26412324:26413032,26412325:26413285,26412327:2641345', 'assoc_mat': '26387880:papier:4230:26388306,26387883:papier:4230:26388128,26387886:papier:4230:26388084,26388156:papier:4230:26388556,26388158:papier:4230:26388391,26389291:papier:4230:26389674,26390001:papier:4230:26390067,26390313:papier:4230:26390921,26390315:papier:4230:26390549,26390382:papier:4230:26390493,26391171:papier:4230:26391357,26391173:papier:4230:26391310,26391176:papier:4230:26391249,26391653:papier:4230:26391753,26393935:papier:4230:26394791,26393938:papier:4230:26394874,26393940:papier:4230:26394628,26393943:papier:4230:26394416,26393946:papier:4230:26394310,26395041:papier:4230:26395229,26395043:papier:4230:26395167,26395862:papier:4230:26395954,26397071:papier:4230:26398151,26397073:papier:4230:26398241,26397075:papier:4230:26397981,26397077:papier:4230:26397701,26397096:papier:4230:26397647,26397098:papier:4230:26397223,26397116:papier:4230:26398538,26401302:papier:4230:26403382,26401304:papier:4230:26403837,26401307:papier:4230:26402893,26401310:papier:4230:26402713,26401312:papier:4230:26402659,2640'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.001263730155304897, 'nb_photo': 1973, 'list_port_cont': '26388311,26391758,26394865,26397209,26397696,26398530,26402714,26402897,26402974,26403113,26403838,26403951,26405119,26406806,26406861,26413102,26429302,26430716,26431445,26437438,26437799,26437871,26441784,26444866,26445066,26445618,26447727,26447875,26452671,26468587,26483845,26483958,26484145,26486104,26487811,26488524,26488657,26488785,26488928,26489541,26489639,26489784,26489974,26490023,26491798,26491914,26492063,26492381,26494335,26494460,26494786,26495643,26495990,26496071,26496821,26497592,26498207,26498306,26499018,26500045,26500211,26503061,26503429,26503608,26503704,26503849,26504034,26510075,26510487,26510590,26510789,26513139,26513235,26513346,26513459,26513674,26516840,26529107,26531588,26532411,26532520,26532732,26532903,26535263,26535406,26535448,26537746,26538247,26538702,26538834,26539195,26541074,26541112,26544255,26545172,26545288,26545580,26569228,26569385,26571148,26571286,26571613,26572938,26575328,26575928,26576048,26576452,26576506,26576558,26576716,26576849,26577023,26577103,2657713', 'assoc_port': '26387880:26388311,26391653:26391758,26393938:26394865,26397077:26397696,26397098:26397209,26397116:26398530,26401304:26403838,26401307:26402897,26401310:26402714,26402842:26403951,26402844:26403113,26402847:26402974,26404068:26405119,26405437:26406806,26406707:26406861,26412328:26413102,26429205:26429302,26430496:26430716,26431342:26431445,26436971:26437871,26436973:26437799,26436975:26437438,26441388:26441784,26444617:26445618,26444674:26445066,26444677:26444866,26445671:26452671,26447554:26447727,26447557:26447875,26451267:26468587,26483518:26486104,26483562:26483845,26483566:26483958,26483569:26484145,26487472:26489784,26487475:26490023,26487477:26489974,26487479:26489639,26487481:26489541,26487483:26488928,26487485:26488524,26487487:26488657,26487488:26488785,26487492:26487811,26491214:26513674,26491215:26492063,26491223:26495990,26491225:26491914,26491228:26492381,26491231:26500211,26491233:26491798,26492185:26516840,26494008:26494786,26494010:26513346,26494012:26495643,26494022:26513235,26494024:2649830', 'assoc_mat': '26387880:pehd:4230:26388311,26391653:pehd:4230:26391758,26393938:pehd:4230:26394865,26397077:pehd:4230:26397696,26397098:pehd:4230:26397209,26397116:pehd:4230:26398530,26401304:pehd:4230:26403838,26401307:pehd:4230:26402897,26401310:pehd:4230:26402714,26402842:pehd:4230:26403951,26402844:pehd:4230:26403113,26402847:pehd:4230:26402974,26404068:pehd:4230:26405119,26405437:pehd:4230:26406806,26406707:pehd:4230:26406861,26412328:pehd:4230:26413102,26429205:pehd:4230:26429302,26430496:pehd:4230:26430716,26431342:pehd:4230:26431445,26436971:pehd:4230:26437871,26436973:pehd:4230:26437799,26436975:pehd:4230:26437438,26441388:pehd:4230:26441784,26444617:pehd:4230:26445618,26444674:pehd:4230:26445066,26444677:pehd:4230:26444866,26445671:pehd:4230:26452671,26447554:pehd:4230:26447727,26447557:pehd:4230:26447875,26451267:pehd:4230:26468587,26483518:pehd:4230:26486104,26483562:pehd:4230:26483845,26483566:pehd:4230:26483958,26483569:pehd:4230:26484145,26487472:pehd:4230:26489784,26487475:pehd:4230:26490023,26487477:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.010880649466079126, 'nb_photo': 86361, 'list_port_cont': '26388088,26388126,26388309,26388372,26388555,26389680,26390057,26390486,26390550,26390910,26391248,26391308,26391347,26391752,26394320,26394419,26394618,26394785,26394872,26395178,26395237,26395948,26397217,26397646,26397705,26397984,26398149,26398251,26398528,26401675,26401865,26402661,26402709,26402888,26402972,26403024,26403117,26403376,26403830,26403943,26404277,26405121,26405675,26405902,26406245,26406803,26406872,26406991,26407754,26407982,26408087,26408203,26408322,26413037,26413096,26413284,26413329,26413451,26415584,26429301,26430718,26431440,26437110,26437160,26437276,26437436,26437608,26437793,26437833,26437877,26440441,26441783,26441862,26442846,26444858,26444944,26445075,26445122,26445161,26445292,26445326,26445348,26445413,26445458,26445523,26445556,26445620,26445717,26445952,26446019,26446490,26446939,26447036,26447283,26447424,26447603,26447723,26447876,26447929,26448019,26448358,26448746,26448832,26448875,26449545,26450496,26450518,26450637,26450744,26451710,26452616,26452666,26457413,2646858', 'assoc_port': '26387880:26388309,26387883:26388126,26387886:26388088,26388156:26388555,26388158:26388372,26389291:26389680,26390001:26390057,26390313:26390910,26390315:26390550,26390382:26390486,26391171:26391347,26391173:26391308,26391176:26391248,26391653:26391752,26393935:26394785,26393938:26394872,26393940:26394618,26393943:26394419,26393946:26394320,26395041:26395237,26395043:26395178,26395862:26395948,26397071:26398149,26397073:26398251,26397075:26397984,26397077:26397705,26397096:26397646,26397098:26397217,26397116:26398528,26401302:26403376,26401304:26403830,26401307:26402888,26401310:26402709,26401312:26402661,26401316:26403024,26401336:26401865,26401339:26401675,26402842:26403943,26402844:26403117,26402847:26402972,26404068:26405121,26404069:26404277,26405437:26406803,26405440:26406245,26405443:26405675,26405446:26405902,26406706:26406991,26406707:26406872,26407578:26408203,26407579:26408322,26407580:26408087,26407581:26407982,26407582:26407754,26412322:26413329,26412324:26413037,26412325:26413284,26412327:2641345', 'assoc_mat': '26387880:pet_clair:4230:26388309,26387883:pet_clair:4230:26388126,26387886:pet_clair:4230:26388088,26388156:pet_clair:4230:26388555,26388158:pet_clair:4230:26388372,26389291:pet_clair:4230:26389680,26390001:pet_clair:4230:26390057,26390313:pet_clair:4230:26390910,26390315:pet_clair:4230:26390550,26390382:pet_clair:4230:26390486,26391171:pet_clair:4230:26391347,26391173:pet_clair:4230:26391308,26391176:pet_clair:4230:26391248,26391653:pet_clair:4230:26391752,26393935:pet_clair:4230:26394785,26393938:pet_clair:4230:26394872,26393940:pet_clair:4230:26394618,26393943:pet_clair:4230:26394419,26393946:pet_clair:4230:26394320,26395041:pet_clair:4230:26395237,26395043:pet_clair:4230:26395178,26395862:pet_clair:4230:26395948,26397071:pet_clair:4230:26398149,26397073:pet_clair:4230:26398251,26397075:pet_clair:4230:26397984,26397077:pet_clair:4230:26397705,26397096:pet_clair:4230:26397646,26397098:pet_clair:4230:26397217,26397116:pet_clair:4230:26398528,26401302:pet_clair:4230:26403376,26401304:pet_clair:4230:26403830,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0017838803725459, 'nb_photo': 1433, 'list_port_cont': '26388090,26388134,26388299,26391246,26391303,26394873,26395953,26398147,26398249,26401671,26401862,26402894,26402971,26403843,26403947,26405112,26405900,26406243,26406809,26407762,26407968,26408206,26408335,26413450,26430727,26437106,26437156,26437442,26437607,26437798,26437870,26440450,26444947,26445068,26447428,26447712,26447877,26450645,26451702,26452667,26468589,26483847,26483955,26484144,26484647,26484719,26485688,26486111,26486442,26486702,26487805,26487871,26488790,26489545,26489632,26489787,26489967,26490028,26491659,26491796,26491905,26492075,26492377,26494321,26494468,26494533,26494781,26495648,26496069,26496824,26497586,26498210,26498309,26498579,26499990,26500039,26503378,26503525,26504032,26510323,26510907,26511512,26512163,26512608,26513142,26513240,26513350,26513452,26513675,26516837,26529112,26531594,26534666,26535274,26535454,26538475,26538704,26539111,26539953,26540292,26540891,26541075,26541108,26541228,26543284,26543869,26544710,26545170,26545584,26546133,26552412,26568241,26570711,2657128', 'assoc_port': '26387880:26388299,26387883:26388134,26387886:26388090,26391173:26391303,26391176:26391246,26393938:26394873,26395862:26395953,26397071:26398147,26397073:26398249,26401304:26403843,26401307:26402894,26401336:26401862,26401339:26401671,26402842:26403947,26402847:26402971,26404068:26405112,26405437:26406809,26405440:26406243,26405446:26405900,26407578:26408206,26407579:26408335,26407581:26407968,26407582:26407762,26412327:26413450,26430496:26430727,26436971:26437870,26436973:26437798,26436974:26437607,26436975:26437442,26436977:26437106,26436988:26437156,26440347:26440450,26444671:26444947,26444674:26445068,26445668:26447428,26445671:26452667,26447554:26447712,26447557:26447877,26449901:26450645,26451264:26451702,26451267:26468589,26483485:26486702,26483513:26486442,26483518:26486111,26483526:26484719,26483556:26484647,26483562:26483847,26483566:26483955,26483569:26484144,26485012:26485688,26487472:26489787,26487475:26490028,26487477:26489967,26487479:26489632,26487481:26489545,26487488:26488790,26487490:2648787', 'assoc_mat': '26387880:pet_fonce:4230:26388299,26387883:pet_fonce:4230:26388134,26387886:pet_fonce:4230:26388090,26391173:pet_fonce:4230:26391303,26391176:pet_fonce:4230:26391246,26393938:pet_fonce:4230:26394873,26395862:pet_fonce:4230:26395953,26397071:pet_fonce:4230:26398147,26397073:pet_fonce:4230:26398249,26401304:pet_fonce:4230:26403843,26401307:pet_fonce:4230:26402894,26401336:pet_fonce:4230:26401862,26401339:pet_fonce:4230:26401671,26402842:pet_fonce:4230:26403947,26402847:pet_fonce:4230:26402971,26404068:pet_fonce:4230:26405112,26405437:pet_fonce:4230:26406809,26405440:pet_fonce:4230:26406243,26405446:pet_fonce:4230:26405900,26407578:pet_fonce:4230:26408206,26407579:pet_fonce:4230:26408335,26407581:pet_fonce:4230:26407968,26407582:pet_fonce:4230:26407762,26412327:pet_fonce:4230:26413450,26430496:pet_fonce:4230:26430727,26436971:pet_fonce:4230:26437870,26436973:pet_fonce:4230:26437798,26436974:pet_fonce:4230:26437607,26436975:pet_fonce:4230:26437442,26436977:pet_fonce:4230:26437106,26436988:pet_fonce:4230:26437156,2'}), 'main_stat': {'nb_photos': 8946}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} filepath : /data_4/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_09_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'truck': {'autre': ['autre', '2.53%', 147587], 'carton': ['carton', '2.65%', 175670], 'metal': ['metal', '0.61%', 7766], 'papier': ['papier', '10.97%', 471517], 'pehd': ['pehd', '0.13%', 1973], 'pet_clair': ['pet_clair', '1.09%', 86361], 'pet_fonce': ['pet_fonce', '0.18%', 1433]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_4/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_09_annee_2025.pdf le fichier se trouve ici : /data_4/data_log/job/memo/dechet_Valcor_v2 2.85user 2.82system 0:18.10elapsed 31%CPU (0avgtext+0avgdata 178748maxresident)k 72inputs+592outputs (0major+46755minor)pagefaults 0swaps