python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20084 --dashboard_places=dechet_Valcor_v2 --rootfolder_sla=/data_2/data_log/job/memo/dechet_Valcor_v2 -v --mtr_id=1055 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : 2025-04 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (1, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (1, 30) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 132 month : 04 mtr_id : 1055 dashboard_places : dechet_Valcor_v2 date : 2025-04 year : 2025 raspi : 20084 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'dechet_Valcor_v2' and date like '%2025-04%') and created_at like '%2025-04%'))); nb_day : (1, 30) after unwanted_material_data nb_day : (1, 30) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20084%' AND ms.result_str like '%2025/04%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82737 seconds', 'coverage_times_pause': '0 days 85269 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 7610, 'nb_two_criteria_ok': 7610, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 896, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 543, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.9576152501765067}, 'dashboard_dict': {'nb_ptf_finished': 256, 'nb_images_finished': 2019, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2019, 'last_update': '2025/05/01', 'portfolio_id': 22527911, 'last_run_id': 1769651, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83036 seconds', 'coverage_times_pause': '0 days 85458 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7389, 'nb_two_criteria_ok': 7389, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1138, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 307, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9610759383789165}, 'dashboard_dict': {'nb_ptf_finished': 275, 'nb_images_finished': 2189, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 25, 'nb_selected_images': 2214, 'last_update': '2025/04/30', 'portfolio_id': 22483834, 'last_run_id': 1765327, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82737 seconds', 'coverage_times_pause': '0 days 85269 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 7610, 'nb_two_criteria_ok': 7610, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 896, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 543, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.9576152501765067}, 'dashboard_dict': {'nb_ptf_finished': 256, 'nb_images_finished': 2019, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2019, 'last_update': '2025/05/01', 'portfolio_id': 22527911, 'last_run_id': 1769651, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83036 seconds', 'coverage_times_pause': '0 days 85458 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7389, 'nb_two_criteria_ok': 7389, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1138, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 307, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9610759383789165}, 'dashboard_dict': {'nb_ptf_finished': 275, 'nb_images_finished': 2189, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 25, 'nb_selected_images': 2214, 'last_update': '2025/04/30', 'portfolio_id': 22483834, 'last_run_id': 1765327, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83059 seconds', 'coverage_times_pause': '0 days 85435 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7474, 'nb_two_criteria_ok': 7474, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1045, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7461, 'ratio_coverage': 0.9613421451637172}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82737 seconds', 'coverage_times_pause': '0 days 85269 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 7610, 'nb_two_criteria_ok': 7610, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 896, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 543, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.9576152501765067}, 'dashboard_dict': {'nb_ptf_finished': 256, 'nb_images_finished': 2019, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2019, 'last_update': '2025/05/01', 'portfolio_id': 22527911, 'last_run_id': 1769651, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83036 seconds', 'coverage_times_pause': '0 days 85458 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7389, 'nb_two_criteria_ok': 7389, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1138, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 307, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9610759383789165}, 'dashboard_dict': {'nb_ptf_finished': 275, 'nb_images_finished': 2189, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 25, 'nb_selected_images': 2214, 'last_update': '2025/04/30', 'portfolio_id': 22483834, 'last_run_id': 1765327, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83059 seconds', 'coverage_times_pause': '0 days 85435 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7474, 'nb_two_criteria_ok': 7474, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1045, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7461, 'ratio_coverage': 0.9613421451637172}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83118 seconds', 'coverage_times_pause': '0 days 85391 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7229, 'nb_two_criteria_ok': 7229, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1299, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1904, 'end_of_day_photos_uploaded': 5310, 'ratio_coverage': 0.9620250234377713}, 'dashboard_dict': {'nb_ptf_finished': 173, 'nb_images_finished': 1463, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 37, 'nb_images_started': 286, 'nb_selected_images': 1749, 'last_update': '2025/05/01', 'portfolio_id': 22415669, 'last_run_id': 1770253, 'total_number_of_photos': 7341}} No error ? {'log_dict': {'total_nb_images': 8502, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82737 seconds', 'coverage_times_pause': '0 days 85269 seconds', 'nb_photos_decision': 8508, 'nb_gray_level_ok': 8508, 'nb_dedup_ok': 7610, 'nb_two_criteria_ok': 7610, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 896, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 543, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.9576152501765067}, 'dashboard_dict': {'nb_ptf_finished': 256, 'nb_images_finished': 2019, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 2019, 'last_update': '2025/05/01', 'portfolio_id': 22527911, 'last_run_id': 1769651, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83036 seconds', 'coverage_times_pause': '0 days 85458 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7389, 'nb_two_criteria_ok': 7389, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1138, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 307, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9610759383789165}, 'dashboard_dict': {'nb_ptf_finished': 275, 'nb_images_finished': 2189, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 25, 'nb_selected_images': 2214, 'last_update': '2025/04/30', 'portfolio_id': 22483834, 'last_run_id': 1765327, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83059 seconds', 'coverage_times_pause': '0 days 85435 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7474, 'nb_two_criteria_ok': 7474, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1045, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7461, 'ratio_coverage': 0.9613421451637172}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83118 seconds', 'coverage_times_pause': '0 days 85391 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7229, 'nb_two_criteria_ok': 7229, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1299, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1904, 'end_of_day_photos_uploaded': 5310, 'ratio_coverage': 0.9620250234377713}, 'dashboard_dict': {'nb_ptf_finished': 124, 'nb_images_finished': 1172, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 52, 'nb_images_started': 318, 'nb_selected_images': 1490, 'last_update': '2025/04/29', 'portfolio_id': 22415669, 'last_run_id': 1761365, 'total_number_of_photos': 6366}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83036 seconds', 'coverage_times_pause': '0 days 85458 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7389, 'nb_two_criteria_ok': 7389, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1138, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 307, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9610759383789165}, 'dashboard_dict': {'nb_ptf_finished': 275, 'nb_images_finished': 2189, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 1, 'nb_images_started': 25, 'nb_selected_images': 2214, 'last_update': '2025/04/30', 'portfolio_id': 22483834, 'last_run_id': 1765327, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83059 seconds', 'coverage_times_pause': '0 days 85435 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7474, 'nb_two_criteria_ok': 7474, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1045, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7461, 'ratio_coverage': 0.9613421451637172}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83118 seconds', 'coverage_times_pause': '0 days 85391 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7229, 'nb_two_criteria_ok': 7229, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1299, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1904, 'end_of_day_photos_uploaded': 5310, 'ratio_coverage': 0.9620250234377713}, 'dashboard_dict': {'nb_ptf_finished': 124, 'nb_images_finished': 1172, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 52, 'nb_images_started': 318, 'nb_selected_images': 1490, 'last_update': '2025/04/29', 'portfolio_id': 22415669, 'last_run_id': 1761365, 'total_number_of_photos': 5406}} No error ? {'log_dict': {'total_nb_images': 8507, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85319 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7715, 'nb_two_criteria_ok': 7715, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 803, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 629, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 155, 'nb_images_finished': 1203, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1203, 'last_update': '2025/04/25', 'portfolio_id': 22366340, 'last_run_id': 1755682, 'total_number_of_photos': 7362}} No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83434 seconds', 'coverage_times_pause': '0 days 85680 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7009, 'nb_two_criteria_ok': 7009, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1537, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 2523, 'end_of_day_photos_uploaded': 4476, 'ratio_coverage': 0.9656824731767729}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 776, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 776, 'last_update': '2025/04/29', 'portfolio_id': 22447574, 'last_run_id': 1760797, 'total_number_of_photos': 4554}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83260 seconds', 'coverage_times_pause': '0 days 85450 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 6681, 'nb_two_criteria_ok': 6681, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1848, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 6665, 'ratio_coverage': 0.963668560978715}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83059 seconds', 'coverage_times_pause': '0 days 85435 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7474, 'nb_two_criteria_ok': 7474, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1045, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7461, 'ratio_coverage': 0.9613421451637172}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83118 seconds', 'coverage_times_pause': '0 days 85391 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7229, 'nb_two_criteria_ok': 7229, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1299, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 1904, 'end_of_day_photos_uploaded': 5310, 'ratio_coverage': 0.9620250234377713}, 'dashboard_dict': {'nb_ptf_finished': 101, 'nb_images_finished': 1072, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 26, 'nb_images_started': 116, 'nb_selected_images': 1188, 'last_update': '2025/04/28', 'portfolio_id': 22415669, 'last_run_id': 1758016, 'total_number_of_photos': 5406}} No error ? {'log_dict': {'total_nb_images': 8507, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85319 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7715, 'nb_two_criteria_ok': 7715, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 803, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 629, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 155, 'nb_images_finished': 1203, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1203, 'last_update': '2025/04/25', 'portfolio_id': 22366340, 'last_run_id': 1755682, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83161 seconds', 'coverage_times_pause': '0 days 85356 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7735, 'nb_two_criteria_ok': 7735, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 785, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 642, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9625227143832683}, 'dashboard_dict': {'nb_ptf_finished': 117, 'nb_images_finished': 834, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 834, 'last_update': '2025/04/24', 'portfolio_id': 22324753, 'last_run_id': 1751857, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8485, 'max_time_between_images': '0 days 120 seconds', 'coverage_pause': '0 days 82697 seconds', 'coverage_times_pause': '0 days 85107 seconds', 'nb_photos_decision': 8503, 'nb_gray_level_ok': 8503, 'nb_dedup_ok': 7480, 'nb_two_criteria_ok': 7480, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1023, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 405, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.957152281855114}, 'dashboard_dict': {'nb_ptf_finished': 265, 'nb_images_finished': 1526, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1526, 'last_update': '2025/04/23', 'portfolio_id': 22282843, 'last_run_id': 1747824, 'total_number_of_photos': 7464}} No error ? {'log_dict': {'total_nb_images': 8507, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85319 seconds', 'nb_photos_decision': 8519, 'nb_gray_level_ok': 8519, 'nb_dedup_ok': 7715, 'nb_two_criteria_ok': 7715, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 803, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 629, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 155, 'nb_images_finished': 1203, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1203, 'last_update': '2025/04/25', 'portfolio_id': 22366340, 'last_run_id': 1755682, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83161 seconds', 'coverage_times_pause': '0 days 85356 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7735, 'nb_two_criteria_ok': 7735, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 785, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 642, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9625227143832683}, 'dashboard_dict': {'nb_ptf_finished': 117, 'nb_images_finished': 834, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 834, 'last_update': '2025/04/24', 'portfolio_id': 22324753, 'last_run_id': 1751857, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8485, 'max_time_between_images': '0 days 120 seconds', 'coverage_pause': '0 days 82697 seconds', 'coverage_times_pause': '0 days 85107 seconds', 'nb_photos_decision': 8503, 'nb_gray_level_ok': 8503, 'nb_dedup_ok': 7480, 'nb_two_criteria_ok': 7480, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1023, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 405, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.957152281855114}, 'dashboard_dict': {'nb_ptf_finished': 265, 'nb_images_finished': 1526, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1526, 'last_update': '2025/04/23', 'portfolio_id': 22282843, 'last_run_id': 1747824, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83015 seconds', 'coverage_times_pause': '0 days 85447 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1334, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 105, 'end_of_day_photos_uploaded': 7074, 'ratio_coverage': 0.9608328800101853}, 'dashboard_dict': {'nb_ptf_finished': 89, 'nb_images_finished': 579, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 579, 'last_update': '2025/04/22', 'portfolio_id': 22270131, 'last_run_id': 1743822, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85384 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7686, 'nb_two_criteria_ok': 7686, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 839, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 594, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 243, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 243, 'last_update': '2025/04/21', 'portfolio_id': 22258396, 'last_run_id': 1740578, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7614}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83161 seconds', 'coverage_times_pause': '0 days 85356 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7735, 'nb_two_criteria_ok': 7735, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 785, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 642, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9625227143832683}, 'dashboard_dict': {'nb_ptf_finished': 117, 'nb_images_finished': 834, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 834, 'last_update': '2025/04/24', 'portfolio_id': 22324753, 'last_run_id': 1751857, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8485, 'max_time_between_images': '0 days 120 seconds', 'coverage_pause': '0 days 82697 seconds', 'coverage_times_pause': '0 days 85107 seconds', 'nb_photos_decision': 8503, 'nb_gray_level_ok': 8503, 'nb_dedup_ok': 7480, 'nb_two_criteria_ok': 7480, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1023, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 405, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.957152281855114}, 'dashboard_dict': {'nb_ptf_finished': 265, 'nb_images_finished': 1526, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1526, 'last_update': '2025/04/23', 'portfolio_id': 22282843, 'last_run_id': 1747824, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83015 seconds', 'coverage_times_pause': '0 days 85447 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1334, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 105, 'end_of_day_photos_uploaded': 7074, 'ratio_coverage': 0.9608328800101853}, 'dashboard_dict': {'nb_ptf_finished': 89, 'nb_images_finished': 579, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 579, 'last_update': '2025/04/22', 'portfolio_id': 22270131, 'last_run_id': 1743822, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85384 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7686, 'nb_two_criteria_ok': 7686, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 839, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 594, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 243, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 243, 'last_update': '2025/04/21', 'portfolio_id': 22258396, 'last_run_id': 1740578, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8512, 'max_time_between_images': '0 days 327 seconds', 'coverage_pause': '0 days 83079 seconds', 'coverage_times_pause': '0 days 85377 seconds', 'nb_photos_decision': 8509, 'nb_gray_level_ok': 8509, 'nb_dedup_ok': 7540, 'nb_two_criteria_ok': 7540, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 963, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 747, 'end_of_day_photos_uploaded': 6792, 'ratio_coverage': 0.9615736293244135}, 'dashboard_dict': {'nb_ptf_finished': 145, 'nb_images_finished': 1109, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 91, 'nb_images_started': 1198, 'nb_selected_images': 2307, 'last_update': '2025/04/20', 'portfolio_id': 22238626, 'last_run_id': 1740099, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7458}} No error ? {'log_dict': {'total_nb_images': 8485, 'max_time_between_images': '0 days 120 seconds', 'coverage_pause': '0 days 82697 seconds', 'coverage_times_pause': '0 days 85107 seconds', 'nb_photos_decision': 8503, 'nb_gray_level_ok': 8503, 'nb_dedup_ok': 7480, 'nb_two_criteria_ok': 7480, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1023, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 405, 'end_of_day_photos_uploaded': 7056, 'ratio_coverage': 0.957152281855114}, 'dashboard_dict': {'nb_ptf_finished': 265, 'nb_images_finished': 1526, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1526, 'last_update': '2025/04/23', 'portfolio_id': 22282843, 'last_run_id': 1747824, 'total_number_of_photos': 7182}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83015 seconds', 'coverage_times_pause': '0 days 85447 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1334, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 105, 'end_of_day_photos_uploaded': 7074, 'ratio_coverage': 0.9608328800101853}, 'dashboard_dict': {'nb_ptf_finished': 89, 'nb_images_finished': 579, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 579, 'last_update': '2025/04/22', 'portfolio_id': 22270131, 'last_run_id': 1743822, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8512, 'max_time_between_images': '0 days 327 seconds', 'coverage_pause': '0 days 83079 seconds', 'coverage_times_pause': '0 days 85377 seconds', 'nb_photos_decision': 8509, 'nb_gray_level_ok': 8509, 'nb_dedup_ok': 7540, 'nb_two_criteria_ok': 7540, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 963, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 747, 'end_of_day_photos_uploaded': 6792, 'ratio_coverage': 0.9615736293244135}, 'dashboard_dict': {'nb_ptf_finished': 145, 'nb_images_finished': 1109, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 91, 'nb_images_started': 1198, 'nb_selected_images': 2307, 'last_update': '2025/04/20', 'portfolio_id': 22238626, 'last_run_id': 1740099, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7374}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83015 seconds', 'coverage_times_pause': '0 days 85447 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1334, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 105, 'end_of_day_photos_uploaded': 7074, 'ratio_coverage': 0.9608328800101853}, 'dashboard_dict': {'nb_ptf_finished': 89, 'nb_images_finished': 579, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 579, 'last_update': '2025/04/22', 'portfolio_id': 22270131, 'last_run_id': 1743822, 'total_number_of_photos': 7194}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85384 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7686, 'nb_two_criteria_ok': 7686, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 839, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 594, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 243, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 243, 'last_update': '2025/04/21', 'portfolio_id': 22258396, 'last_run_id': 1740578, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8512, 'max_time_between_images': '0 days 327 seconds', 'coverage_pause': '0 days 83079 seconds', 'coverage_times_pause': '0 days 85377 seconds', 'nb_photos_decision': 8509, 'nb_gray_level_ok': 8509, 'nb_dedup_ok': 7540, 'nb_two_criteria_ok': 7540, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 963, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 747, 'end_of_day_photos_uploaded': 6792, 'ratio_coverage': 0.9615736293244135}, 'dashboard_dict': {'nb_ptf_finished': 145, 'nb_images_finished': 1109, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 91, 'nb_images_started': 1198, 'nb_selected_images': 2307, 'last_update': '2025/04/20', 'portfolio_id': 22238626, 'last_run_id': 1740099, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7170}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5442}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82823 seconds', 'coverage_times_pause': '0 days 85384 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7686, 'nb_two_criteria_ok': 7686, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 839, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 594, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9586106320675007}, 'dashboard_dict': {'nb_ptf_finished': 57, 'nb_images_finished': 243, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 243, 'last_update': '2025/04/21', 'portfolio_id': 22258396, 'last_run_id': 1740578, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8512, 'max_time_between_images': '0 days 327 seconds', 'coverage_pause': '0 days 83079 seconds', 'coverage_times_pause': '0 days 85377 seconds', 'nb_photos_decision': 8509, 'nb_gray_level_ok': 8509, 'nb_dedup_ok': 7540, 'nb_two_criteria_ok': 7540, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 963, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 747, 'end_of_day_photos_uploaded': 6792, 'ratio_coverage': 0.9615736293244135}, 'dashboard_dict': {'nb_ptf_finished': 145, 'nb_images_finished': 1109, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 91, 'nb_images_started': 1198, 'nb_selected_images': 2307, 'last_update': '2025/04/20', 'portfolio_id': 22238626, 'last_run_id': 1740099, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7170}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5196}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83350 seconds', 'coverage_times_pause': '0 days 85617 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7951, 'nb_two_criteria_ok': 7951, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 592, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7932, 'ratio_coverage': 0.9647102397018484}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8512, 'max_time_between_images': '0 days 327 seconds', 'coverage_pause': '0 days 83079 seconds', 'coverage_times_pause': '0 days 85377 seconds', 'nb_photos_decision': 8509, 'nb_gray_level_ok': 8509, 'nb_dedup_ok': 7540, 'nb_two_criteria_ok': 7540, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 3, 'end_of_day_photos_duplicated': 963, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 747, 'end_of_day_photos_uploaded': 6792, 'ratio_coverage': 0.9615736293244135}, 'dashboard_dict': {'nb_ptf_finished': 125, 'nb_images_finished': 1009, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 21, 'nb_images_started': 120, 'nb_selected_images': 1129, 'last_update': '2025/04/20', 'portfolio_id': 22238626, 'last_run_id': 1739537, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8495, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82961 seconds', 'coverage_times_pause': '0 days 85200 seconds', 'nb_photos_decision': 8507, 'nb_gray_level_ok': 8507, 'nb_dedup_ok': 7632, 'nb_two_criteria_ok': 7632, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 873, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 541, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9602078727763053}, 'dashboard_dict': {'nb_ptf_finished': 179, 'nb_images_finished': 1541, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1541, 'last_update': '2025/04/19', 'portfolio_id': 22170118, 'last_run_id': 1738093, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7170}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5196}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83350 seconds', 'coverage_times_pause': '0 days 85617 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7951, 'nb_two_criteria_ok': 7951, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 592, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7932, 'ratio_coverage': 0.9647102397018484}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82908 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7635, 'nb_two_criteria_ok': 7635, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 890, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 728, 'end_of_day_photos_uploaded': 6894, 'ratio_coverage': 0.9595944397504601}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83193 seconds', 'coverage_times_pause': '0 days 85507 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7623, 'nb_two_criteria_ok': 7623, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 912, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 527, 'end_of_day_photos_uploaded': 7080, 'ratio_coverage': 0.9628930890403824}, 'dashboard_dict': {'nb_ptf_finished': 140, 'nb_images_finished': 862, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 862, 'last_update': '2025/04/18', 'portfolio_id': 22117565, 'last_run_id': 1733354, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7170}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5196}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83350 seconds', 'coverage_times_pause': '0 days 85617 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7951, 'nb_two_criteria_ok': 7951, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 592, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7932, 'ratio_coverage': 0.9647102397018484}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82908 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7635, 'nb_two_criteria_ok': 7635, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 890, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 728, 'end_of_day_photos_uploaded': 6894, 'ratio_coverage': 0.9595944397504601}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8531, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 83088 seconds', 'coverage_times_pause': '0 days 85556 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7315, 'nb_two_criteria_ok': 7315, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1226, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 314, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9616777971967269}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8559, 'max_time_between_images': '0 days 100 seconds', 'coverage_pause': '0 days 83528 seconds', 'coverage_times_pause': '0 days 85842 seconds', 'nb_photos_decision': 8559, 'nb_gray_level_ok': 8559, 'nb_dedup_ok': 8094, 'nb_two_criteria_ok': 8094, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 462, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 1040, 'end_of_day_photos_uploaded': 7044, 'ratio_coverage': 0.9667704487320455}, 'dashboard_dict': {'nb_ptf_finished': 237, 'nb_images_finished': 1728, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 1728, 'last_update': '2025/04/17', 'portfolio_id': 22058619, 'last_run_id': 1729460, 'total_number_of_photos': 7170}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5196}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83350 seconds', 'coverage_times_pause': '0 days 85617 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7951, 'nb_two_criteria_ok': 7951, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 592, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7932, 'ratio_coverage': 0.9647102397018484}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82908 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7635, 'nb_two_criteria_ok': 7635, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 890, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 728, 'end_of_day_photos_uploaded': 6894, 'ratio_coverage': 0.9595944397504601}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82992 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8562, 'nb_gray_level_ok': 8562, 'nb_dedup_ok': 7507, 'nb_two_criteria_ok': 7507, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1055, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 480, 'end_of_day_photos_uploaded': 7014, 'ratio_coverage': 0.9605666732253846}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8531, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 83088 seconds', 'coverage_times_pause': '0 days 85556 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7315, 'nb_two_criteria_ok': 7315, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1226, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 314, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9616777971967269}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83288 seconds', 'coverage_times_pause': '0 days 85388 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7770, 'nb_two_criteria_ok': 7770, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 689, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9639926388036899}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8551, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83557 seconds', 'coverage_times_pause': '0 days 85748 seconds', 'nb_photos_decision': 8568, 'nb_gray_level_ok': 8568, 'nb_dedup_ok': 7513, 'nb_two_criteria_ok': 7513, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1052, 'end_of_day_photos_nothing_done': 2, 'end_of_day_photos_ok_for_neural_classification': 2391, 'end_of_day_photos_uploaded': 5106, 'ratio_coverage': 0.9671061007650551}, 'dashboard_dict': {'nb_ptf_finished': 116, 'nb_images_finished': 773, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 773, 'last_update': '2025/04/16', 'portfolio_id': 22024903, 'last_run_id': 1725542, 'total_number_of_photos': 5196}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83350 seconds', 'coverage_times_pause': '0 days 85617 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7951, 'nb_two_criteria_ok': 7951, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 592, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 7932, 'ratio_coverage': 0.9647102397018484}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8519, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82908 seconds', 'coverage_times_pause': '0 days 85449 seconds', 'nb_photos_decision': 8525, 'nb_gray_level_ok': 8525, 'nb_dedup_ok': 7635, 'nb_two_criteria_ok': 7635, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 890, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 728, 'end_of_day_photos_uploaded': 6894, 'ratio_coverage': 0.9595944397504601}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8550, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82992 seconds', 'coverage_times_pause': '0 days 85749 seconds', 'nb_photos_decision': 8562, 'nb_gray_level_ok': 8562, 'nb_dedup_ok': 7507, 'nb_two_criteria_ok': 7507, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1055, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 480, 'end_of_day_photos_uploaded': 7014, 'ratio_coverage': 0.9605666732253846}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8531, 'max_time_between_images': '0 days 83 seconds', 'coverage_pause': '0 days 83088 seconds', 'coverage_times_pause': '0 days 85556 seconds', 'nb_photos_decision': 8543, 'nb_gray_level_ok': 8543, 'nb_dedup_ok': 7315, 'nb_two_criteria_ok': 7315, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1226, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 314, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9616777971967269}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83288 seconds', 'coverage_times_pause': '0 days 85388 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7770, 'nb_two_criteria_ok': 7770, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 689, 'end_of_day_photos_uploaded': 7068, 'ratio_coverage': 0.9639926388036899}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8529, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83463 seconds', 'coverage_times_pause': '0 days 85529 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7459, 'nb_two_criteria_ok': 7459, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1084, 'end_of_day_photos_nothing_done': 4, 'end_of_day_photos_ok_for_neural_classification': 403, 'end_of_day_photos_uploaded': 7038, 'ratio_coverage': 0.9660181252097825}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'total_number_of_photos': 0, 'last_update': '0000/00/00'}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83535 seconds', 'coverage_times_pause': '0 days 85570 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7622, 'nb_two_criteria_ok': 7622, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 921, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 626, 'end_of_day_photos_uploaded': 6978, 'ratio_coverage': 0.9668514681882893}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/04/03', 'portfolio_id': 21964660, 'last_run_id': 1720468, 'total_number_of_photos': 7736}} No error ? {'log_dict': {'total_nb_images': 8510, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 82978 seconds', 'coverage_times_pause': '0 days 85366 seconds', 'nb_photos_decision': 8510, 'nb_gray_level_ok': 8510, 'nb_dedup_ok': 7029, 'nb_two_criteria_ok': 7029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1481, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 344, 'end_of_day_photos_uploaded': 6672, 'ratio_coverage': 0.9604046343128971}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/04/02', 'portfolio_id': 21932448, 'last_run_id': 1717576, 'total_number_of_photos': 7166}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8510, 'max_time_between_images': '0 days 109 seconds', 'coverage_pause': '0 days 82978 seconds', 'coverage_times_pause': '0 days 85366 seconds', 'nb_photos_decision': 8510, 'nb_gray_level_ok': 8510, 'nb_dedup_ok': 7029, 'nb_two_criteria_ok': 7029, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1481, 'end_of_day_photos_nothing_done': 13, 'end_of_day_photos_ok_for_neural_classification': 344, 'end_of_day_photos_uploaded': 6672, 'ratio_coverage': 0.9604046343128971}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/04/02', 'portfolio_id': 21932448, 'last_run_id': 1717576, 'total_number_of_photos': 7154}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-04-30 00:00:00 Found day : 2025-04-29 00:00:00 Found day : 2025-04-28 00:00:00 Found day : 2025-04-27 00:00:00 Found day : 2025-04-26 00:00:00 Found day : 2025-04-25 00:00:00 Found day : 2025-04-24 00:00:00 Found day : 2025-04-23 00:00:00 Found day : 2025-04-22 00:00:00 Found day : 2025-04-21 00:00:00 Found day : 2025-04-20 00:00:00 Found day : 2025-04-18 00:00:00 Found day : 2025-04-19 00:00:00 Found day : 2025-04-17 00:00:00 Found day : 2025-04-16 00:00:00 Found day : 2025-04-15 00:00:00 Found day : 2025-04-14 00:00:00 Found day : 2025-04-13 00:00:00 Found day : 2025-04-11 00:00:00 Found day : 2025-04-12 00:00:00 Found day : 2025-04-10 00:00:00 Found day : 2025-04-09 00:00:00 Found day : 2025-04-02 00:00:00 Found day : 2025-04-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-04-03 00:00:00,2025-04-04 00:00:00,2025-04-05 00:00:00,2025-04-06 00:00:00,2025-04-07 00:00:00,2025-04-08 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 132 and month(ded.date) = 04 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______truck' and ded.dashboard_place_id = 132 and month(ded.date) = 04 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 132 and mp.name like '%042025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-04-01 : dt_date_just_month_year : 2025-04-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "dechet_Valcor_v2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-04-01" AND ded.date <= "2025-04-30" apple3 {'test': {'mat': 'test', 'pht': 0, 'datou_carac_id': 370, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 538914404}, 'truck': {'mat': 'truck', 'pht': 4230, 'datou_carac_id': 4234, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1734297,1734361,1734264,1752311,1756177,1756182,1756194,1761399,1765793,1765791,1766381,1765790,1770252,1773933,1760797,1765327,1769651) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (0,4230) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.040205758878486944, 'nb_photo': 332128, 'list_port_cont': '22035278,22035302,22035542,22035568,22035805,22035926,22036019,22036119,22036164,22036249,22036499,22036523,22037009,22037162,22037248,22037316,22037416,22038802,22038844,22039236,22039322,22039343,22039640,22039951,22040318,22040403,22040551,22040582,22041004,22043492,22043558,22043785,22044038,22044088,22044305,22044362,22044493,22044629,22044719,22044771,22044858,22044939,22045112,22045225,22045264,22045350,22045539,22045631,22046972,22047043,22047273,22047465,22047511,22047707,22047722,22047773,22047838,22047932,22048072,22048200,22048268,22048327,22048439,22048519,22048699,22048743,22048914,22048971,22049011,22049056,22049136,22049211,22049266,22049370,22049411,22049473,22049604,22049662,22050565,22051062,22054801,22054858,22055128,22055180,22055269,22055336,22055428,22055472,22055580,22055648,22055680,22055729,22055845,22055871,22055920,22055966,22056004,22056042,22056078,22056096,22056133,22056189,22056223,22056263,22056275,22056346,22056398,22056427,22056461,22056498,22056545,22056599,22057200,2207826', 'assoc_port': '22035061:22036499,22035062:22036523,22035063:22036249,22035065:22036164,22035066:22036119,22035067:22036019,22035068:22035926,22035069:22035805,22035070:22035568,22035071:22035542,22035072:22035278,22035073:22039640,22035075:22035302,22036822:22037416,22036823:22037316,22036824:22037248,22036825:22037162,22036850:22037009,22038541:22039322,22038542:22039236,22038543:22039343,22038544:22041004,22038545:22039951,22038546:22038844,22038547:22038802,22040167:22040551,22040168:22040403,22040169:22040582,22040170:22040318,22043091:22045539,22043092:22044858,22043093:22044939,22043094:22051062,22043095:22044629,22043096:22044493,22043097:22045631,22043098:22044038,22043099:22044305,22043100:22043558,22043101:22044088,22043102:22045264,22043103:22044719,22043105:22044771,22043108:22043492,22043110:22050565,22043113:22044362,22043115:22043785,22044829:22045225,22044834:22045350,22044835:22045112,22046712:22049604,22046713:22049662,22046714:22049473,22046715:22049411,22046716:22049211,22046717:22049370,22046718:2204913', 'assoc_mat': '22035061:autre:4230:22036499,22035062:autre:4230:22036523,22035063:autre:4230:22036249,22035065:autre:4230:22036164,22035066:autre:4230:22036119,22035067:autre:4230:22036019,22035068:autre:4230:22035926,22035069:autre:4230:22035805,22035070:autre:4230:22035568,22035071:autre:4230:22035542,22035072:autre:4230:22035278,22035073:autre:4230:22039640,22035075:autre:4230:22035302,22036822:autre:4230:22037416,22036823:autre:4230:22037316,22036824:autre:4230:22037248,22036825:autre:4230:22037162,22036850:autre:4230:22037009,22038541:autre:4230:22039322,22038542:autre:4230:22039236,22038543:autre:4230:22039343,22038544:autre:4230:22041004,22038545:autre:4230:22039951,22038546:autre:4230:22038844,22038547:autre:4230:22038802,22040167:autre:4230:22040551,22040168:autre:4230:22040403,22040169:autre:4230:22040582,22040170:autre:4230:22040318,22043091:autre:4230:22045539,22043092:autre:4230:22044858,22043093:autre:4230:22044939,22043094:autre:4230:22051062,22043095:autre:4230:22044629,22043096:autre:4230:22044493,22043097:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.03395980467205257, 'nb_photo': 384239, 'list_port_cont': '22035272,22035315,22035549,22035559,22035817,22035937,22036029,22036115,22036153,22036263,22036506,22036519,22037006,22037168,22037246,22037322,22037433,22038813,22038852,22039235,22039327,22039334,22039644,22039950,22040320,22040412,22040546,22040574,22040992,22043499,22043553,22043823,22044048,22044103,22044296,22044367,22044508,22044636,22044721,22044780,22044868,22044950,22045117,22045237,22045268,22045352,22045535,22045624,22046970,22047040,22047274,22047473,22047510,22047704,22047725,22047779,22047841,22047931,22048075,22048210,22048277,22048323,22048441,22048526,22048703,22048741,22048916,22048977,22049014,22049057,22049135,22049219,22049268,22049377,22049427,22049464,22049602,22049654,22050547,22051075,22054800,22054865,22055134,22055184,22055273,22055331,22055421,22055477,22055579,22055649,22055690,22055731,22055840,22055881,22055926,22055963,22056001,22056032,22056075,22056093,22056147,22056199,22056224,22056271,22056280,22056342,22056397,22056432,22056471,22056508,22056539,22056611,22057204,2207826', 'assoc_port': '22035061:22036506,22035062:22036519,22035063:22036263,22035065:22036153,22035066:22036115,22035067:22036029,22035068:22035937,22035069:22035817,22035070:22035559,22035071:22035549,22035072:22035272,22035073:22039644,22035075:22035315,22036822:22037433,22036823:22037322,22036824:22037246,22036825:22037168,22036850:22037006,22038541:22039327,22038542:22039235,22038543:22039334,22038544:22040992,22038545:22039950,22038546:22038852,22038547:22038813,22040167:22040546,22040168:22040412,22040169:22040574,22040170:22040320,22043091:22045535,22043092:22044868,22043093:22044950,22043094:22051075,22043095:22044636,22043096:22044508,22043097:22045624,22043098:22044048,22043099:22044296,22043100:22043553,22043101:22044103,22043102:22045268,22043103:22044721,22043105:22044780,22043108:22043499,22043110:22050547,22043113:22044367,22043115:22043823,22044829:22045237,22044834:22045352,22044835:22045117,22046712:22049602,22046713:22049654,22046714:22049464,22046715:22049427,22046716:22049219,22046717:22049377,22046718:2204913', 'assoc_mat': '22035061:carton:4230:22036506,22035062:carton:4230:22036519,22035063:carton:4230:22036263,22035065:carton:4230:22036153,22035066:carton:4230:22036115,22035067:carton:4230:22036029,22035068:carton:4230:22035937,22035069:carton:4230:22035817,22035070:carton:4230:22035559,22035071:carton:4230:22035549,22035072:carton:4230:22035272,22035073:carton:4230:22039644,22035075:carton:4230:22035315,22036822:carton:4230:22037433,22036823:carton:4230:22037322,22036824:carton:4230:22037246,22036825:carton:4230:22037168,22036850:carton:4230:22037006,22038541:carton:4230:22039327,22038542:carton:4230:22039235,22038543:carton:4230:22039334,22038544:carton:4230:22040992,22038545:carton:4230:22039950,22038546:carton:4230:22038852,22038547:carton:4230:22038813,22040167:carton:4230:22040546,22040168:carton:4230:22040412,22040169:carton:4230:22040574,22040170:carton:4230:22040320,22043091:carton:4230:22045535,22043092:carton:4230:22044868,22043093:carton:4230:22044950,22043094:carton:4230:22051075,22043095:carton:4230:22044636,2204'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009853189052209223, 'nb_photo': 17543, 'list_port_cont': '22035265,22035313,22035548,22035557,22035802,22035924,22036014,22036121,22036148,22036259,22036494,22036524,22036999,22037166,22037255,22037308,22038807,22038842,22039227,22039317,22039340,22039634,22039940,22040307,22040409,22040548,22040581,22040994,22043493,22043554,22043822,22044056,22044091,22044297,22044371,22044509,22044718,22044781,22044873,22044944,22045106,22045259,22045529,22045635,22046962,22047035,22047471,22047520,22047771,22047830,22048195,22048271,22048318,22048436,22048517,22048702,22048734,22048913,22048963,22049017,22049053,22049257,22049460,22049589,22049663,22050551,22051065,22054796,22054849,22055120,22055179,22055329,22055429,22055482,22055572,22055643,22055682,22055842,22055879,22055962,22055996,22056086,22056150,22056197,22056220,22056264,22056278,22056395,22056465,22056499,22056532,22056598,22078250,22078431,22078940,22079274,22079825,22079843,22080088,22080149,22080268,22080381,22080594,22080792,22080833,22080874,22081031,22081450,22081502,22081577,22081629,22081853,22081911,2208196', 'assoc_port': '22035061:22036494,22035062:22036524,22035063:22036259,22035065:22036148,22035066:22036121,22035067:22036014,22035068:22035924,22035069:22035802,22035070:22035557,22035071:22035548,22035072:22035265,22035073:22039634,22035075:22035313,22036823:22037308,22036824:22037255,22036825:22037166,22036850:22036999,22038541:22039317,22038542:22039227,22038543:22039340,22038544:22040994,22038545:22039940,22038546:22038842,22038547:22038807,22040167:22040548,22040168:22040409,22040169:22040581,22040170:22040307,22043091:22045529,22043092:22044873,22043093:22044944,22043094:22051065,22043096:22044509,22043097:22045635,22043098:22044056,22043099:22044297,22043100:22043554,22043101:22044091,22043102:22045259,22043103:22044718,22043105:22044781,22043108:22043493,22043110:22050551,22043113:22044371,22043115:22043822,22044835:22045106,22046712:22049589,22046713:22049663,22046714:22049460,22046719:22049257,22046720:22048318,22046721:22048436,22046722:22048195,22046724:22048271,22046752:22047771,22046754:22047035,22046755:2204752', 'assoc_mat': '22035061:metal:4230:22036494,22035062:metal:4230:22036524,22035063:metal:4230:22036259,22035065:metal:4230:22036148,22035066:metal:4230:22036121,22035067:metal:4230:22036014,22035068:metal:4230:22035924,22035069:metal:4230:22035802,22035070:metal:4230:22035557,22035071:metal:4230:22035548,22035072:metal:4230:22035265,22035073:metal:4230:22039634,22035075:metal:4230:22035313,22036823:metal:4230:22037308,22036824:metal:4230:22037255,22036825:metal:4230:22037166,22036850:metal:4230:22036999,22038541:metal:4230:22039317,22038542:metal:4230:22039227,22038543:metal:4230:22039340,22038544:metal:4230:22040994,22038545:metal:4230:22039940,22038546:metal:4230:22038842,22038547:metal:4230:22038807,22040167:metal:4230:22040548,22040168:metal:4230:22040409,22040169:metal:4230:22040581,22040170:metal:4230:22040307,22043091:metal:4230:22045529,22043092:metal:4230:22044873,22043093:metal:4230:22044944,22043094:metal:4230:22051065,22043096:metal:4230:22044509,22043097:metal:4230:22045635,22043098:metal:4230:22044056,22043099:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.12625039371678903, 'nb_photo': 1040437, 'list_port_cont': '22035274,22035309,22035547,22035572,22035812,22035932,22036028,22036112,22036158,22036260,22036497,22036514,22037001,22037163,22037252,22037318,22037429,22038809,22038847,22039234,22039326,22039347,22039651,22039946,22040322,22040417,22040550,22040588,22041001,22043491,22043564,22043788,22044045,22044097,22044306,22044372,22044502,22044633,22044714,22044775,22044866,22044953,22045114,22045233,22045267,22045353,22045531,22045636,22046979,22047028,22047280,22047470,22047519,22047702,22047717,22047780,22047836,22047925,22048069,22048202,22048265,22048322,22048432,22048532,22048705,22048742,22048918,22048974,22049008,22049052,22049143,22049206,22049265,22049376,22049420,22049469,22049603,22049664,22050549,22051073,22054804,22054852,22055130,22055176,22055283,22055335,22055427,22055484,22055577,22055655,22055695,22055728,22055839,22055872,22055929,22055961,22055998,22056035,22056068,22056094,22056143,22056200,22056237,22056273,22056285,22056337,22056385,22056435,22056466,22056497,22056537,22056609,22057208,2207825', 'assoc_port': '22035061:22036497,22035062:22036514,22035063:22036260,22035065:22036158,22035066:22036112,22035067:22036028,22035068:22035932,22035069:22035812,22035070:22035572,22035071:22035547,22035072:22035274,22035073:22039651,22035075:22035309,22036822:22037429,22036823:22037318,22036824:22037252,22036825:22037163,22036850:22037001,22038541:22039326,22038542:22039234,22038543:22039347,22038544:22041001,22038545:22039946,22038546:22038847,22038547:22038809,22040167:22040550,22040168:22040417,22040169:22040588,22040170:22040322,22043091:22045531,22043092:22044866,22043093:22044953,22043094:22051073,22043095:22044633,22043096:22044502,22043097:22045636,22043098:22044045,22043099:22044306,22043100:22043564,22043101:22044097,22043102:22045267,22043103:22044714,22043105:22044775,22043108:22043491,22043110:22050549,22043113:22044372,22043115:22043788,22044829:22045233,22044834:22045353,22044835:22045114,22046712:22049603,22046713:22049664,22046714:22049469,22046715:22049420,22046716:22049206,22046717:22049376,22046718:2204914', 'assoc_mat': '22035061:papier:4230:22036497,22035062:papier:4230:22036514,22035063:papier:4230:22036260,22035065:papier:4230:22036158,22035066:papier:4230:22036112,22035067:papier:4230:22036028,22035068:papier:4230:22035932,22035069:papier:4230:22035812,22035070:papier:4230:22035572,22035071:papier:4230:22035547,22035072:papier:4230:22035274,22035073:papier:4230:22039651,22035075:papier:4230:22035309,22036822:papier:4230:22037429,22036823:papier:4230:22037318,22036824:papier:4230:22037252,22036825:papier:4230:22037163,22036850:papier:4230:22037001,22038541:papier:4230:22039326,22038542:papier:4230:22039234,22038543:papier:4230:22039347,22038544:papier:4230:22041001,22038545:papier:4230:22039946,22038546:papier:4230:22038847,22038547:papier:4230:22038809,22040167:papier:4230:22040550,22040168:papier:4230:22040417,22040169:papier:4230:22040588,22040170:papier:4230:22040322,22043091:papier:4230:22045531,22043092:papier:4230:22044866,22043093:papier:4230:22044953,22043094:papier:4230:22051073,22043095:papier:4230:22044633,2204'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0013614587666678616, 'nb_photo': 7193, 'list_port_cont': '22036251,22036501,22036510,22038804,22039949,22040584,22044784,22045540,22047507,22047772,22048211,22048978,22049661,22055129,22055276,22055328,22055425,22055473,22055587,22055647,22055681,22055967,22056005,22056082,22056201,22056462,22056501,22056544,22056608,22078434,22079271,22080093,22080378,22080604,22080798,22080830,22081973,22085100,22085289,22085405,22085533,22085650,22085731,22086346,22087508,22088002,22088721,22088812,22088993,22089047,22090160,22090335,22090415,22090442,22090554,22090755,22090866,22090949,22091056,22091100,22091169,22091659,22091962,22092212,22092289,22092378,22092962,22093273,22094028,22094090,22094208,22094261,22094394,22094401,22094561,22094802,22094932,22094985,22095023,22095109,22095333,22095518,22095576,22096291,22096343,22096403,22096489,22096790,22097386,22097833,22098093,22098285,22098831,22098982,22099210,22099221,22099508,22100169,22100204,22100386,22100420,22100735,22100806,22100863,22100925,22100955,22101003,22101083,22101085,22101229,22101261,22101285,22101501,2210162', 'assoc_port': '22035061:22036501,22035062:22036510,22035063:22036251,22038545:22039949,22038547:22038804,22040169:22040584,22043091:22045540,22043105:22044784,22046713:22049661,22046722:22048211,22046752:22047772,22046755:22047507,22048045:22048978,22054420:22056608,22054421:22056462,22054422:22056501,22054423:22055328,22054425:22056201,22054429:22056005,22054430:22056544,22054431:22056082,22054433:22055473,22054434:22055276,22054435:22055681,22054436:22055425,22054437:22055647,22054438:22055967,22054442:22055587,22054445:22055129,22078140:22079271,22078142:22078434,22079378:22081973,22079381:22080830,22079383:22080378,22079409:22080798,22079414:22080093,22079415:22080604,22084059:22091100,22084060:22091169,22084099:22090949,22084100:22091056,22084101:22090866,22084102:22090755,22084103:22090442,22084105:22090554,22084134:22086346,22084135:22097833,22084136:22085731,22084137:22098093,22084139:22085533,22084140:22085650,22084142:22085100,22084143:22085405,22084147:22085289,22085775:22090160,22085777:22090335,22085778:2209041', 'assoc_mat': '22035061:pehd:4230:22036501,22035062:pehd:4230:22036510,22035063:pehd:4230:22036251,22038545:pehd:4230:22039949,22038547:pehd:4230:22038804,22040169:pehd:4230:22040584,22043091:pehd:4230:22045540,22043105:pehd:4230:22044784,22046713:pehd:4230:22049661,22046722:pehd:4230:22048211,22046752:pehd:4230:22047772,22046755:pehd:4230:22047507,22048045:pehd:4230:22048978,22054420:pehd:4230:22056608,22054421:pehd:4230:22056462,22054422:pehd:4230:22056501,22054423:pehd:4230:22055328,22054425:pehd:4230:22056201,22054429:pehd:4230:22056005,22054430:pehd:4230:22056544,22054431:pehd:4230:22056082,22054433:pehd:4230:22055473,22054434:pehd:4230:22055276,22054435:pehd:4230:22055681,22054436:pehd:4230:22055425,22054437:pehd:4230:22055647,22054438:pehd:4230:22055967,22054442:pehd:4230:22055587,22054445:pehd:4230:22055129,22078140:pehd:4230:22079271,22078142:pehd:4230:22078434,22079378:pehd:4230:22081973,22079381:pehd:4230:22080830,22079383:pehd:4230:22080378,22079409:pehd:4230:22080798,22079414:pehd:4230:22080093,22079415:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009170475250917147, 'nb_photo': 143910, 'list_port_cont': '22035276,22035304,22035554,22035567,22035816,22035936,22036016,22036117,22036161,22036262,22036502,22036522,22037000,22037171,22037254,22037321,22037432,22038806,22038851,22039232,22039321,22039332,22039636,22039952,22040317,22040418,22040540,22040590,22041005,22043501,22043563,22043819,22044055,22044099,22044301,22044363,22044503,22044632,22044716,22044783,22044870,22044947,22045111,22045232,22045265,22045359,22045534,22045629,22046977,22047031,22047284,22047468,22047517,22047703,22047724,22047774,22047835,22047929,22048073,22048198,22048273,22048329,22048435,22048533,22048704,22048739,22048909,22048976,22049007,22049055,22049144,22049217,22049267,22049372,22049428,22049472,22049598,22049665,22050563,22051066,22054802,22054864,22055127,22055182,22055281,22055323,22055433,22055480,22055584,22055651,22055692,22055724,22055836,22055875,22055923,22055964,22056003,22056041,22056072,22056087,22056142,22056191,22056232,22056272,22056288,22056335,22056392,22056434,22056470,22056504,22056543,22056596,22057207,2207826', 'assoc_port': '22035061:22036502,22035062:22036522,22035063:22036262,22035065:22036161,22035066:22036117,22035067:22036016,22035068:22035936,22035069:22035816,22035070:22035567,22035071:22035554,22035072:22035276,22035073:22039636,22035075:22035304,22036822:22037432,22036823:22037321,22036824:22037254,22036825:22037171,22036850:22037000,22038541:22039321,22038542:22039232,22038543:22039332,22038544:22041005,22038545:22039952,22038546:22038851,22038547:22038806,22040167:22040540,22040168:22040418,22040169:22040590,22040170:22040317,22043091:22045534,22043092:22044870,22043093:22044947,22043094:22051066,22043095:22044632,22043096:22044503,22043097:22045629,22043098:22044055,22043099:22044301,22043100:22043563,22043101:22044099,22043102:22045265,22043103:22044716,22043105:22044783,22043108:22043501,22043110:22050563,22043113:22044363,22043115:22043819,22044829:22045232,22044834:22045359,22044835:22045111,22046712:22049598,22046713:22049665,22046714:22049472,22046715:22049428,22046716:22049217,22046717:22049372,22046718:2204914', 'assoc_mat': '22035061:pet_clair:4230:22036502,22035062:pet_clair:4230:22036522,22035063:pet_clair:4230:22036262,22035065:pet_clair:4230:22036161,22035066:pet_clair:4230:22036117,22035067:pet_clair:4230:22036016,22035068:pet_clair:4230:22035936,22035069:pet_clair:4230:22035816,22035070:pet_clair:4230:22035567,22035071:pet_clair:4230:22035554,22035072:pet_clair:4230:22035276,22035073:pet_clair:4230:22039636,22035075:pet_clair:4230:22035304,22036822:pet_clair:4230:22037432,22036823:pet_clair:4230:22037321,22036824:pet_clair:4230:22037254,22036825:pet_clair:4230:22037171,22036850:pet_clair:4230:22037000,22038541:pet_clair:4230:22039321,22038542:pet_clair:4230:22039232,22038543:pet_clair:4230:22039332,22038544:pet_clair:4230:22041005,22038545:pet_clair:4230:22039952,22038546:pet_clair:4230:22038851,22038547:pet_clair:4230:22038806,22040167:pet_clair:4230:22040540,22040168:pet_clair:4230:22040418,22040169:pet_clair:4230:22040590,22040170:pet_clair:4230:22040317,22043091:pet_clair:4230:22045534,22043092:pet_clair:4230:22044870,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0023051088276208505, 'nb_photo': 3357, 'list_port_cont': '22037259,22039238,22039939,22040578,22043559,22044052,22044303,22044358,22044717,22044774,22044948,22045271,22045634,22048077,22048276,22048696,22048915,22049259,22049426,22049599,22049659,22050567,22051076,22055132,22055330,22055431,22055583,22055657,22055687,22055733,22055877,22055968,22055995,22056089,22056194,22056258,22056291,22056388,22056469,22056507,22056541,22056607,22078923,22079282,22080100,22080154,22080598,22081971,22085007,22085212,22085928,22087772,22087896,22088170,22088310,22088717,22088815,22089044,22089110,22089831,22090334,22090405,22090867,22090940,22091063,22091166,22092206,22092372,22092958,22093275,22094206,22094562,22094812,22094991,22095440,22095507,22095909,22095962,22096279,22096800,22097390,22097830,22098091,22098290,22098495,22098794,22098832,22098976,22099065,22099211,22099225,22099349,22099790,22100201,22100241,22100804,22100953,22101009,22101087,22101230,22101287,22101680,22101939,22102079,22102383,22102670,22102726,22102909,22104654,22105163,22105253,22105292,22105337,2210540', 'assoc_port': '22036824:22037259,22038542:22039238,22038545:22039939,22040169:22040578,22043093:22044948,22043094:22051076,22043097:22045634,22043098:22044052,22043099:22044303,22043100:22043559,22043102:22045271,22043103:22044717,22043105:22044774,22043110:22050567,22043113:22044358,22046712:22049599,22046713:22049659,22046715:22049426,22046719:22049259,22046724:22048276,22046751:22048077,22048048:22048696,22048049:22048915,22054350:22056388,22054354:22056258,22054355:22056291,22054420:22056607,22054421:22056469,22054422:22056507,22054423:22055330,22054424:22055877,22054425:22056194,22054428:22055733,22054429:22055995,22054430:22056541,22054431:22056089,22054435:22055687,22054436:22055431,22054437:22055657,22054438:22055968,22054442:22055583,22054445:22055132,22078140:22079282,22078141:22078923,22079378:22081971,22079410:22080154,22079414:22080100,22079415:22080598,22084060:22091166,22084099:22090940,22084100:22091063,22084101:22090867,22084132:22085928,22084135:22097830,22084137:22098091,22084144:22085007,22084145:2208521', 'assoc_mat': '22036824:pet_fonce:4230:22037259,22038542:pet_fonce:4230:22039238,22038545:pet_fonce:4230:22039939,22040169:pet_fonce:4230:22040578,22043093:pet_fonce:4230:22044948,22043094:pet_fonce:4230:22051076,22043097:pet_fonce:4230:22045634,22043098:pet_fonce:4230:22044052,22043099:pet_fonce:4230:22044303,22043100:pet_fonce:4230:22043559,22043102:pet_fonce:4230:22045271,22043103:pet_fonce:4230:22044717,22043105:pet_fonce:4230:22044774,22043110:pet_fonce:4230:22050567,22043113:pet_fonce:4230:22044358,22046712:pet_fonce:4230:22049599,22046713:pet_fonce:4230:22049659,22046715:pet_fonce:4230:22049426,22046719:pet_fonce:4230:22049259,22046724:pet_fonce:4230:22048276,22046751:pet_fonce:4230:22048077,22048048:pet_fonce:4230:22048696,22048049:pet_fonce:4230:22048915,22054350:pet_fonce:4230:22056388,22054354:pet_fonce:4230:22056258,22054355:pet_fonce:4230:22056291,22054420:pet_fonce:4230:22056607,22054421:pet_fonce:4230:22056469,22054422:pet_fonce:4230:22056507,22054423:pet_fonce:4230:22055330,22054424:pet_fonce:4230:22055877,2'}, {'unwanted_material': 'refus', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.8336118956875427, 'nb_photo': 965, 'list_port_cont': '22346191', 'assoc_port': '22345824:22346191', 'assoc_mat': '22345824:refus:4230:22346191'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1734297,1734361,1734264,1752311,1756177,1756182,1756194,1761399,1765793,1765791,1766381,1765790,1770252,1773933,1760797,1765327,1769651)); after get_hostname_from_raspi hasthag : truck hasthag that could be used but not yet : _______refus SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______truck' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1055) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=132 and date >='2025-04-01' and date <= '2025-04-30') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((20121,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 15444),), 'material_dict': {'truck': 15444}, 'coverage_data': (('2025/04/30/', 0.957615), ('2025/04/29/', 0.961076), ('2025/04/28/', 0.965682), ('2025/04/27/', 0.963669), ('2025/04/26/', 0.961342), ('2025/04/25/', 0.962025), ('2025/04/24/', 0.958611), ('2025/04/23/', 0.962523), ('2025/04/22/', 0.957152), ('2025/04/21/', 0.960833), ('2025/04/20/', 0.958611), ('2025/04/18/', 0.960208), ('2025/04/19/', 0.961574), ('2025/04/17/', 0.962893), ('2025/04/16/', 0.96677), ('2025/04/15/', 0.967106), ('2025/04/14/', 0.96471), ('2025/04/13/', 0.959594), ('2025/04/11/', 0.961678), ('2025/04/12/', 0.960567), ('2025/04/10/', 0.963993), ('2025/04/09/', 0.966018), ('2025/04/02/', 0.966851), ('2025/04/01/', 0.960405)), 'impurety_average_data': ((datetime.date(2025, 4, 1), 0.22372752713236607, 1284), (datetime.date(2025, 4, 2), 0.21019084581504535, 827), (datetime.date(2025, 4, 3), 0.17707630916345143, 34), (datetime.date(2025, 4, 15), 0.1825603406657378, 900), (datetime.date(2025, 4, 16), 0.184181277748339, 1722), (datetime.date(2025, 4, 17), 0.24719553778720263, 826), (datetime.date(2025, 4, 18), 0.23783875986987724, 1512), (datetime.date(2025, 4, 19), 0.23333064218148647, 2307), (datetime.date(2025, 4, 20), 0.23067271980415782, 243), (datetime.date(2025, 4, 21), 0.17247829565215098, 579), (datetime.date(2025, 4, 22), 0.20252984096471627, 1476), (datetime.date(2025, 4, 23), 0.19560101008001624, 831), (datetime.date(2025, 4, 24), 0.23169714528549848, 1145), (datetime.date(2025, 4, 25), 0.21563665941598556, 1685), (datetime.date(2025, 4, 28), 0.21356860986434448, 767), (datetime.date(2025, 4, 29), 0.1998356811796272, 2136), (datetime.date(2025, 4, 30), 0.22006341804788554, 1839)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 4, 1), 0.22372752713236607, 1284), (datetime.date(2025, 4, 2), 0.21019084581504535, 827), (datetime.date(2025, 4, 3), 0.17707630916345143, 34), (datetime.date(2025, 4, 15), 0.1825603406657378, 900), (datetime.date(2025, 4, 16), 0.184181277748339, 1722), (datetime.date(2025, 4, 17), 0.24719553778720263, 826), (datetime.date(2025, 4, 18), 0.23783875986987724, 1512), (datetime.date(2025, 4, 19), 0.23333064218148647, 2307), (datetime.date(2025, 4, 20), 0.23067271980415782, 243), (datetime.date(2025, 4, 21), 0.17247829565215098, 579), (datetime.date(2025, 4, 22), 0.20252984096471627, 1476), (datetime.date(2025, 4, 23), 0.19560101008001624, 831), (datetime.date(2025, 4, 24), 0.23169714528549848, 1145), (datetime.date(2025, 4, 25), 0.21563665941598556, 1685), (datetime.date(2025, 4, 28), 0.21356860986434448, 767), (datetime.date(2025, 4, 29), 0.1998356811796272, 2136), (datetime.date(2025, 4, 30), 0.22006341804788554, 1839))}, 'quality_array': [['-7.401582516570274', '01042025'], ['-7.451827147952839', '02042025'], ['-7.889285438777034', '03042025'], ['-7.715708122738408', '15042025'], ['-7.716432857926614', '16042025'], ['-7.659131913691329', '17042025'], ['-7.915684239872292', '18042025'], ['-7.75454731014833', '19042025'], ['-7.789091715907841', '20042025'], ['-7.385689771915514', '21042025'], ['-7.539128415201154', '22042025'], ['-7.567285135966937', '23042025'], ['-7.239445161540982', '24042025'], ['-7.395502423491663', '25042025'], ['-7.468566465010861', '28042025'], ['-7.4906374082405796', '29042025'], ['-7.597271374877762', '30042025']], 'number_of_batch': ((2804,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.040205758878486944, 'nb_photo': 332128, 'list_port_cont': '22035278,22035302,22035542,22035568,22035805,22035926,22036019,22036119,22036164,22036249,22036499,22036523,22037009,22037162,22037248,22037316,22037416,22038802,22038844,22039236,22039322,22039343,22039640,22039951,22040318,22040403,22040551,22040582,22041004,22043492,22043558,22043785,22044038,22044088,22044305,22044362,22044493,22044629,22044719,22044771,22044858,22044939,22045112,22045225,22045264,22045350,22045539,22045631,22046972,22047043,22047273,22047465,22047511,22047707,22047722,22047773,22047838,22047932,22048072,22048200,22048268,22048327,22048439,22048519,22048699,22048743,22048914,22048971,22049011,22049056,22049136,22049211,22049266,22049370,22049411,22049473,22049604,22049662,22050565,22051062,22054801,22054858,22055128,22055180,22055269,22055336,22055428,22055472,22055580,22055648,22055680,22055729,22055845,22055871,22055920,22055966,22056004,22056042,22056078,22056096,22056133,22056189,22056223,22056263,22056275,22056346,22056398,22056427,22056461,22056498,22056545,22056599,22057200,2207826', 'assoc_port': '22035061:22036499,22035062:22036523,22035063:22036249,22035065:22036164,22035066:22036119,22035067:22036019,22035068:22035926,22035069:22035805,22035070:22035568,22035071:22035542,22035072:22035278,22035073:22039640,22035075:22035302,22036822:22037416,22036823:22037316,22036824:22037248,22036825:22037162,22036850:22037009,22038541:22039322,22038542:22039236,22038543:22039343,22038544:22041004,22038545:22039951,22038546:22038844,22038547:22038802,22040167:22040551,22040168:22040403,22040169:22040582,22040170:22040318,22043091:22045539,22043092:22044858,22043093:22044939,22043094:22051062,22043095:22044629,22043096:22044493,22043097:22045631,22043098:22044038,22043099:22044305,22043100:22043558,22043101:22044088,22043102:22045264,22043103:22044719,22043105:22044771,22043108:22043492,22043110:22050565,22043113:22044362,22043115:22043785,22044829:22045225,22044834:22045350,22044835:22045112,22046712:22049604,22046713:22049662,22046714:22049473,22046715:22049411,22046716:22049211,22046717:22049370,22046718:2204913', 'assoc_mat': '22035061:autre:4230:22036499,22035062:autre:4230:22036523,22035063:autre:4230:22036249,22035065:autre:4230:22036164,22035066:autre:4230:22036119,22035067:autre:4230:22036019,22035068:autre:4230:22035926,22035069:autre:4230:22035805,22035070:autre:4230:22035568,22035071:autre:4230:22035542,22035072:autre:4230:22035278,22035073:autre:4230:22039640,22035075:autre:4230:22035302,22036822:autre:4230:22037416,22036823:autre:4230:22037316,22036824:autre:4230:22037248,22036825:autre:4230:22037162,22036850:autre:4230:22037009,22038541:autre:4230:22039322,22038542:autre:4230:22039236,22038543:autre:4230:22039343,22038544:autre:4230:22041004,22038545:autre:4230:22039951,22038546:autre:4230:22038844,22038547:autre:4230:22038802,22040167:autre:4230:22040551,22040168:autre:4230:22040403,22040169:autre:4230:22040582,22040170:autre:4230:22040318,22043091:autre:4230:22045539,22043092:autre:4230:22044858,22043093:autre:4230:22044939,22043094:autre:4230:22051062,22043095:autre:4230:22044629,22043096:autre:4230:22044493,22043097:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.03395980467205257, 'nb_photo': 384239, 'list_port_cont': '22035272,22035315,22035549,22035559,22035817,22035937,22036029,22036115,22036153,22036263,22036506,22036519,22037006,22037168,22037246,22037322,22037433,22038813,22038852,22039235,22039327,22039334,22039644,22039950,22040320,22040412,22040546,22040574,22040992,22043499,22043553,22043823,22044048,22044103,22044296,22044367,22044508,22044636,22044721,22044780,22044868,22044950,22045117,22045237,22045268,22045352,22045535,22045624,22046970,22047040,22047274,22047473,22047510,22047704,22047725,22047779,22047841,22047931,22048075,22048210,22048277,22048323,22048441,22048526,22048703,22048741,22048916,22048977,22049014,22049057,22049135,22049219,22049268,22049377,22049427,22049464,22049602,22049654,22050547,22051075,22054800,22054865,22055134,22055184,22055273,22055331,22055421,22055477,22055579,22055649,22055690,22055731,22055840,22055881,22055926,22055963,22056001,22056032,22056075,22056093,22056147,22056199,22056224,22056271,22056280,22056342,22056397,22056432,22056471,22056508,22056539,22056611,22057204,2207826', 'assoc_port': '22035061:22036506,22035062:22036519,22035063:22036263,22035065:22036153,22035066:22036115,22035067:22036029,22035068:22035937,22035069:22035817,22035070:22035559,22035071:22035549,22035072:22035272,22035073:22039644,22035075:22035315,22036822:22037433,22036823:22037322,22036824:22037246,22036825:22037168,22036850:22037006,22038541:22039327,22038542:22039235,22038543:22039334,22038544:22040992,22038545:22039950,22038546:22038852,22038547:22038813,22040167:22040546,22040168:22040412,22040169:22040574,22040170:22040320,22043091:22045535,22043092:22044868,22043093:22044950,22043094:22051075,22043095:22044636,22043096:22044508,22043097:22045624,22043098:22044048,22043099:22044296,22043100:22043553,22043101:22044103,22043102:22045268,22043103:22044721,22043105:22044780,22043108:22043499,22043110:22050547,22043113:22044367,22043115:22043823,22044829:22045237,22044834:22045352,22044835:22045117,22046712:22049602,22046713:22049654,22046714:22049464,22046715:22049427,22046716:22049219,22046717:22049377,22046718:2204913', 'assoc_mat': '22035061:carton:4230:22036506,22035062:carton:4230:22036519,22035063:carton:4230:22036263,22035065:carton:4230:22036153,22035066:carton:4230:22036115,22035067:carton:4230:22036029,22035068:carton:4230:22035937,22035069:carton:4230:22035817,22035070:carton:4230:22035559,22035071:carton:4230:22035549,22035072:carton:4230:22035272,22035073:carton:4230:22039644,22035075:carton:4230:22035315,22036822:carton:4230:22037433,22036823:carton:4230:22037322,22036824:carton:4230:22037246,22036825:carton:4230:22037168,22036850:carton:4230:22037006,22038541:carton:4230:22039327,22038542:carton:4230:22039235,22038543:carton:4230:22039334,22038544:carton:4230:22040992,22038545:carton:4230:22039950,22038546:carton:4230:22038852,22038547:carton:4230:22038813,22040167:carton:4230:22040546,22040168:carton:4230:22040412,22040169:carton:4230:22040574,22040170:carton:4230:22040320,22043091:carton:4230:22045535,22043092:carton:4230:22044868,22043093:carton:4230:22044950,22043094:carton:4230:22051075,22043095:carton:4230:22044636,2204'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009853189052209223, 'nb_photo': 17543, 'list_port_cont': '22035265,22035313,22035548,22035557,22035802,22035924,22036014,22036121,22036148,22036259,22036494,22036524,22036999,22037166,22037255,22037308,22038807,22038842,22039227,22039317,22039340,22039634,22039940,22040307,22040409,22040548,22040581,22040994,22043493,22043554,22043822,22044056,22044091,22044297,22044371,22044509,22044718,22044781,22044873,22044944,22045106,22045259,22045529,22045635,22046962,22047035,22047471,22047520,22047771,22047830,22048195,22048271,22048318,22048436,22048517,22048702,22048734,22048913,22048963,22049017,22049053,22049257,22049460,22049589,22049663,22050551,22051065,22054796,22054849,22055120,22055179,22055329,22055429,22055482,22055572,22055643,22055682,22055842,22055879,22055962,22055996,22056086,22056150,22056197,22056220,22056264,22056278,22056395,22056465,22056499,22056532,22056598,22078250,22078431,22078940,22079274,22079825,22079843,22080088,22080149,22080268,22080381,22080594,22080792,22080833,22080874,22081031,22081450,22081502,22081577,22081629,22081853,22081911,2208196', 'assoc_port': '22035061:22036494,22035062:22036524,22035063:22036259,22035065:22036148,22035066:22036121,22035067:22036014,22035068:22035924,22035069:22035802,22035070:22035557,22035071:22035548,22035072:22035265,22035073:22039634,22035075:22035313,22036823:22037308,22036824:22037255,22036825:22037166,22036850:22036999,22038541:22039317,22038542:22039227,22038543:22039340,22038544:22040994,22038545:22039940,22038546:22038842,22038547:22038807,22040167:22040548,22040168:22040409,22040169:22040581,22040170:22040307,22043091:22045529,22043092:22044873,22043093:22044944,22043094:22051065,22043096:22044509,22043097:22045635,22043098:22044056,22043099:22044297,22043100:22043554,22043101:22044091,22043102:22045259,22043103:22044718,22043105:22044781,22043108:22043493,22043110:22050551,22043113:22044371,22043115:22043822,22044835:22045106,22046712:22049589,22046713:22049663,22046714:22049460,22046719:22049257,22046720:22048318,22046721:22048436,22046722:22048195,22046724:22048271,22046752:22047771,22046754:22047035,22046755:2204752', 'assoc_mat': '22035061:metal:4230:22036494,22035062:metal:4230:22036524,22035063:metal:4230:22036259,22035065:metal:4230:22036148,22035066:metal:4230:22036121,22035067:metal:4230:22036014,22035068:metal:4230:22035924,22035069:metal:4230:22035802,22035070:metal:4230:22035557,22035071:metal:4230:22035548,22035072:metal:4230:22035265,22035073:metal:4230:22039634,22035075:metal:4230:22035313,22036823:metal:4230:22037308,22036824:metal:4230:22037255,22036825:metal:4230:22037166,22036850:metal:4230:22036999,22038541:metal:4230:22039317,22038542:metal:4230:22039227,22038543:metal:4230:22039340,22038544:metal:4230:22040994,22038545:metal:4230:22039940,22038546:metal:4230:22038842,22038547:metal:4230:22038807,22040167:metal:4230:22040548,22040168:metal:4230:22040409,22040169:metal:4230:22040581,22040170:metal:4230:22040307,22043091:metal:4230:22045529,22043092:metal:4230:22044873,22043093:metal:4230:22044944,22043094:metal:4230:22051065,22043096:metal:4230:22044509,22043097:metal:4230:22045635,22043098:metal:4230:22044056,22043099:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.12625039371678903, 'nb_photo': 1040437, 'list_port_cont': '22035274,22035309,22035547,22035572,22035812,22035932,22036028,22036112,22036158,22036260,22036497,22036514,22037001,22037163,22037252,22037318,22037429,22038809,22038847,22039234,22039326,22039347,22039651,22039946,22040322,22040417,22040550,22040588,22041001,22043491,22043564,22043788,22044045,22044097,22044306,22044372,22044502,22044633,22044714,22044775,22044866,22044953,22045114,22045233,22045267,22045353,22045531,22045636,22046979,22047028,22047280,22047470,22047519,22047702,22047717,22047780,22047836,22047925,22048069,22048202,22048265,22048322,22048432,22048532,22048705,22048742,22048918,22048974,22049008,22049052,22049143,22049206,22049265,22049376,22049420,22049469,22049603,22049664,22050549,22051073,22054804,22054852,22055130,22055176,22055283,22055335,22055427,22055484,22055577,22055655,22055695,22055728,22055839,22055872,22055929,22055961,22055998,22056035,22056068,22056094,22056143,22056200,22056237,22056273,22056285,22056337,22056385,22056435,22056466,22056497,22056537,22056609,22057208,2207825', 'assoc_port': '22035061:22036497,22035062:22036514,22035063:22036260,22035065:22036158,22035066:22036112,22035067:22036028,22035068:22035932,22035069:22035812,22035070:22035572,22035071:22035547,22035072:22035274,22035073:22039651,22035075:22035309,22036822:22037429,22036823:22037318,22036824:22037252,22036825:22037163,22036850:22037001,22038541:22039326,22038542:22039234,22038543:22039347,22038544:22041001,22038545:22039946,22038546:22038847,22038547:22038809,22040167:22040550,22040168:22040417,22040169:22040588,22040170:22040322,22043091:22045531,22043092:22044866,22043093:22044953,22043094:22051073,22043095:22044633,22043096:22044502,22043097:22045636,22043098:22044045,22043099:22044306,22043100:22043564,22043101:22044097,22043102:22045267,22043103:22044714,22043105:22044775,22043108:22043491,22043110:22050549,22043113:22044372,22043115:22043788,22044829:22045233,22044834:22045353,22044835:22045114,22046712:22049603,22046713:22049664,22046714:22049469,22046715:22049420,22046716:22049206,22046717:22049376,22046718:2204914', 'assoc_mat': '22035061:papier:4230:22036497,22035062:papier:4230:22036514,22035063:papier:4230:22036260,22035065:papier:4230:22036158,22035066:papier:4230:22036112,22035067:papier:4230:22036028,22035068:papier:4230:22035932,22035069:papier:4230:22035812,22035070:papier:4230:22035572,22035071:papier:4230:22035547,22035072:papier:4230:22035274,22035073:papier:4230:22039651,22035075:papier:4230:22035309,22036822:papier:4230:22037429,22036823:papier:4230:22037318,22036824:papier:4230:22037252,22036825:papier:4230:22037163,22036850:papier:4230:22037001,22038541:papier:4230:22039326,22038542:papier:4230:22039234,22038543:papier:4230:22039347,22038544:papier:4230:22041001,22038545:papier:4230:22039946,22038546:papier:4230:22038847,22038547:papier:4230:22038809,22040167:papier:4230:22040550,22040168:papier:4230:22040417,22040169:papier:4230:22040588,22040170:papier:4230:22040322,22043091:papier:4230:22045531,22043092:papier:4230:22044866,22043093:papier:4230:22044953,22043094:papier:4230:22051073,22043095:papier:4230:22044633,2204'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0013614587666678616, 'nb_photo': 7193, 'list_port_cont': '22036251,22036501,22036510,22038804,22039949,22040584,22044784,22045540,22047507,22047772,22048211,22048978,22049661,22055129,22055276,22055328,22055425,22055473,22055587,22055647,22055681,22055967,22056005,22056082,22056201,22056462,22056501,22056544,22056608,22078434,22079271,22080093,22080378,22080604,22080798,22080830,22081973,22085100,22085289,22085405,22085533,22085650,22085731,22086346,22087508,22088002,22088721,22088812,22088993,22089047,22090160,22090335,22090415,22090442,22090554,22090755,22090866,22090949,22091056,22091100,22091169,22091659,22091962,22092212,22092289,22092378,22092962,22093273,22094028,22094090,22094208,22094261,22094394,22094401,22094561,22094802,22094932,22094985,22095023,22095109,22095333,22095518,22095576,22096291,22096343,22096403,22096489,22096790,22097386,22097833,22098093,22098285,22098831,22098982,22099210,22099221,22099508,22100169,22100204,22100386,22100420,22100735,22100806,22100863,22100925,22100955,22101003,22101083,22101085,22101229,22101261,22101285,22101501,2210162', 'assoc_port': '22035061:22036501,22035062:22036510,22035063:22036251,22038545:22039949,22038547:22038804,22040169:22040584,22043091:22045540,22043105:22044784,22046713:22049661,22046722:22048211,22046752:22047772,22046755:22047507,22048045:22048978,22054420:22056608,22054421:22056462,22054422:22056501,22054423:22055328,22054425:22056201,22054429:22056005,22054430:22056544,22054431:22056082,22054433:22055473,22054434:22055276,22054435:22055681,22054436:22055425,22054437:22055647,22054438:22055967,22054442:22055587,22054445:22055129,22078140:22079271,22078142:22078434,22079378:22081973,22079381:22080830,22079383:22080378,22079409:22080798,22079414:22080093,22079415:22080604,22084059:22091100,22084060:22091169,22084099:22090949,22084100:22091056,22084101:22090866,22084102:22090755,22084103:22090442,22084105:22090554,22084134:22086346,22084135:22097833,22084136:22085731,22084137:22098093,22084139:22085533,22084140:22085650,22084142:22085100,22084143:22085405,22084147:22085289,22085775:22090160,22085777:22090335,22085778:2209041', 'assoc_mat': '22035061:pehd:4230:22036501,22035062:pehd:4230:22036510,22035063:pehd:4230:22036251,22038545:pehd:4230:22039949,22038547:pehd:4230:22038804,22040169:pehd:4230:22040584,22043091:pehd:4230:22045540,22043105:pehd:4230:22044784,22046713:pehd:4230:22049661,22046722:pehd:4230:22048211,22046752:pehd:4230:22047772,22046755:pehd:4230:22047507,22048045:pehd:4230:22048978,22054420:pehd:4230:22056608,22054421:pehd:4230:22056462,22054422:pehd:4230:22056501,22054423:pehd:4230:22055328,22054425:pehd:4230:22056201,22054429:pehd:4230:22056005,22054430:pehd:4230:22056544,22054431:pehd:4230:22056082,22054433:pehd:4230:22055473,22054434:pehd:4230:22055276,22054435:pehd:4230:22055681,22054436:pehd:4230:22055425,22054437:pehd:4230:22055647,22054438:pehd:4230:22055967,22054442:pehd:4230:22055587,22054445:pehd:4230:22055129,22078140:pehd:4230:22079271,22078142:pehd:4230:22078434,22079378:pehd:4230:22081973,22079381:pehd:4230:22080830,22079383:pehd:4230:22080378,22079409:pehd:4230:22080798,22079414:pehd:4230:22080093,22079415:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009170475250917147, 'nb_photo': 143910, 'list_port_cont': '22035276,22035304,22035554,22035567,22035816,22035936,22036016,22036117,22036161,22036262,22036502,22036522,22037000,22037171,22037254,22037321,22037432,22038806,22038851,22039232,22039321,22039332,22039636,22039952,22040317,22040418,22040540,22040590,22041005,22043501,22043563,22043819,22044055,22044099,22044301,22044363,22044503,22044632,22044716,22044783,22044870,22044947,22045111,22045232,22045265,22045359,22045534,22045629,22046977,22047031,22047284,22047468,22047517,22047703,22047724,22047774,22047835,22047929,22048073,22048198,22048273,22048329,22048435,22048533,22048704,22048739,22048909,22048976,22049007,22049055,22049144,22049217,22049267,22049372,22049428,22049472,22049598,22049665,22050563,22051066,22054802,22054864,22055127,22055182,22055281,22055323,22055433,22055480,22055584,22055651,22055692,22055724,22055836,22055875,22055923,22055964,22056003,22056041,22056072,22056087,22056142,22056191,22056232,22056272,22056288,22056335,22056392,22056434,22056470,22056504,22056543,22056596,22057207,2207826', 'assoc_port': '22035061:22036502,22035062:22036522,22035063:22036262,22035065:22036161,22035066:22036117,22035067:22036016,22035068:22035936,22035069:22035816,22035070:22035567,22035071:22035554,22035072:22035276,22035073:22039636,22035075:22035304,22036822:22037432,22036823:22037321,22036824:22037254,22036825:22037171,22036850:22037000,22038541:22039321,22038542:22039232,22038543:22039332,22038544:22041005,22038545:22039952,22038546:22038851,22038547:22038806,22040167:22040540,22040168:22040418,22040169:22040590,22040170:22040317,22043091:22045534,22043092:22044870,22043093:22044947,22043094:22051066,22043095:22044632,22043096:22044503,22043097:22045629,22043098:22044055,22043099:22044301,22043100:22043563,22043101:22044099,22043102:22045265,22043103:22044716,22043105:22044783,22043108:22043501,22043110:22050563,22043113:22044363,22043115:22043819,22044829:22045232,22044834:22045359,22044835:22045111,22046712:22049598,22046713:22049665,22046714:22049472,22046715:22049428,22046716:22049217,22046717:22049372,22046718:2204914', 'assoc_mat': '22035061:pet_clair:4230:22036502,22035062:pet_clair:4230:22036522,22035063:pet_clair:4230:22036262,22035065:pet_clair:4230:22036161,22035066:pet_clair:4230:22036117,22035067:pet_clair:4230:22036016,22035068:pet_clair:4230:22035936,22035069:pet_clair:4230:22035816,22035070:pet_clair:4230:22035567,22035071:pet_clair:4230:22035554,22035072:pet_clair:4230:22035276,22035073:pet_clair:4230:22039636,22035075:pet_clair:4230:22035304,22036822:pet_clair:4230:22037432,22036823:pet_clair:4230:22037321,22036824:pet_clair:4230:22037254,22036825:pet_clair:4230:22037171,22036850:pet_clair:4230:22037000,22038541:pet_clair:4230:22039321,22038542:pet_clair:4230:22039232,22038543:pet_clair:4230:22039332,22038544:pet_clair:4230:22041005,22038545:pet_clair:4230:22039952,22038546:pet_clair:4230:22038851,22038547:pet_clair:4230:22038806,22040167:pet_clair:4230:22040540,22040168:pet_clair:4230:22040418,22040169:pet_clair:4230:22040590,22040170:pet_clair:4230:22040317,22043091:pet_clair:4230:22045534,22043092:pet_clair:4230:22044870,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0023051088276208505, 'nb_photo': 3357, 'list_port_cont': '22037259,22039238,22039939,22040578,22043559,22044052,22044303,22044358,22044717,22044774,22044948,22045271,22045634,22048077,22048276,22048696,22048915,22049259,22049426,22049599,22049659,22050567,22051076,22055132,22055330,22055431,22055583,22055657,22055687,22055733,22055877,22055968,22055995,22056089,22056194,22056258,22056291,22056388,22056469,22056507,22056541,22056607,22078923,22079282,22080100,22080154,22080598,22081971,22085007,22085212,22085928,22087772,22087896,22088170,22088310,22088717,22088815,22089044,22089110,22089831,22090334,22090405,22090867,22090940,22091063,22091166,22092206,22092372,22092958,22093275,22094206,22094562,22094812,22094991,22095440,22095507,22095909,22095962,22096279,22096800,22097390,22097830,22098091,22098290,22098495,22098794,22098832,22098976,22099065,22099211,22099225,22099349,22099790,22100201,22100241,22100804,22100953,22101009,22101087,22101230,22101287,22101680,22101939,22102079,22102383,22102670,22102726,22102909,22104654,22105163,22105253,22105292,22105337,2210540', 'assoc_port': '22036824:22037259,22038542:22039238,22038545:22039939,22040169:22040578,22043093:22044948,22043094:22051076,22043097:22045634,22043098:22044052,22043099:22044303,22043100:22043559,22043102:22045271,22043103:22044717,22043105:22044774,22043110:22050567,22043113:22044358,22046712:22049599,22046713:22049659,22046715:22049426,22046719:22049259,22046724:22048276,22046751:22048077,22048048:22048696,22048049:22048915,22054350:22056388,22054354:22056258,22054355:22056291,22054420:22056607,22054421:22056469,22054422:22056507,22054423:22055330,22054424:22055877,22054425:22056194,22054428:22055733,22054429:22055995,22054430:22056541,22054431:22056089,22054435:22055687,22054436:22055431,22054437:22055657,22054438:22055968,22054442:22055583,22054445:22055132,22078140:22079282,22078141:22078923,22079378:22081971,22079410:22080154,22079414:22080100,22079415:22080598,22084060:22091166,22084099:22090940,22084100:22091063,22084101:22090867,22084132:22085928,22084135:22097830,22084137:22098091,22084144:22085007,22084145:2208521', 'assoc_mat': '22036824:pet_fonce:4230:22037259,22038542:pet_fonce:4230:22039238,22038545:pet_fonce:4230:22039939,22040169:pet_fonce:4230:22040578,22043093:pet_fonce:4230:22044948,22043094:pet_fonce:4230:22051076,22043097:pet_fonce:4230:22045634,22043098:pet_fonce:4230:22044052,22043099:pet_fonce:4230:22044303,22043100:pet_fonce:4230:22043559,22043102:pet_fonce:4230:22045271,22043103:pet_fonce:4230:22044717,22043105:pet_fonce:4230:22044774,22043110:pet_fonce:4230:22050567,22043113:pet_fonce:4230:22044358,22046712:pet_fonce:4230:22049599,22046713:pet_fonce:4230:22049659,22046715:pet_fonce:4230:22049426,22046719:pet_fonce:4230:22049259,22046724:pet_fonce:4230:22048276,22046751:pet_fonce:4230:22048077,22048048:pet_fonce:4230:22048696,22048049:pet_fonce:4230:22048915,22054350:pet_fonce:4230:22056388,22054354:pet_fonce:4230:22056258,22054355:pet_fonce:4230:22056291,22054420:pet_fonce:4230:22056607,22054421:pet_fonce:4230:22056469,22054422:pet_fonce:4230:22056507,22054423:pet_fonce:4230:22055330,22054424:pet_fonce:4230:22055877,2'}, {'unwanted_material': 'refus', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.8336118956875427, 'nb_photo': 965, 'list_port_cont': '22346191', 'assoc_port': '22345824:22346191', 'assoc_mat': '22345824:refus:4230:22346191'}), 'main_stat': {'nb_photos': 20121}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((20121,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 15444),), 'material_dict': {'truck': 15444}, 'coverage_data': (('2025/04/30/', 0.957615), ('2025/04/29/', 0.961076), ('2025/04/28/', 0.965682), ('2025/04/27/', 0.963669), ('2025/04/26/', 0.961342), ('2025/04/25/', 0.962025), ('2025/04/24/', 0.958611), ('2025/04/23/', 0.962523), ('2025/04/22/', 0.957152), ('2025/04/21/', 0.960833), ('2025/04/20/', 0.958611), ('2025/04/18/', 0.960208), ('2025/04/19/', 0.961574), ('2025/04/17/', 0.962893), ('2025/04/16/', 0.96677), ('2025/04/15/', 0.967106), ('2025/04/14/', 0.96471), ('2025/04/13/', 0.959594), ('2025/04/11/', 0.961678), ('2025/04/12/', 0.960567), ('2025/04/10/', 0.963993), ('2025/04/09/', 0.966018), ('2025/04/02/', 0.966851), ('2025/04/01/', 0.960405)), 'impurety_average_data': ((datetime.date(2025, 4, 1), 0.22372752713236607, 1284), (datetime.date(2025, 4, 2), 0.21019084581504535, 827), (datetime.date(2025, 4, 3), 0.17707630916345143, 34), (datetime.date(2025, 4, 15), 0.1825603406657378, 900), (datetime.date(2025, 4, 16), 0.184181277748339, 1722), (datetime.date(2025, 4, 17), 0.24719553778720263, 826), (datetime.date(2025, 4, 18), 0.23783875986987724, 1512), (datetime.date(2025, 4, 19), 0.23333064218148647, 2307), (datetime.date(2025, 4, 20), 0.23067271980415782, 243), (datetime.date(2025, 4, 21), 0.17247829565215098, 579), (datetime.date(2025, 4, 22), 0.20252984096471627, 1476), (datetime.date(2025, 4, 23), 0.19560101008001624, 831), (datetime.date(2025, 4, 24), 0.23169714528549848, 1145), (datetime.date(2025, 4, 25), 0.21563665941598556, 1685), (datetime.date(2025, 4, 28), 0.21356860986434448, 767), (datetime.date(2025, 4, 29), 0.1998356811796272, 2136), (datetime.date(2025, 4, 30), 0.22006341804788554, 1839)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 4, 1), 0.22372752713236607, 1284), (datetime.date(2025, 4, 2), 0.21019084581504535, 827), (datetime.date(2025, 4, 3), 0.17707630916345143, 34), (datetime.date(2025, 4, 15), 0.1825603406657378, 900), (datetime.date(2025, 4, 16), 0.184181277748339, 1722), (datetime.date(2025, 4, 17), 0.24719553778720263, 826), (datetime.date(2025, 4, 18), 0.23783875986987724, 1512), (datetime.date(2025, 4, 19), 0.23333064218148647, 2307), (datetime.date(2025, 4, 20), 0.23067271980415782, 243), (datetime.date(2025, 4, 21), 0.17247829565215098, 579), (datetime.date(2025, 4, 22), 0.20252984096471627, 1476), (datetime.date(2025, 4, 23), 0.19560101008001624, 831), (datetime.date(2025, 4, 24), 0.23169714528549848, 1145), (datetime.date(2025, 4, 25), 0.21563665941598556, 1685), (datetime.date(2025, 4, 28), 0.21356860986434448, 767), (datetime.date(2025, 4, 29), 0.1998356811796272, 2136), (datetime.date(2025, 4, 30), 0.22006341804788554, 1839))}, 'quality_array': [['-7.401582516570274', '01042025'], ['-7.451827147952839', '02042025'], ['-7.889285438777034', '03042025'], ['-7.715708122738408', '15042025'], ['-7.716432857926614', '16042025'], ['-7.659131913691329', '17042025'], ['-7.915684239872292', '18042025'], ['-7.75454731014833', '19042025'], ['-7.789091715907841', '20042025'], ['-7.385689771915514', '21042025'], ['-7.539128415201154', '22042025'], ['-7.567285135966937', '23042025'], ['-7.239445161540982', '24042025'], ['-7.395502423491663', '25042025'], ['-7.468566465010861', '28042025'], ['-7.4906374082405796', '29042025'], ['-7.597271374877762', '30042025']], 'number_of_batch': ((2804,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.040205758878486944, 'nb_photo': 332128, 'list_port_cont': '22035278,22035302,22035542,22035568,22035805,22035926,22036019,22036119,22036164,22036249,22036499,22036523,22037009,22037162,22037248,22037316,22037416,22038802,22038844,22039236,22039322,22039343,22039640,22039951,22040318,22040403,22040551,22040582,22041004,22043492,22043558,22043785,22044038,22044088,22044305,22044362,22044493,22044629,22044719,22044771,22044858,22044939,22045112,22045225,22045264,22045350,22045539,22045631,22046972,22047043,22047273,22047465,22047511,22047707,22047722,22047773,22047838,22047932,22048072,22048200,22048268,22048327,22048439,22048519,22048699,22048743,22048914,22048971,22049011,22049056,22049136,22049211,22049266,22049370,22049411,22049473,22049604,22049662,22050565,22051062,22054801,22054858,22055128,22055180,22055269,22055336,22055428,22055472,22055580,22055648,22055680,22055729,22055845,22055871,22055920,22055966,22056004,22056042,22056078,22056096,22056133,22056189,22056223,22056263,22056275,22056346,22056398,22056427,22056461,22056498,22056545,22056599,22057200,2207826', 'assoc_port': '22035061:22036499,22035062:22036523,22035063:22036249,22035065:22036164,22035066:22036119,22035067:22036019,22035068:22035926,22035069:22035805,22035070:22035568,22035071:22035542,22035072:22035278,22035073:22039640,22035075:22035302,22036822:22037416,22036823:22037316,22036824:22037248,22036825:22037162,22036850:22037009,22038541:22039322,22038542:22039236,22038543:22039343,22038544:22041004,22038545:22039951,22038546:22038844,22038547:22038802,22040167:22040551,22040168:22040403,22040169:22040582,22040170:22040318,22043091:22045539,22043092:22044858,22043093:22044939,22043094:22051062,22043095:22044629,22043096:22044493,22043097:22045631,22043098:22044038,22043099:22044305,22043100:22043558,22043101:22044088,22043102:22045264,22043103:22044719,22043105:22044771,22043108:22043492,22043110:22050565,22043113:22044362,22043115:22043785,22044829:22045225,22044834:22045350,22044835:22045112,22046712:22049604,22046713:22049662,22046714:22049473,22046715:22049411,22046716:22049211,22046717:22049370,22046718:2204913', 'assoc_mat': '22035061:autre:4230:22036499,22035062:autre:4230:22036523,22035063:autre:4230:22036249,22035065:autre:4230:22036164,22035066:autre:4230:22036119,22035067:autre:4230:22036019,22035068:autre:4230:22035926,22035069:autre:4230:22035805,22035070:autre:4230:22035568,22035071:autre:4230:22035542,22035072:autre:4230:22035278,22035073:autre:4230:22039640,22035075:autre:4230:22035302,22036822:autre:4230:22037416,22036823:autre:4230:22037316,22036824:autre:4230:22037248,22036825:autre:4230:22037162,22036850:autre:4230:22037009,22038541:autre:4230:22039322,22038542:autre:4230:22039236,22038543:autre:4230:22039343,22038544:autre:4230:22041004,22038545:autre:4230:22039951,22038546:autre:4230:22038844,22038547:autre:4230:22038802,22040167:autre:4230:22040551,22040168:autre:4230:22040403,22040169:autre:4230:22040582,22040170:autre:4230:22040318,22043091:autre:4230:22045539,22043092:autre:4230:22044858,22043093:autre:4230:22044939,22043094:autre:4230:22051062,22043095:autre:4230:22044629,22043096:autre:4230:22044493,22043097:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.03395980467205257, 'nb_photo': 384239, 'list_port_cont': '22035272,22035315,22035549,22035559,22035817,22035937,22036029,22036115,22036153,22036263,22036506,22036519,22037006,22037168,22037246,22037322,22037433,22038813,22038852,22039235,22039327,22039334,22039644,22039950,22040320,22040412,22040546,22040574,22040992,22043499,22043553,22043823,22044048,22044103,22044296,22044367,22044508,22044636,22044721,22044780,22044868,22044950,22045117,22045237,22045268,22045352,22045535,22045624,22046970,22047040,22047274,22047473,22047510,22047704,22047725,22047779,22047841,22047931,22048075,22048210,22048277,22048323,22048441,22048526,22048703,22048741,22048916,22048977,22049014,22049057,22049135,22049219,22049268,22049377,22049427,22049464,22049602,22049654,22050547,22051075,22054800,22054865,22055134,22055184,22055273,22055331,22055421,22055477,22055579,22055649,22055690,22055731,22055840,22055881,22055926,22055963,22056001,22056032,22056075,22056093,22056147,22056199,22056224,22056271,22056280,22056342,22056397,22056432,22056471,22056508,22056539,22056611,22057204,2207826', 'assoc_port': '22035061:22036506,22035062:22036519,22035063:22036263,22035065:22036153,22035066:22036115,22035067:22036029,22035068:22035937,22035069:22035817,22035070:22035559,22035071:22035549,22035072:22035272,22035073:22039644,22035075:22035315,22036822:22037433,22036823:22037322,22036824:22037246,22036825:22037168,22036850:22037006,22038541:22039327,22038542:22039235,22038543:22039334,22038544:22040992,22038545:22039950,22038546:22038852,22038547:22038813,22040167:22040546,22040168:22040412,22040169:22040574,22040170:22040320,22043091:22045535,22043092:22044868,22043093:22044950,22043094:22051075,22043095:22044636,22043096:22044508,22043097:22045624,22043098:22044048,22043099:22044296,22043100:22043553,22043101:22044103,22043102:22045268,22043103:22044721,22043105:22044780,22043108:22043499,22043110:22050547,22043113:22044367,22043115:22043823,22044829:22045237,22044834:22045352,22044835:22045117,22046712:22049602,22046713:22049654,22046714:22049464,22046715:22049427,22046716:22049219,22046717:22049377,22046718:2204913', 'assoc_mat': '22035061:carton:4230:22036506,22035062:carton:4230:22036519,22035063:carton:4230:22036263,22035065:carton:4230:22036153,22035066:carton:4230:22036115,22035067:carton:4230:22036029,22035068:carton:4230:22035937,22035069:carton:4230:22035817,22035070:carton:4230:22035559,22035071:carton:4230:22035549,22035072:carton:4230:22035272,22035073:carton:4230:22039644,22035075:carton:4230:22035315,22036822:carton:4230:22037433,22036823:carton:4230:22037322,22036824:carton:4230:22037246,22036825:carton:4230:22037168,22036850:carton:4230:22037006,22038541:carton:4230:22039327,22038542:carton:4230:22039235,22038543:carton:4230:22039334,22038544:carton:4230:22040992,22038545:carton:4230:22039950,22038546:carton:4230:22038852,22038547:carton:4230:22038813,22040167:carton:4230:22040546,22040168:carton:4230:22040412,22040169:carton:4230:22040574,22040170:carton:4230:22040320,22043091:carton:4230:22045535,22043092:carton:4230:22044868,22043093:carton:4230:22044950,22043094:carton:4230:22051075,22043095:carton:4230:22044636,2204'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009853189052209223, 'nb_photo': 17543, 'list_port_cont': '22035265,22035313,22035548,22035557,22035802,22035924,22036014,22036121,22036148,22036259,22036494,22036524,22036999,22037166,22037255,22037308,22038807,22038842,22039227,22039317,22039340,22039634,22039940,22040307,22040409,22040548,22040581,22040994,22043493,22043554,22043822,22044056,22044091,22044297,22044371,22044509,22044718,22044781,22044873,22044944,22045106,22045259,22045529,22045635,22046962,22047035,22047471,22047520,22047771,22047830,22048195,22048271,22048318,22048436,22048517,22048702,22048734,22048913,22048963,22049017,22049053,22049257,22049460,22049589,22049663,22050551,22051065,22054796,22054849,22055120,22055179,22055329,22055429,22055482,22055572,22055643,22055682,22055842,22055879,22055962,22055996,22056086,22056150,22056197,22056220,22056264,22056278,22056395,22056465,22056499,22056532,22056598,22078250,22078431,22078940,22079274,22079825,22079843,22080088,22080149,22080268,22080381,22080594,22080792,22080833,22080874,22081031,22081450,22081502,22081577,22081629,22081853,22081911,2208196', 'assoc_port': '22035061:22036494,22035062:22036524,22035063:22036259,22035065:22036148,22035066:22036121,22035067:22036014,22035068:22035924,22035069:22035802,22035070:22035557,22035071:22035548,22035072:22035265,22035073:22039634,22035075:22035313,22036823:22037308,22036824:22037255,22036825:22037166,22036850:22036999,22038541:22039317,22038542:22039227,22038543:22039340,22038544:22040994,22038545:22039940,22038546:22038842,22038547:22038807,22040167:22040548,22040168:22040409,22040169:22040581,22040170:22040307,22043091:22045529,22043092:22044873,22043093:22044944,22043094:22051065,22043096:22044509,22043097:22045635,22043098:22044056,22043099:22044297,22043100:22043554,22043101:22044091,22043102:22045259,22043103:22044718,22043105:22044781,22043108:22043493,22043110:22050551,22043113:22044371,22043115:22043822,22044835:22045106,22046712:22049589,22046713:22049663,22046714:22049460,22046719:22049257,22046720:22048318,22046721:22048436,22046722:22048195,22046724:22048271,22046752:22047771,22046754:22047035,22046755:2204752', 'assoc_mat': '22035061:metal:4230:22036494,22035062:metal:4230:22036524,22035063:metal:4230:22036259,22035065:metal:4230:22036148,22035066:metal:4230:22036121,22035067:metal:4230:22036014,22035068:metal:4230:22035924,22035069:metal:4230:22035802,22035070:metal:4230:22035557,22035071:metal:4230:22035548,22035072:metal:4230:22035265,22035073:metal:4230:22039634,22035075:metal:4230:22035313,22036823:metal:4230:22037308,22036824:metal:4230:22037255,22036825:metal:4230:22037166,22036850:metal:4230:22036999,22038541:metal:4230:22039317,22038542:metal:4230:22039227,22038543:metal:4230:22039340,22038544:metal:4230:22040994,22038545:metal:4230:22039940,22038546:metal:4230:22038842,22038547:metal:4230:22038807,22040167:metal:4230:22040548,22040168:metal:4230:22040409,22040169:metal:4230:22040581,22040170:metal:4230:22040307,22043091:metal:4230:22045529,22043092:metal:4230:22044873,22043093:metal:4230:22044944,22043094:metal:4230:22051065,22043096:metal:4230:22044509,22043097:metal:4230:22045635,22043098:metal:4230:22044056,22043099:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.12625039371678903, 'nb_photo': 1040437, 'list_port_cont': '22035274,22035309,22035547,22035572,22035812,22035932,22036028,22036112,22036158,22036260,22036497,22036514,22037001,22037163,22037252,22037318,22037429,22038809,22038847,22039234,22039326,22039347,22039651,22039946,22040322,22040417,22040550,22040588,22041001,22043491,22043564,22043788,22044045,22044097,22044306,22044372,22044502,22044633,22044714,22044775,22044866,22044953,22045114,22045233,22045267,22045353,22045531,22045636,22046979,22047028,22047280,22047470,22047519,22047702,22047717,22047780,22047836,22047925,22048069,22048202,22048265,22048322,22048432,22048532,22048705,22048742,22048918,22048974,22049008,22049052,22049143,22049206,22049265,22049376,22049420,22049469,22049603,22049664,22050549,22051073,22054804,22054852,22055130,22055176,22055283,22055335,22055427,22055484,22055577,22055655,22055695,22055728,22055839,22055872,22055929,22055961,22055998,22056035,22056068,22056094,22056143,22056200,22056237,22056273,22056285,22056337,22056385,22056435,22056466,22056497,22056537,22056609,22057208,2207825', 'assoc_port': '22035061:22036497,22035062:22036514,22035063:22036260,22035065:22036158,22035066:22036112,22035067:22036028,22035068:22035932,22035069:22035812,22035070:22035572,22035071:22035547,22035072:22035274,22035073:22039651,22035075:22035309,22036822:22037429,22036823:22037318,22036824:22037252,22036825:22037163,22036850:22037001,22038541:22039326,22038542:22039234,22038543:22039347,22038544:22041001,22038545:22039946,22038546:22038847,22038547:22038809,22040167:22040550,22040168:22040417,22040169:22040588,22040170:22040322,22043091:22045531,22043092:22044866,22043093:22044953,22043094:22051073,22043095:22044633,22043096:22044502,22043097:22045636,22043098:22044045,22043099:22044306,22043100:22043564,22043101:22044097,22043102:22045267,22043103:22044714,22043105:22044775,22043108:22043491,22043110:22050549,22043113:22044372,22043115:22043788,22044829:22045233,22044834:22045353,22044835:22045114,22046712:22049603,22046713:22049664,22046714:22049469,22046715:22049420,22046716:22049206,22046717:22049376,22046718:2204914', 'assoc_mat': '22035061:papier:4230:22036497,22035062:papier:4230:22036514,22035063:papier:4230:22036260,22035065:papier:4230:22036158,22035066:papier:4230:22036112,22035067:papier:4230:22036028,22035068:papier:4230:22035932,22035069:papier:4230:22035812,22035070:papier:4230:22035572,22035071:papier:4230:22035547,22035072:papier:4230:22035274,22035073:papier:4230:22039651,22035075:papier:4230:22035309,22036822:papier:4230:22037429,22036823:papier:4230:22037318,22036824:papier:4230:22037252,22036825:papier:4230:22037163,22036850:papier:4230:22037001,22038541:papier:4230:22039326,22038542:papier:4230:22039234,22038543:papier:4230:22039347,22038544:papier:4230:22041001,22038545:papier:4230:22039946,22038546:papier:4230:22038847,22038547:papier:4230:22038809,22040167:papier:4230:22040550,22040168:papier:4230:22040417,22040169:papier:4230:22040588,22040170:papier:4230:22040322,22043091:papier:4230:22045531,22043092:papier:4230:22044866,22043093:papier:4230:22044953,22043094:papier:4230:22051073,22043095:papier:4230:22044633,2204'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0013614587666678616, 'nb_photo': 7193, 'list_port_cont': '22036251,22036501,22036510,22038804,22039949,22040584,22044784,22045540,22047507,22047772,22048211,22048978,22049661,22055129,22055276,22055328,22055425,22055473,22055587,22055647,22055681,22055967,22056005,22056082,22056201,22056462,22056501,22056544,22056608,22078434,22079271,22080093,22080378,22080604,22080798,22080830,22081973,22085100,22085289,22085405,22085533,22085650,22085731,22086346,22087508,22088002,22088721,22088812,22088993,22089047,22090160,22090335,22090415,22090442,22090554,22090755,22090866,22090949,22091056,22091100,22091169,22091659,22091962,22092212,22092289,22092378,22092962,22093273,22094028,22094090,22094208,22094261,22094394,22094401,22094561,22094802,22094932,22094985,22095023,22095109,22095333,22095518,22095576,22096291,22096343,22096403,22096489,22096790,22097386,22097833,22098093,22098285,22098831,22098982,22099210,22099221,22099508,22100169,22100204,22100386,22100420,22100735,22100806,22100863,22100925,22100955,22101003,22101083,22101085,22101229,22101261,22101285,22101501,2210162', 'assoc_port': '22035061:22036501,22035062:22036510,22035063:22036251,22038545:22039949,22038547:22038804,22040169:22040584,22043091:22045540,22043105:22044784,22046713:22049661,22046722:22048211,22046752:22047772,22046755:22047507,22048045:22048978,22054420:22056608,22054421:22056462,22054422:22056501,22054423:22055328,22054425:22056201,22054429:22056005,22054430:22056544,22054431:22056082,22054433:22055473,22054434:22055276,22054435:22055681,22054436:22055425,22054437:22055647,22054438:22055967,22054442:22055587,22054445:22055129,22078140:22079271,22078142:22078434,22079378:22081973,22079381:22080830,22079383:22080378,22079409:22080798,22079414:22080093,22079415:22080604,22084059:22091100,22084060:22091169,22084099:22090949,22084100:22091056,22084101:22090866,22084102:22090755,22084103:22090442,22084105:22090554,22084134:22086346,22084135:22097833,22084136:22085731,22084137:22098093,22084139:22085533,22084140:22085650,22084142:22085100,22084143:22085405,22084147:22085289,22085775:22090160,22085777:22090335,22085778:2209041', 'assoc_mat': '22035061:pehd:4230:22036501,22035062:pehd:4230:22036510,22035063:pehd:4230:22036251,22038545:pehd:4230:22039949,22038547:pehd:4230:22038804,22040169:pehd:4230:22040584,22043091:pehd:4230:22045540,22043105:pehd:4230:22044784,22046713:pehd:4230:22049661,22046722:pehd:4230:22048211,22046752:pehd:4230:22047772,22046755:pehd:4230:22047507,22048045:pehd:4230:22048978,22054420:pehd:4230:22056608,22054421:pehd:4230:22056462,22054422:pehd:4230:22056501,22054423:pehd:4230:22055328,22054425:pehd:4230:22056201,22054429:pehd:4230:22056005,22054430:pehd:4230:22056544,22054431:pehd:4230:22056082,22054433:pehd:4230:22055473,22054434:pehd:4230:22055276,22054435:pehd:4230:22055681,22054436:pehd:4230:22055425,22054437:pehd:4230:22055647,22054438:pehd:4230:22055967,22054442:pehd:4230:22055587,22054445:pehd:4230:22055129,22078140:pehd:4230:22079271,22078142:pehd:4230:22078434,22079378:pehd:4230:22081973,22079381:pehd:4230:22080830,22079383:pehd:4230:22080378,22079409:pehd:4230:22080798,22079414:pehd:4230:22080093,22079415:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009170475250917147, 'nb_photo': 143910, 'list_port_cont': '22035276,22035304,22035554,22035567,22035816,22035936,22036016,22036117,22036161,22036262,22036502,22036522,22037000,22037171,22037254,22037321,22037432,22038806,22038851,22039232,22039321,22039332,22039636,22039952,22040317,22040418,22040540,22040590,22041005,22043501,22043563,22043819,22044055,22044099,22044301,22044363,22044503,22044632,22044716,22044783,22044870,22044947,22045111,22045232,22045265,22045359,22045534,22045629,22046977,22047031,22047284,22047468,22047517,22047703,22047724,22047774,22047835,22047929,22048073,22048198,22048273,22048329,22048435,22048533,22048704,22048739,22048909,22048976,22049007,22049055,22049144,22049217,22049267,22049372,22049428,22049472,22049598,22049665,22050563,22051066,22054802,22054864,22055127,22055182,22055281,22055323,22055433,22055480,22055584,22055651,22055692,22055724,22055836,22055875,22055923,22055964,22056003,22056041,22056072,22056087,22056142,22056191,22056232,22056272,22056288,22056335,22056392,22056434,22056470,22056504,22056543,22056596,22057207,2207826', 'assoc_port': '22035061:22036502,22035062:22036522,22035063:22036262,22035065:22036161,22035066:22036117,22035067:22036016,22035068:22035936,22035069:22035816,22035070:22035567,22035071:22035554,22035072:22035276,22035073:22039636,22035075:22035304,22036822:22037432,22036823:22037321,22036824:22037254,22036825:22037171,22036850:22037000,22038541:22039321,22038542:22039232,22038543:22039332,22038544:22041005,22038545:22039952,22038546:22038851,22038547:22038806,22040167:22040540,22040168:22040418,22040169:22040590,22040170:22040317,22043091:22045534,22043092:22044870,22043093:22044947,22043094:22051066,22043095:22044632,22043096:22044503,22043097:22045629,22043098:22044055,22043099:22044301,22043100:22043563,22043101:22044099,22043102:22045265,22043103:22044716,22043105:22044783,22043108:22043501,22043110:22050563,22043113:22044363,22043115:22043819,22044829:22045232,22044834:22045359,22044835:22045111,22046712:22049598,22046713:22049665,22046714:22049472,22046715:22049428,22046716:22049217,22046717:22049372,22046718:2204914', 'assoc_mat': '22035061:pet_clair:4230:22036502,22035062:pet_clair:4230:22036522,22035063:pet_clair:4230:22036262,22035065:pet_clair:4230:22036161,22035066:pet_clair:4230:22036117,22035067:pet_clair:4230:22036016,22035068:pet_clair:4230:22035936,22035069:pet_clair:4230:22035816,22035070:pet_clair:4230:22035567,22035071:pet_clair:4230:22035554,22035072:pet_clair:4230:22035276,22035073:pet_clair:4230:22039636,22035075:pet_clair:4230:22035304,22036822:pet_clair:4230:22037432,22036823:pet_clair:4230:22037321,22036824:pet_clair:4230:22037254,22036825:pet_clair:4230:22037171,22036850:pet_clair:4230:22037000,22038541:pet_clair:4230:22039321,22038542:pet_clair:4230:22039232,22038543:pet_clair:4230:22039332,22038544:pet_clair:4230:22041005,22038545:pet_clair:4230:22039952,22038546:pet_clair:4230:22038851,22038547:pet_clair:4230:22038806,22040167:pet_clair:4230:22040540,22040168:pet_clair:4230:22040418,22040169:pet_clair:4230:22040590,22040170:pet_clair:4230:22040317,22043091:pet_clair:4230:22045534,22043092:pet_clair:4230:22044870,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.0023051088276208505, 'nb_photo': 3357, 'list_port_cont': '22037259,22039238,22039939,22040578,22043559,22044052,22044303,22044358,22044717,22044774,22044948,22045271,22045634,22048077,22048276,22048696,22048915,22049259,22049426,22049599,22049659,22050567,22051076,22055132,22055330,22055431,22055583,22055657,22055687,22055733,22055877,22055968,22055995,22056089,22056194,22056258,22056291,22056388,22056469,22056507,22056541,22056607,22078923,22079282,22080100,22080154,22080598,22081971,22085007,22085212,22085928,22087772,22087896,22088170,22088310,22088717,22088815,22089044,22089110,22089831,22090334,22090405,22090867,22090940,22091063,22091166,22092206,22092372,22092958,22093275,22094206,22094562,22094812,22094991,22095440,22095507,22095909,22095962,22096279,22096800,22097390,22097830,22098091,22098290,22098495,22098794,22098832,22098976,22099065,22099211,22099225,22099349,22099790,22100201,22100241,22100804,22100953,22101009,22101087,22101230,22101287,22101680,22101939,22102079,22102383,22102670,22102726,22102909,22104654,22105163,22105253,22105292,22105337,2210540', 'assoc_port': '22036824:22037259,22038542:22039238,22038545:22039939,22040169:22040578,22043093:22044948,22043094:22051076,22043097:22045634,22043098:22044052,22043099:22044303,22043100:22043559,22043102:22045271,22043103:22044717,22043105:22044774,22043110:22050567,22043113:22044358,22046712:22049599,22046713:22049659,22046715:22049426,22046719:22049259,22046724:22048276,22046751:22048077,22048048:22048696,22048049:22048915,22054350:22056388,22054354:22056258,22054355:22056291,22054420:22056607,22054421:22056469,22054422:22056507,22054423:22055330,22054424:22055877,22054425:22056194,22054428:22055733,22054429:22055995,22054430:22056541,22054431:22056089,22054435:22055687,22054436:22055431,22054437:22055657,22054438:22055968,22054442:22055583,22054445:22055132,22078140:22079282,22078141:22078923,22079378:22081971,22079410:22080154,22079414:22080100,22079415:22080598,22084060:22091166,22084099:22090940,22084100:22091063,22084101:22090867,22084132:22085928,22084135:22097830,22084137:22098091,22084144:22085007,22084145:2208521', 'assoc_mat': '22036824:pet_fonce:4230:22037259,22038542:pet_fonce:4230:22039238,22038545:pet_fonce:4230:22039939,22040169:pet_fonce:4230:22040578,22043093:pet_fonce:4230:22044948,22043094:pet_fonce:4230:22051076,22043097:pet_fonce:4230:22045634,22043098:pet_fonce:4230:22044052,22043099:pet_fonce:4230:22044303,22043100:pet_fonce:4230:22043559,22043102:pet_fonce:4230:22045271,22043103:pet_fonce:4230:22044717,22043105:pet_fonce:4230:22044774,22043110:pet_fonce:4230:22050567,22043113:pet_fonce:4230:22044358,22046712:pet_fonce:4230:22049599,22046713:pet_fonce:4230:22049659,22046715:pet_fonce:4230:22049426,22046719:pet_fonce:4230:22049259,22046724:pet_fonce:4230:22048276,22046751:pet_fonce:4230:22048077,22048048:pet_fonce:4230:22048696,22048049:pet_fonce:4230:22048915,22054350:pet_fonce:4230:22056388,22054354:pet_fonce:4230:22056258,22054355:pet_fonce:4230:22056291,22054420:pet_fonce:4230:22056607,22054421:pet_fonce:4230:22056469,22054422:pet_fonce:4230:22056507,22054423:pet_fonce:4230:22055330,22054424:pet_fonce:4230:22055877,2'}, {'unwanted_material': 'refus', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.8336118956875427, 'nb_photo': 965, 'list_port_cont': '22346191', 'assoc_port': '22345824:22346191', 'assoc_mat': '22345824:refus:4230:22346191'}), 'main_stat': {'nb_photos': 20121}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_04_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'truck': {'autre': ['autre', '4.02%', 332128], 'carton': ['carton', '3.4%', 384239], 'metal': ['metal', '0.99%', 17543], 'papier': ['papier', '12.63%', 1040437], 'pehd': ['pehd', '0.14%', 7193], 'pet_clair': ['pet_clair', '0.92%', 143910], 'pet_fonce': ['pet_fonce', '0.23%', 3357], 'refus': ['refus', '83.36%', 965]}} before organize_and_plot_coverage_data before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_04_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/dechet_Valcor_v2 3.03user 2.05system 0:24.18elapsed 21%CPU (0avgtext+0avgdata 193324maxresident)k 240inputs+552outputs (1major+75740minor)pagefaults 0swaps