python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20084 --dashboard_places=dechet_Valcor_v2 --rootfolder_sla=/data_2/data_log/job/memo/dechet_Valcor_v2 -v --mtr_id=1055 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20084, Date : 2025-02 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 132 month : 02 mtr_id : 1055 dashboard_places : dechet_Valcor_v2 date : 2025-02 year : 2025 raspi : 20084 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'dechet_Valcor_v2' and date like '%2025-02%') and created_at like '%2025-02%'))); nb_day : (5, 28) after unwanted_material_data nb_day : (5, 28) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20084%' AND ms.result_str like '%2025/02%'ORDER BY ms.id desc LIMIT 0, 1000000; No error ? {'log_dict': {'total_nb_images': 8543, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83380 seconds', 'coverage_times_pause': '0 days 85679 seconds', 'nb_photos_decision': 8555, 'nb_gray_level_ok': 8551, 'nb_dedup_ok': 5255, 'nb_two_criteria_ok': 5251, 'nb_forced_upload': 0, 'end_of_day_photos_dark': 4, 'end_of_day_photos_duplicated': 3294, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 11, 'end_of_day_photos_uploaded': 5233, 'ratio_coverage': 0.9650574659428929}, 'dashboard_dict': {'nb_ptf_finished': 27, 'nb_images_finished': 145, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 145, 'last_update': '2025/02/16', 'portfolio_id': 20581809, 'last_run_id': 1614363, 'total_number_of_photos': 5295}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83429 seconds', 'coverage_times_pause': '0 days 85506 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7085, 'nb_two_criteria_ok': 7085, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1451, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 7070, 'ratio_coverage': 0.9656246021365988}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 324, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 27, 'nb_images_started': 102, 'nb_selected_images': 426, 'last_update': '2025/02/15', 'portfolio_id': 20537173, 'last_run_id': 1613534, 'total_number_of_photos': 7206}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85505 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 6922, 'nb_two_criteria_ok': 6922, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1616, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 6907, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 177, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 177, 'last_update': '2025/02/15', 'portfolio_id': 20496067, 'last_run_id': 1613692, 'total_number_of_photos': 7022}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82997 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6788, 'nb_two_criteria_ok': 6788, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 10, 'end_of_day_photos_uploaded': 6759, 'ratio_coverage': 0.9606245442655587}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 174, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 174, 'last_update': '2025/02/14', 'portfolio_id': 20466809, 'last_run_id': 1610844, 'total_number_of_photos': 6896}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83048 seconds', 'coverage_times_pause': '0 days 85386 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 6985, 'nb_two_criteria_ok': 6985, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1529, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 7, 'end_of_day_photos_uploaded': 6971, 'ratio_coverage': 0.9612148288753342}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 291, 'last_update': '2025/02/13', 'portfolio_id': 20426313, 'last_run_id': 1607815, 'total_number_of_photos': 7111}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 255, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 18, 'nb_selected_images': 273, 'last_update': '2025/02/13', 'portfolio_id': 20384981, 'last_run_id': 1604880, 'total_number_of_photos': 7715}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/11', 'portfolio_id': 20370864, 'last_run_id': 1601956, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83429 seconds', 'coverage_times_pause': '0 days 85506 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7085, 'nb_two_criteria_ok': 7085, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1451, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 4, 'end_of_day_photos_uploaded': 7070, 'ratio_coverage': 0.9656246021365988}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 324, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 27, 'nb_images_started': 102, 'nb_selected_images': 426, 'last_update': '2025/02/15', 'portfolio_id': 20537173, 'last_run_id': 1613534, 'total_number_of_photos': 7200}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85505 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 6922, 'nb_two_criteria_ok': 6922, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1616, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 6907, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 143, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 34, 'nb_selected_images': 177, 'last_update': '2025/02/14', 'portfolio_id': 20496067, 'last_run_id': 1610505, 'total_number_of_photos': 7022}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82997 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6788, 'nb_two_criteria_ok': 6788, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 10, 'end_of_day_photos_uploaded': 6759, 'ratio_coverage': 0.9606245442655587}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 174, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 174, 'last_update': '2025/02/14', 'portfolio_id': 20466809, 'last_run_id': 1610844, 'total_number_of_photos': 6896}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83048 seconds', 'coverage_times_pause': '0 days 85386 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 6985, 'nb_two_criteria_ok': 6985, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1529, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 7, 'end_of_day_photos_uploaded': 6971, 'ratio_coverage': 0.9612148288753342}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 291, 'last_update': '2025/02/13', 'portfolio_id': 20426313, 'last_run_id': 1607815, 'total_number_of_photos': 7111}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 255, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 18, 'nb_selected_images': 273, 'last_update': '2025/02/13', 'portfolio_id': 20384981, 'last_run_id': 1604880, 'total_number_of_photos': 7715}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/11', 'portfolio_id': 20370864, 'last_run_id': 1601956, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 294, 'nb_selected_images': 567, 'last_update': '2025/02/13', 'portfolio_id': 20355919, 'last_run_id': 1598985, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83578 seconds', 'coverage_times_pause': '0 days 85505 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 6922, 'nb_two_criteria_ok': 6922, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1616, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 2, 'end_of_day_photos_uploaded': 6907, 'ratio_coverage': 0.9673491591337863}, 'dashboard_dict': {'nb_ptf_finished': 35, 'nb_images_finished': 143, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 4, 'nb_images_started': 34, 'nb_selected_images': 177, 'last_update': '2025/02/14', 'portfolio_id': 20496067, 'last_run_id': 1610505, 'total_number_of_photos': 7017}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82997 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6788, 'nb_two_criteria_ok': 6788, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 10, 'end_of_day_photos_uploaded': 6759, 'ratio_coverage': 0.9606245442655587}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 174, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 174, 'last_update': '2025/02/13', 'portfolio_id': 20466809, 'last_run_id': 1607502, 'total_number_of_photos': 6896}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83048 seconds', 'coverage_times_pause': '0 days 85386 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 6985, 'nb_two_criteria_ok': 6985, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1529, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 7, 'end_of_day_photos_uploaded': 6971, 'ratio_coverage': 0.9612148288753342}, 'dashboard_dict': {'nb_ptf_finished': 51, 'nb_images_finished': 291, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 291, 'last_update': '2025/02/13', 'portfolio_id': 20426313, 'last_run_id': 1607815, 'total_number_of_photos': 7111}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 255, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 18, 'nb_selected_images': 273, 'last_update': '2025/02/13', 'portfolio_id': 20384981, 'last_run_id': 1604880, 'total_number_of_photos': 7715}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/11', 'portfolio_id': 20370864, 'last_run_id': 1601956, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 294, 'nb_selected_images': 567, 'last_update': '2025/02/13', 'portfolio_id': 20355919, 'last_run_id': 1598985, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 66, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 156, 'nb_selected_images': 222, 'last_update': '2025/02/12', 'portfolio_id': 20317747, 'last_run_id': 1598996, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82997 seconds', 'coverage_times_pause': '0 days 85502 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6788, 'nb_two_criteria_ok': 6788, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1756, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 10, 'end_of_day_photos_uploaded': 6759, 'ratio_coverage': 0.9606245442655587}, 'dashboard_dict': {'nb_ptf_finished': 44, 'nb_images_finished': 174, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 174, 'last_update': '2025/02/13', 'portfolio_id': 20466809, 'last_run_id': 1607502, 'total_number_of_photos': 6889}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83048 seconds', 'coverage_times_pause': '0 days 85386 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 6985, 'nb_two_criteria_ok': 6985, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1529, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 7, 'end_of_day_photos_uploaded': 6971, 'ratio_coverage': 0.9612148288753342}, 'dashboard_dict': {'nb_ptf_finished': 22, 'nb_images_finished': 98, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 29, 'nb_images_started': 193, 'nb_selected_images': 291, 'last_update': '2025/02/13', 'portfolio_id': 20426313, 'last_run_id': 1604648, 'total_number_of_photos': 7111}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 63, 'nb_images_finished': 255, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 6, 'nb_images_started': 18, 'nb_selected_images': 273, 'last_update': '2025/02/12', 'portfolio_id': 20384981, 'last_run_id': 1604880, 'total_number_of_photos': 7715}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/11', 'portfolio_id': 20370864, 'last_run_id': 1601956, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 294, 'nb_selected_images': 567, 'last_update': '2025/02/12', 'portfolio_id': 20355919, 'last_run_id': 1598985, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 66, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 156, 'nb_selected_images': 222, 'last_update': '2025/02/12', 'portfolio_id': 20317747, 'last_run_id': 1598996, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 113, 'nb_images_finished': 859, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 50, 'nb_selected_images': 909, 'last_update': '2025/02/12', 'portfolio_id': 20283554, 'last_run_id': 1599004, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83048 seconds', 'coverage_times_pause': '0 days 85386 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 6985, 'nb_two_criteria_ok': 6985, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1529, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 7, 'end_of_day_photos_uploaded': 6971, 'ratio_coverage': 0.9612148288753342}, 'dashboard_dict': {'nb_ptf_finished': 22, 'nb_images_finished': 98, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 29, 'nb_images_started': 193, 'nb_selected_images': 291, 'last_update': '2025/02/12', 'portfolio_id': 20426313, 'last_run_id': 1604648, 'total_number_of_photos': 7098}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 157, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 116, 'nb_selected_images': 273, 'last_update': '2025/02/12', 'portfolio_id': 20384981, 'last_run_id': 1601642, 'total_number_of_photos': 7715}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/11', 'portfolio_id': 20370864, 'last_run_id': 1601956, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 294, 'nb_selected_images': 567, 'last_update': '2025/02/11', 'portfolio_id': 20355919, 'last_run_id': 1598985, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 66, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 156, 'nb_selected_images': 222, 'last_update': '2025/02/11', 'portfolio_id': 20317747, 'last_run_id': 1598996, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 113, 'nb_images_finished': 859, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 50, 'nb_selected_images': 909, 'last_update': '2025/02/11', 'portfolio_id': 20283554, 'last_run_id': 1599004, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 222, 'nb_images_finished': 1235, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 98, 'nb_selected_images': 1333, 'last_update': '2025/02/11', 'portfolio_id': 20238989, 'last_run_id': 1599013, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83273 seconds', 'coverage_times_pause': '0 days 85448 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7607, 'nb_two_criteria_ok': 7607, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 925, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 214, 'end_of_day_photos_uploaded': 7380, 'ratio_coverage': 0.9638190256831676}, 'dashboard_dict': {'nb_ptf_finished': 29, 'nb_images_finished': 157, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 40, 'nb_images_started': 116, 'nb_selected_images': 273, 'last_update': '2025/02/11', 'portfolio_id': 20384981, 'last_run_id': 1601642, 'total_number_of_photos': 7708}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/10', 'portfolio_id': 20370864, 'last_run_id': 1598112, 'total_number_of_photos': 6924}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 53, 'nb_images_finished': 273, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 294, 'nb_selected_images': 567, 'last_update': '2025/02/10', 'portfolio_id': 20355919, 'last_run_id': 1598985, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 16, 'nb_images_finished': 66, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 32, 'nb_images_started': 156, 'nb_selected_images': 222, 'last_update': '2025/02/11', 'portfolio_id': 20317747, 'last_run_id': 1598996, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 113, 'nb_images_finished': 859, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 3, 'nb_images_started': 50, 'nb_selected_images': 909, 'last_update': '2025/02/10', 'portfolio_id': 20283554, 'last_run_id': 1599004, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 222, 'nb_images_finished': 1235, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 19, 'nb_images_started': 98, 'nb_selected_images': 1333, 'last_update': '2025/02/10', 'portfolio_id': 20238989, 'last_run_id': 1599013, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 279, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 94, 'nb_images_started': 812, 'nb_selected_images': 1091, 'last_update': '2025/02/11', 'portfolio_id': 20197575, 'last_run_id': 1590216, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8526, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82845 seconds', 'coverage_times_pause': '0 days 85510 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 6850, 'nb_two_criteria_ok': 6850, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1692, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 6, 'end_of_day_photos_uploaded': 6827, 'ratio_coverage': 0.9588652646442667}, 'dashboard_dict': {'nb_ptf_finished': 0, 'nb_images_finished': 0, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 0, 'nb_images_started': 0, 'nb_selected_images': 0, 'last_update': '2025/02/10', 'portfolio_id': 20370864, 'last_run_id': 1598112, 'total_number_of_photos': 6917}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 98, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 219, 'nb_selected_images': 317, 'last_update': '2025/02/10', 'portfolio_id': 20355919, 'last_run_id': 1597409, 'total_number_of_photos': 7359}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 17, 'nb_images_finished': 70, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 30, 'nb_images_started': 149, 'nb_selected_images': 219, 'last_update': '2025/02/08', 'portfolio_id': 20317747, 'last_run_id': 1595962, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 240, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 86, 'nb_images_started': 669, 'nb_selected_images': 909, 'last_update': '2025/02/10', 'portfolio_id': 20283554, 'last_run_id': 1592755, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 312, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 203, 'nb_images_started': 1021, 'nb_selected_images': 1333, 'last_update': '2025/02/09', 'portfolio_id': 20238989, 'last_run_id': 1589829, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 279, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 94, 'nb_images_started': 812, 'nb_selected_images': 1091, 'last_update': '2025/02/10', 'portfolio_id': 20197575, 'last_run_id': 1590216, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 131, 'nb_images_started': 907, 'nb_selected_images': 1235, 'last_update': '2025/02/07', 'portfolio_id': 20165885, 'last_run_id': 1590227, 'total_number_of_photos': 7747}} No error ? {'log_dict': {'total_nb_images': 8532, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83174 seconds', 'coverage_times_pause': '0 days 85568 seconds', 'nb_photos_decision': 8544, 'nb_gray_level_ok': 8544, 'nb_dedup_ok': 7235, 'nb_two_criteria_ok': 7235, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1305, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_uploaded': 7220, 'ratio_coverage': 0.9626731790877209}, 'dashboard_dict': {'nb_ptf_finished': 25, 'nb_images_finished': 98, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 31, 'nb_images_started': 219, 'nb_selected_images': 317, 'last_update': '2025/02/09', 'portfolio_id': 20355919, 'last_run_id': 1597409, 'total_number_of_photos': 7340}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 17, 'nb_images_finished': 70, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 30, 'nb_images_started': 149, 'nb_selected_images': 219, 'last_update': '2025/02/08', 'portfolio_id': 20317747, 'last_run_id': 1595962, 'total_number_of_photos': 7318}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 240, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 86, 'nb_images_started': 669, 'nb_selected_images': 909, 'last_update': '2025/02/07', 'portfolio_id': 20283554, 'last_run_id': 1592755, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 312, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 203, 'nb_images_started': 1021, 'nb_selected_images': 1333, 'last_update': '2025/02/09', 'portfolio_id': 20238989, 'last_run_id': 1589829, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 279, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 94, 'nb_images_started': 812, 'nb_selected_images': 1091, 'last_update': '2025/02/08', 'portfolio_id': 20197575, 'last_run_id': 1590216, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 131, 'nb_images_started': 907, 'nb_selected_images': 1235, 'last_update': '2025/02/07', 'portfolio_id': 20165885, 'last_run_id': 1590227, 'total_number_of_photos': 7747}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 265, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 19, 'nb_selected_images': 284, 'last_update': '2025/02/06', 'portfolio_id': 20149401, 'last_run_id': 1583728, 'total_number_of_photos': 7675}} No error ? {'log_dict': {'total_nb_images': 8508, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83106 seconds', 'coverage_times_pause': '0 days 85305 seconds', 'nb_photos_decision': 8514, 'nb_gray_level_ok': 8514, 'nb_dedup_ok': 7189, 'nb_two_criteria_ok': 7189, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1325, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 90, 'end_of_day_photos_uploaded': 7086, 'ratio_coverage': 0.9618861329413535}, 'dashboard_dict': {'nb_ptf_finished': 17, 'nb_images_finished': 70, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 30, 'nb_images_started': 149, 'nb_selected_images': 219, 'last_update': '2025/02/08', 'portfolio_id': 20317747, 'last_run_id': 1595962, 'total_number_of_photos': 7308}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 240, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 86, 'nb_images_started': 669, 'nb_selected_images': 909, 'last_update': '2025/02/07', 'portfolio_id': 20283554, 'last_run_id': 1592755, 'total_number_of_photos': 7724}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 312, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 203, 'nb_images_started': 1021, 'nb_selected_images': 1333, 'last_update': '2025/02/06', 'portfolio_id': 20238989, 'last_run_id': 1589829, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 279, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 94, 'nb_images_started': 812, 'nb_selected_images': 1091, 'last_update': '2025/02/08', 'portfolio_id': 20197575, 'last_run_id': 1590216, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 131, 'nb_images_started': 907, 'nb_selected_images': 1235, 'last_update': '2025/02/07', 'portfolio_id': 20165885, 'last_run_id': 1590227, 'total_number_of_photos': 7747}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 265, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 19, 'nb_selected_images': 284, 'last_update': '2025/02/06', 'portfolio_id': 20149401, 'last_run_id': 1583728, 'total_number_of_photos': 7675}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83149 seconds', 'coverage_times_pause': '0 days 85401 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 137, 'end_of_day_photos_uploaded': 7344, 'ratio_coverage': 0.9623838238868505}, 'dashboard_dict': {'nb_ptf_finished': 111, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 75, 'nb_images_started': 536, 'nb_selected_images': 1263, 'last_update': '2025/02/06', 'portfolio_id': 20133372, 'last_run_id': 1580638, 'total_number_of_photos': 7607}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8538, 'nb_gray_level_ok': 8538, 'nb_dedup_ok': 7614, 'nb_two_criteria_ok': 7614, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 30, 'nb_images_finished': 240, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 86, 'nb_images_started': 669, 'nb_selected_images': 909, 'last_update': '2025/02/07', 'portfolio_id': 20283554, 'last_run_id': 1592755, 'total_number_of_photos': 7717}} No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 312, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 203, 'nb_images_started': 1021, 'nb_selected_images': 1333, 'last_update': '2025/02/06', 'portfolio_id': 20238989, 'last_run_id': 1589829, 'total_number_of_photos': 7880}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 279, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 94, 'nb_images_started': 812, 'nb_selected_images': 1091, 'last_update': '2025/02/06', 'portfolio_id': 20197575, 'last_run_id': 1590216, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 50, 'nb_images_finished': 328, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 131, 'nb_images_started': 907, 'nb_selected_images': 1235, 'last_update': '2025/02/07', 'portfolio_id': 20165885, 'last_run_id': 1590227, 'total_number_of_photos': 7747}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 265, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 19, 'nb_selected_images': 284, 'last_update': '2025/02/06', 'portfolio_id': 20149401, 'last_run_id': 1583728, 'total_number_of_photos': 7675}} No error ? {'log_dict': {'total_nb_images': 0, 'max_time_between_images': '0 days 0 seconds', 'coverage_pause': '0 days 0 seconds', 'coverage_times_pause': '0 days 0 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'ratio_coverage': 0.0}, 'dashboard_dict': {'nb_ptf_finished': 111, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 75, 'nb_images_started': 536, 'nb_selected_images': 1263, 'last_update': '2025/02/06', 'portfolio_id': 20133372, 'last_run_id': 1580638, 'total_number_of_photos': 7607}} Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8537, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 83091 seconds', 'coverage_times_pause': '0 days 85608 seconds', 'nb_photos_decision': 8549, 'nb_gray_level_ok': 8549, 'nb_dedup_ok': 7778, 'nb_two_criteria_ok': 7778, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 770, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 380, 'end_of_day_photos_uploaded': 7386, 'ratio_coverage': 0.9617125198208313}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 312, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 203, 'nb_images_started': 1021, 'nb_selected_images': 1333, 'last_update': '2025/02/06', 'portfolio_id': 20238989, 'last_run_id': 1589829, 'total_number_of_photos': 7874}} No error ? {'log_dict': {'total_nb_images': 8544, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83565 seconds', 'coverage_times_pause': '0 days 85659 seconds', 'nb_photos_decision': 8550, 'nb_gray_level_ok': 8550, 'nb_dedup_ok': 7786, 'nb_two_criteria_ok': 7786, 'nb_forced_upload': 0, 'end_of_day_photos_no_longer_on_disk': 12, 'end_of_day_photos_duplicated': 764, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 459, 'end_of_day_photos_uploaded': 7308, 'ratio_coverage': 0.9671986944293337}, 'dashboard_dict': {'nb_ptf_finished': 23, 'nb_images_finished': 250, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 81, 'nb_images_started': 724, 'nb_selected_images': 974, 'last_update': '2025/02/05', 'portfolio_id': 20197575, 'last_run_id': 1586439, 'total_number_of_photos': 7899}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 142, 'nb_images_started': 937, 'nb_selected_images': 1235, 'last_update': '2025/02/04', 'portfolio_id': 20165885, 'last_run_id': 1583243, 'total_number_of_photos': 7747}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 38, 'nb_images_finished': 265, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 5, 'nb_images_started': 19, 'nb_selected_images': 284, 'last_update': '2025/02/04', 'portfolio_id': 20149401, 'last_run_id': 1583728, 'total_number_of_photos': 7675}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83149 seconds', 'coverage_times_pause': '0 days 85401 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 137, 'end_of_day_photos_uploaded': 7344, 'ratio_coverage': 0.9623838238868505}, 'dashboard_dict': {'nb_ptf_finished': 111, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 75, 'nb_images_started': 536, 'nb_selected_images': 1263, 'last_update': '2025/02/06', 'portfolio_id': 20133372, 'last_run_id': 1580638, 'total_number_of_photos': 7607}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83187 seconds', 'coverage_times_pause': '0 days 85389 seconds', 'nb_photos_decision': 8526, 'nb_gray_level_ok': 8526, 'nb_dedup_ok': 7615, 'nb_two_criteria_ok': 7615, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 911, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 606, 'end_of_day_photos_uploaded': 6990, 'ratio_coverage': 0.9628236437921736}, 'dashboard_dict': {'nb_ptf_finished': 39, 'nb_images_finished': 298, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 142, 'nb_images_started': 937, 'nb_selected_images': 1235, 'last_update': '2025/02/04', 'portfolio_id': 20165885, 'last_run_id': 1583243, 'total_number_of_photos': 7740}} No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 221, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 63, 'nb_selected_images': 284, 'last_update': '2025/02/03', 'portfolio_id': 20149401, 'last_run_id': 1580412, 'total_number_of_photos': 7675}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83149 seconds', 'coverage_times_pause': '0 days 85401 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 137, 'end_of_day_photos_uploaded': 7344, 'ratio_coverage': 0.9623838238868505}, 'dashboard_dict': {'nb_ptf_finished': 111, 'nb_images_finished': 727, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 75, 'nb_images_started': 536, 'nb_selected_images': 1263, 'last_update': '2025/02/03', 'portfolio_id': 20133372, 'last_run_id': 1580638, 'total_number_of_photos': 7607}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8514, 'max_time_between_images': '0 days 81 seconds', 'coverage_pause': '0 days 82548 seconds', 'coverage_times_pause': '0 days 85394 seconds', 'nb_photos_decision': 8520, 'nb_gray_level_ok': 8520, 'nb_dedup_ok': 7566, 'nb_two_criteria_ok': 7566, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 953, 'end_of_day_photos_nothing_done': 7, 'end_of_day_photos_ok_for_neural_classification': 72, 'end_of_day_photos_uploaded': 7482, 'ratio_coverage': 0.9554277248579266}, 'dashboard_dict': {'nb_ptf_finished': 31, 'nb_images_finished': 221, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 12, 'nb_images_started': 63, 'nb_selected_images': 284, 'last_update': '2025/02/03', 'portfolio_id': 20149401, 'last_run_id': 1580412, 'total_number_of_photos': 7662}} No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83149 seconds', 'coverage_times_pause': '0 days 85401 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 137, 'end_of_day_photos_uploaded': 7344, 'ratio_coverage': 0.9623838238868505}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 87, 'nb_images_started': 648, 'nb_selected_images': 1263, 'last_update': '2025/02/02', 'portfolio_id': 20133372, 'last_run_id': 1579583, 'total_number_of_photos': 7607}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! No error ? {'log_dict': {'total_nb_images': 8520, 'max_time_between_images': '0 days 80 seconds', 'coverage_pause': '0 days 83149 seconds', 'coverage_times_pause': '0 days 85401 seconds', 'nb_photos_decision': 8532, 'nb_gray_level_ok': 8532, 'nb_dedup_ok': 7493, 'nb_two_criteria_ok': 7493, 'nb_forced_upload': 0, 'end_of_day_photos_duplicated': 1038, 'end_of_day_photos_nothing_done': 1, 'end_of_day_photos_ok_for_neural_classification': 137, 'end_of_day_photos_uploaded': 7344, 'ratio_coverage': 0.9623838238868505}, 'dashboard_dict': {'nb_ptf_finished': 99, 'nb_images_finished': 615, 'nb_ptf_finished_for_older': 0, 'nb_images_finished_for_older': 0, 'nb_ptf_started': 87, 'nb_images_started': 648, 'nb_selected_images': 1263, 'last_update': '2025/02/02', 'portfolio_id': 20133372, 'last_run_id': 1579583, 'total_number_of_photos': 7601}} Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Since we don't have condition on date we need to verify this lately ! Found day : 2025-02-15 00:00:00 Found day : 2025-02-14 00:00:00 Found day : 2025-02-13 00:00:00 Found day : 2025-02-12 00:00:00 Found day : 2025-02-11 00:00:00 Found day : 2025-02-10 00:00:00 Found day : 2025-02-09 00:00:00 Found day : 2025-02-08 00:00:00 Found day : 2025-02-07 00:00:00 Found day : 2025-02-06 00:00:00 Found day : 2025-02-05 00:00:00 Found day : 2025-02-04 00:00:00 Found day : 2025-02-03 00:00:00 Found day : 2025-02-02 00:00:00 Found day : 2025-02-01 00:00:00 Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-02-16 00:00:00,2025-02-17 00:00:00,2025-02-18 00:00:00,2025-02-19 00:00:00,2025-02-20 00:00:00,2025-02-21 00:00:00,2025-02-22 00:00:00,2025-02-23 00:00:00,2025-02-24 00:00:00,2025-02-25 00:00:00,2025-02-26 00:00:00,2025-02-27 00:00:00,2025-02-28 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 132 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______truck' and ded.dashboard_place_id = 132 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 132 and mp.name like '%022025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-02-01 : dt_date_just_month_year : 2025-02-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "dechet_Valcor_v2" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-02-01" AND ded.date <= "2025-02-28" apple3 {'test': {'mat': 'test', 'pht': 0, 'datou_carac_id': 370, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 538914404}, 'truck': {'mat': 'truck', 'pht': 4230, 'datou_carac_id': 4234, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'refus'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1580638,1583728,1590227,1590216,1599013,1599004,1598996,1598985,1601956,1604880,1607815,1610844,1613692,1614384,1614363) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id AND ptp.type IN (0,4230) group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06699575400215528, 'nb_photo': 111368, 'list_port_cont': '20140918,20140953,20141037,20141226,20141407,20141731,20141850,20142142,20142310,20142503,20142544,20142645,20142829,20142953,20143113,20143265,20143438,20143498,20143532,20143661,20143753,20143842,20143887,20143933,20143963,20144078,20144109,20144147,20144266,20144385,20144456,20144578,20144702,20144796,20144847,20144925,20144995,20145094,20145229,20145334,20145376,20145460,20145576,20145700,20145836,20145945,20145992,20146094,20146220,20146356,20146510,20146550,20146650,20146842,20146880,20147031,20147097,20147144,20147181,20147214,20147259,20147284,20147320,20147472,20147553,20147586,20147634,20147677,20147732,20147839,20147915,20147947,20147985,20148089,20148143,20148256,20148356,20148393,20148507,20148547,20148610,20148727,20148799,20148887,20148929,20148971,20149027,20149073,20149107,20149234,20149292,20149320,20149367,20149563,20149646,20149705,20149767,20149904,20149985,20150080,20150116,20150230,20150340,20150420,20150460,20150510,20150661,20150817,20150894,20150927,20151013,20162787,20162862,2016291', 'assoc_port': '20140596:20256813,20140597:20257030,20140598:20257198,20140599:20257273,20140600:20257421,20140602:20141037,20140603:20140918,20140832:20257735,20140833:20257775,20140835:20258168,20140836:20258254,20140837:20435780,20140839:20259157,20140840:20259057,20140841:20259115,20140842:20362988,20140843:20259666,20140844:20260537,20140845:20260144,20140846:20260480,20140847:20260651,20140848:20260856,20140849:20363623,20140850:20141407,20140851:20140953,20140852:20141226,20141296:20261889,20141297:20262215,20141298:20261832,20141299:20261773,20141300:20262176,20141301:20363531,20141302:20141731,20141657:20263090,20141658:20262856,20141659:20263260,20141660:20263480,20141661:20263784,20141662:20264172,20141663:20264241,20141664:20264498,20141665:20264548,20141666:20264803,20141667:20264885,20141668:20371198,20141669:20265230,20141670:20265468,20141671:20265816,20141672:20266157,20141673:20266136,20141674:20266318,20141675:20266424,20141676:20266608,20141677:20266712,20141678:20372241,20141679:20266931,20141680:2014214', 'assoc_mat': '20140596:autre:4230:20256813,20140597:autre:4230:20257030,20140598:autre:4230:20257198,20140599:autre:4230:20257273,20140600:autre:4230:20257421,20140602:autre:4230:20141037,20140603:autre:4230:20140918,20140832:autre:4230:20257735,20140833:autre:4230:20257775,20140835:autre:4230:20258168,20140836:autre:4230:20258254,20140837:autre:4230:20435780,20140839:autre:4230:20259157,20140840:autre:4230:20259057,20140841:autre:4230:20259115,20140842:autre:4230:20362988,20140843:autre:4230:20259666,20140844:autre:4230:20260537,20140845:autre:4230:20260144,20140846:autre:4230:20260480,20140847:autre:4230:20260651,20140848:autre:4230:20260856,20140849:autre:4230:20363623,20140850:autre:4230:20141407,20140851:autre:4230:20140953,20140852:autre:4230:20141226,20141296:autre:4230:20261889,20141297:autre:4230:20262215,20141298:autre:4230:20261832,20141299:autre:4230:20261773,20141300:autre:4230:20262176,20141301:autre:4230:20363531,20141302:autre:4230:20141731,20141657:autre:4230:20263090,20141658:autre:4230:20262856,20141659:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.030385603058127545, 'nb_photo': 113606, 'list_port_cont': '20140912,20140958,20141033,20141230,20141419,20141737,20141858,20142146,20142317,20142496,20142551,20142644,20142841,20142951,20143111,20143257,20143451,20143501,20143541,20143678,20143760,20143836,20143884,20143937,20143976,20144083,20144119,20144155,20144275,20144398,20144447,20144567,20144697,20144789,20144858,20144932,20145003,20145091,20145236,20145328,20145389,20145458,20145568,20145710,20145847,20145947,20145984,20146088,20146231,20146369,20146506,20146566,20146657,20146841,20146873,20147034,20147105,20147145,20147172,20147215,20147256,20147298,20147334,20147476,20147560,20147592,20147645,20147683,20147728,20147843,20147909,20147948,20147991,20148099,20148142,20148250,20148365,20148400,20148512,20148539,20148626,20148729,20148804,20148891,20148926,20148960,20149033,20149074,20149102,20149235,20149290,20149328,20149376,20149562,20149645,20149706,20149759,20149903,20149981,20150075,20150110,20150220,20150352,20150430,20150472,20150508,20150656,20150815,20150890,20150930,20151011,20162792,20162866,2016291', 'assoc_port': '20140596:20256816,20140597:20257046,20140598:20257205,20140599:20257285,20140600:20257423,20140602:20141033,20140603:20140912,20140832:20257730,20140833:20257770,20140835:20258175,20140836:20258253,20140837:20435789,20140839:20259168,20140840:20259067,20140841:20259130,20140842:20363003,20140843:20259657,20140844:20260550,20140845:20260142,20140846:20260485,20140847:20260649,20140848:20260846,20140849:20363618,20140850:20141419,20140851:20140958,20140852:20141230,20141296:20261898,20141297:20262212,20141298:20261836,20141299:20261788,20141300:20262165,20141301:20363535,20141302:20141737,20141657:20263091,20141658:20262866,20141659:20263269,20141660:20263484,20141661:20263795,20141662:20264179,20141663:20264252,20141664:20264507,20141665:20264535,20141666:20264808,20141667:20264877,20141668:20371221,20141669:20265226,20141670:20265481,20141671:20265829,20141672:20266169,20141673:20266130,20141674:20266319,20141675:20266414,20141676:20266616,20141677:20266706,20141678:20372251,20141679:20266936,20141680:2014214', 'assoc_mat': '20140596:carton:4230:20256816,20140597:carton:4230:20257046,20140598:carton:4230:20257205,20140599:carton:4230:20257285,20140600:carton:4230:20257423,20140602:carton:4230:20141033,20140603:carton:4230:20140912,20140832:carton:4230:20257730,20140833:carton:4230:20257770,20140835:carton:4230:20258175,20140836:carton:4230:20258253,20140837:carton:4230:20435789,20140839:carton:4230:20259168,20140840:carton:4230:20259067,20140841:carton:4230:20259130,20140842:carton:4230:20363003,20140843:carton:4230:20259657,20140844:carton:4230:20260550,20140845:carton:4230:20260142,20140846:carton:4230:20260485,20140847:carton:4230:20260649,20140848:carton:4230:20260846,20140849:carton:4230:20363618,20140850:carton:4230:20141419,20140851:carton:4230:20140958,20140852:carton:4230:20141230,20141296:carton:4230:20261898,20141297:carton:4230:20262212,20141298:carton:4230:20261836,20141299:carton:4230:20261788,20141300:carton:4230:20262165,20141301:carton:4230:20363535,20141302:carton:4230:20141737,20141657:carton:4230:20263091,2014'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004915529001885848, 'nb_photo': 4056, 'list_port_cont': '20140923,20140959,20141032,20141235,20141405,20141736,20141856,20142147,20142308,20142537,20143109,20143258,20143453,20143491,20143535,20143669,20143745,20143839,20143878,20143935,20143972,20144077,20144124,20144151,20144278,20144399,20144449,20144576,20144689,20144792,20144863,20144931,20144990,20145095,20145223,20145336,20145373,20145454,20145575,20145695,20145845,20145954,20145983,20146089,20146219,20146367,20146508,20146567,20146646,20146831,20146877,20147036,20147107,20147138,20147180,20147205,20147255,20147289,20147325,20147469,20147549,20147591,20147643,20147684,20147724,20147837,20147906,20147943,20148084,20148138,20148258,20148406,20148516,20148613,20148737,20148800,20148888,20148933,20148965,20149024,20149062,20149224,20149293,20149312,20149368,20149559,20149639,20149762,20149890,20149986,20150076,20150105,20150217,20150350,20150469,20150500,20150827,20150901,20150924,20151012,20162798,20162875,20162974,20163058,20163313,20163419,20163766,20163905,20164051,20164908,20165676,20165824,20166235,2016752', 'assoc_port': '20140596:20256807,20140597:20257044,20140599:20257280,20140600:20257418,20140602:20141032,20140603:20140923,20140832:20257732,20140833:20257768,20140835:20258163,20140837:20435791,20140839:20259158,20140840:20259053,20140841:20259124,20140843:20259663,20140844:20260541,20140845:20260135,20140846:20260484,20140847:20260650,20140848:20260849,20140849:20363621,20140850:20141405,20140851:20140959,20140852:20141235,20141296:20261899,20141297:20262214,20141298:20261839,20141299:20261778,20141300:20262170,20141301:20363548,20141302:20141736,20141657:20263089,20141659:20263266,20141660:20263487,20141661:20263786,20141662:20264184,20141663:20264248,20141664:20264505,20141665:20264538,20141666:20264798,20141667:20264879,20141668:20371223,20141670:20265474,20141671:20265818,20141672:20266160,20141673:20266134,20141674:20266306,20141675:20266420,20141676:20266611,20141677:20266697,20141678:20372238,20141679:20266921,20141680:20142147,20141681:20141856,20142049:20267222,20142050:20267576,20142051:20267929,20142052:2026807', 'assoc_mat': '20140596:metal:4230:20256807,20140597:metal:4230:20257044,20140599:metal:4230:20257280,20140600:metal:4230:20257418,20140602:metal:4230:20141032,20140603:metal:4230:20140923,20140832:metal:4230:20257732,20140833:metal:4230:20257768,20140835:metal:4230:20258163,20140837:metal:4230:20435791,20140839:metal:4230:20259158,20140840:metal:4230:20259053,20140841:metal:4230:20259124,20140843:metal:4230:20259663,20140844:metal:4230:20260541,20140845:metal:4230:20260135,20140846:metal:4230:20260484,20140847:metal:4230:20260650,20140848:metal:4230:20260849,20140849:metal:4230:20363621,20140850:metal:4230:20141405,20140851:metal:4230:20140959,20140852:metal:4230:20141235,20141296:metal:4230:20261899,20141297:metal:4230:20262214,20141298:metal:4230:20261839,20141299:metal:4230:20261778,20141300:metal:4230:20262170,20141301:metal:4230:20363548,20141302:metal:4230:20141736,20141657:metal:4230:20263089,20141659:metal:4230:20263266,20141660:metal:4230:20263487,20141661:metal:4230:20263786,20141662:metal:4230:20264184,20141663:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10159311143251597, 'nb_photo': 305919, 'list_port_cont': '20140919,20140960,20141035,20141232,20141414,20141729,20141859,20142152,20142319,20142502,20142545,20142651,20142834,20142943,20143106,20143260,20143448,20143505,20143546,20143674,20143757,20143838,20143885,20143931,20143967,20144079,20144123,20144161,20144281,20144391,20144446,20144581,20144699,20144790,20144860,20144917,20145005,20145086,20145228,20145323,20145378,20145457,20145574,20145707,20145840,20145952,20145981,20146091,20146233,20146362,20146514,20146560,20146655,20146839,20146876,20147032,20147101,20147141,20147174,20147220,20147252,20147297,20147329,20147475,20147559,20147593,20147650,20147680,20147737,20147844,20147911,20147951,20147978,20148098,20148145,20148248,20148362,20148392,20148515,20148549,20148625,20148736,20148807,20148885,20148931,20148966,20149039,20149075,20149112,20149232,20149284,20149381,20149575,20149644,20149707,20149770,20149902,20149997,20150085,20150114,20150228,20150353,20150431,20150461,20150511,20150652,20150821,20150903,20150928,20151005,20162791,20162867,20162907,2016298', 'assoc_port': '20140596:20256809,20140597:20257040,20140598:20257202,20140599:20257286,20140600:20257424,20140602:20141035,20140603:20140919,20140832:20257733,20140833:20257774,20140835:20258173,20140836:20258255,20140837:20435794,20140839:20259169,20140840:20259064,20140841:20259129,20140842:20363000,20140843:20259671,20140844:20260545,20140845:20260141,20140846:20260488,20140847:20260652,20140848:20260841,20140849:20363610,20140850:20141414,20140851:20140960,20140852:20141232,20141296:20261897,20141297:20262204,20141298:20261837,20141299:20261783,20141300:20262178,20141301:20363541,20141302:20141729,20141657:20263098,20141658:20262864,20141659:20263267,20141660:20263494,20141661:20263797,20141662:20264181,20141663:20264254,20141664:20264508,20141665:20264547,20141666:20264805,20141667:20264888,20141668:20371222,20141669:20265231,20141670:20265475,20141671:20265830,20141672:20266164,20141673:20266129,20141674:20266315,20141675:20266418,20141676:20266613,20141677:20266713,20141678:20372246,20141679:20266938,20141680:2014215', 'assoc_mat': '20140596:papier:4230:20256809,20140597:papier:4230:20257040,20140598:papier:4230:20257202,20140599:papier:4230:20257286,20140600:papier:4230:20257424,20140602:papier:4230:20141035,20140603:papier:4230:20140919,20140832:papier:4230:20257733,20140833:papier:4230:20257774,20140835:papier:4230:20258173,20140836:papier:4230:20258255,20140837:papier:4230:20435794,20140839:papier:4230:20259169,20140840:papier:4230:20259064,20140841:papier:4230:20259129,20140842:papier:4230:20363000,20140843:papier:4230:20259671,20140844:papier:4230:20260545,20140845:papier:4230:20260141,20140846:papier:4230:20260488,20140847:papier:4230:20260652,20140848:papier:4230:20260841,20140849:papier:4230:20363610,20140850:papier:4230:20141414,20140851:papier:4230:20140960,20140852:papier:4230:20141232,20141296:papier:4230:20261897,20141297:papier:4230:20262204,20141298:papier:4230:20261837,20141299:papier:4230:20261783,20141300:papier:4230:20262178,20141301:papier:4230:20363541,20141302:papier:4230:20141729,20141657:papier:4230:20263098,2014'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.002278633600684754, 'nb_photo': 1489, 'list_port_cont': '20140925,20141031,20142550,20144113,20147029,20147109,20147250,20149291,20149377,20149631,20150078,20150470,20150506,20150653,20150816,20150938,20178866,20180384,20182608,20183637,20184614,20186419,20187142,20187609,20192864,20195378,20195573,20196117,20196313,20196528,20211329,20220117,20239893,20239935,20240706,20242205,20242285,20244346,20256815,20257036,20257586,20257736,20258179,20259166,20261895,20262210,20264185,20265831,20266581,20268689,20268922,20271192,20278144,20278193,20278301,20278751,20279405,20287665,20287726,20289115,20289763,20292761,20295368,20298068,20300346,20301695,20306759,20307606,20309281,20309647,20312457,20313466,20313677,20314024,20314164,20314292,20314513,20315166,20317878,20319598,20321438,20324226,20333551,20334151,20334444,20336454,20337270,20338767,20344199,20346953,20347089,20348333,20349323,20350228,20351335,20352379,20352444,20353460,20354037,20354251,20359098,20359159,20359294,20359350,20362088,20362406,20362627,20362860,20363130,20363539,20363689,20363850,20363976,2036458', 'assoc_port': '20140596:20256815,20140597:20257036,20140602:20141031,20140603:20140925,20140832:20257736,20140835:20258179,20140837:20435784,20140839:20259166,20141296:20261895,20141297:20262210,20141301:20363539,20141662:20264185,20141671:20265831,20142057:20268689,20142058:20268922,20142063:20373775,20142457:20150938,20142458:20150506,20142459:20150653,20142460:20150816,20142462:20150470,20142467:20142550,20142784:20150078,20142789:20149631,20142792:20149377,20142794:20149291,20143402:20147250,20143406:20147109,20143698:20147029,20143823:20144113,20162665:20292761,20178460:20180384,20178463:20182608,20178464:20178866,20182964:20183637,20182966:20184614,20185150:20187142,20185152:20186419,20187253:20407789,20187256:20319598,20187263:20187609,20190539:20192864,20195295:20196117,20195298:20195573,20195300:20195378,20196010:20196528,20196011:20196313,20210198:20352379,20210200:20352444,20210823:20353460,20210829:20211329,20211509:20354037,20215645:20354251,20216822:20220117,20236816:20359098,20236817:20359159,20236818:2035929', 'assoc_mat': '20140596:pehd:4230:20256815,20140597:pehd:4230:20257036,20140602:pehd:4230:20141031,20140603:pehd:4230:20140925,20140832:pehd:4230:20257736,20140835:pehd:4230:20258179,20140837:pehd:4230:20435784,20140839:pehd:4230:20259166,20141296:pehd:4230:20261895,20141297:pehd:4230:20262210,20141301:pehd:4230:20363539,20141662:pehd:4230:20264185,20141671:pehd:4230:20265831,20142057:pehd:4230:20268689,20142058:pehd:4230:20268922,20142063:pehd:4230:20373775,20142457:pehd:4230:20150938,20142458:pehd:4230:20150506,20142459:pehd:4230:20150653,20142460:pehd:4230:20150816,20142462:pehd:4230:20150470,20142467:pehd:4230:20142550,20142784:pehd:4230:20150078,20142789:pehd:4230:20149631,20142792:pehd:4230:20149377,20142794:pehd:4230:20149291,20143402:pehd:4230:20147250,20143406:pehd:4230:20147109,20143698:pehd:4230:20147029,20143823:pehd:4230:20144113,20162665:pehd:4230:20292761,20178460:pehd:4230:20180384,20178463:pehd:4230:20182608,20178464:pehd:4230:20178866,20182964:pehd:4230:20183637,20182966:pehd:4230:20184614,20185150:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009948184618746149, 'nb_photo': 39644, 'list_port_cont': '20140922,20140952,20141025,20141236,20141418,20141735,20141865,20142156,20142313,20142493,20142548,20142643,20142835,20142949,20143117,20143271,20143449,20143504,20143539,20143673,20143761,20143833,20143881,20143932,20143971,20144085,20144114,20144164,20144280,20144394,20144454,20144571,20144701,20144787,20144859,20144929,20144999,20145092,20145227,20145330,20145388,20145459,20145578,20145709,20145846,20145946,20145994,20146093,20146227,20146365,20146511,20146556,20146647,20146833,20146878,20147028,20147100,20147135,20147178,20147218,20147258,20147294,20147332,20147464,20147556,20147597,20147649,20147678,20147739,20147846,20147918,20147955,20147988,20148096,20148144,20148255,20148366,20148404,20148509,20148544,20148619,20148728,20148809,20148896,20148934,20148970,20149041,20149070,20149105,20149231,20149289,20149325,20149382,20149573,20149635,20149715,20149774,20149906,20149993,20150071,20150120,20150229,20150356,20150428,20150464,20150509,20150659,20150823,20150899,20150937,20151008,20162788,20162878,2016290', 'assoc_port': '20140596:20256808,20140597:20257047,20140598:20257207,20140599:20257278,20140600:20257417,20140602:20141025,20140603:20140922,20140832:20257738,20140833:20257771,20140835:20258170,20140836:20258245,20140837:20435796,20140839:20259159,20140840:20259069,20140841:20259132,20140842:20362997,20140843:20259667,20140844:20260553,20140845:20260146,20140846:20260491,20140847:20260659,20140848:20260857,20140849:20363612,20140850:20141418,20140851:20140952,20140852:20141236,20141296:20261890,20141297:20262201,20141298:20261835,20141299:20261774,20141300:20262171,20141301:20363540,20141302:20141735,20141657:20263096,20141658:20262865,20141659:20263276,20141660:20263483,20141661:20263796,20141662:20264182,20141663:20264249,20141664:20264497,20141665:20264537,20141666:20264797,20141667:20264882,20141668:20371212,20141669:20265221,20141670:20265477,20141671:20265826,20141672:20266161,20141673:20266135,20141674:20266317,20141675:20266425,20141676:20266618,20141677:20266711,20141678:20372255,20141679:20266935,20141680:2014215', 'assoc_mat': '20140596:pet_clair:4230:20256808,20140597:pet_clair:4230:20257047,20140598:pet_clair:4230:20257207,20140599:pet_clair:4230:20257278,20140600:pet_clair:4230:20257417,20140602:pet_clair:4230:20141025,20140603:pet_clair:4230:20140922,20140832:pet_clair:4230:20257738,20140833:pet_clair:4230:20257771,20140835:pet_clair:4230:20258170,20140836:pet_clair:4230:20258245,20140837:pet_clair:4230:20435796,20140839:pet_clair:4230:20259159,20140840:pet_clair:4230:20259069,20140841:pet_clair:4230:20259132,20140842:pet_clair:4230:20362997,20140843:pet_clair:4230:20259667,20140844:pet_clair:4230:20260553,20140845:pet_clair:4230:20260146,20140846:pet_clair:4230:20260491,20140847:pet_clair:4230:20260659,20140848:pet_clair:4230:20260857,20140849:pet_clair:4230:20363612,20140850:pet_clair:4230:20141418,20140851:pet_clair:4230:20140952,20140852:pet_clair:4230:20141236,20141296:pet_clair:4230:20261890,20141297:pet_clair:4230:20262201,20141298:pet_clair:4230:20261835,20141299:pet_clair:4230:20261774,20141300:pet_clair:4230:20262171,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.1026244355772286, 'nb_photo': 3247, 'list_port_cont': '20140920,20141857,20142150,20142318,20142494,20142549,20142646,20142950,20143118,20143270,20143452,20143496,20143542,20143677,20143759,20143848,20144089,20144122,20144276,20144444,20144698,20144793,20144933,20145001,20145088,20145233,20145331,20145385,20145451,20145581,20145831,20145951,20145986,20146082,20146230,20146361,20146505,20146558,20146651,20146828,20146871,20147033,20147093,20147140,20147173,20147219,20147257,20147291,20147328,20147461,20147546,20147596,20147644,20147686,20147730,20147835,20147904,20147954,20147987,20148094,20148146,20148249,20148364,20148394,20148503,20148542,20148621,20148730,20148803,20148892,20148930,20148969,20149031,20149063,20149115,20149225,20149283,20149316,20149374,20149571,20149642,20149704,20149772,20149894,20149990,20150079,20150113,20150227,20150435,20150467,20150824,20150892,20150939,20151004,20166488,20168414,20180383,20187136,20188276,20188917,20190643,20193024,20195382,20195505,20195584,20196122,20196300,20196527,20197497,20199044,20209179,20209974,20210088,2021795', 'assoc_port': '20140596:20256812,20140597:20257045,20140603:20140920,20140832:20257728,20140837:20435781,20140841:20259126,20140844:20260552,20140846:20260487,20140847:20260657,20141296:20261901,20141297:20262209,20141300:20262177,20141670:20265471,20141671:20265820,20141672:20266168,20141673:20266124,20141674:20266314,20141679:20266937,20141680:20142150,20141681:20141857,20142050:20267580,20142051:20267936,20142052:20268072,20142054:20476260,20142055:20268509,20142056:20268589,20142061:20269887,20142062:20270231,20142063:20373774,20142064:20270311,20142065:20142494,20142066:20270346,20142067:20142318,20142453:20151004,20142454:20372175,20142455:20270657,20142456:20150892,20142457:20150939,20142460:20150824,20142461:20284131,20142462:20150467,20142463:20150435,20142466:20142646,20142467:20142549,20142783:20150113,20142784:20150079,20142785:20149772,20142786:20149894,20142787:20149990,20142788:20149704,20142789:20149642,20142790:20150227,20142791:20149316,20142792:20149374,20142793:20143118,20142794:20149283,20142795:2014295', 'assoc_mat': '20140596:pet_fonce:4230:20256812,20140597:pet_fonce:4230:20257045,20140603:pet_fonce:4230:20140920,20140832:pet_fonce:4230:20257728,20140837:pet_fonce:4230:20435781,20140841:pet_fonce:4230:20259126,20140844:pet_fonce:4230:20260552,20140846:pet_fonce:4230:20260487,20140847:pet_fonce:4230:20260657,20141296:pet_fonce:4230:20261901,20141297:pet_fonce:4230:20262209,20141300:pet_fonce:4230:20262177,20141670:pet_fonce:4230:20265471,20141671:pet_fonce:4230:20265820,20141672:pet_fonce:4230:20266168,20141673:pet_fonce:4230:20266124,20141674:pet_fonce:4230:20266314,20141679:pet_fonce:4230:20266937,20141680:pet_fonce:4230:20142150,20141681:pet_fonce:4230:20141857,20142050:pet_fonce:4230:20267580,20142051:pet_fonce:4230:20267936,20142052:pet_fonce:4230:20268072,20142054:pet_fonce:4230:20476260,20142055:pet_fonce:4230:20268509,20142056:pet_fonce:4230:20268589,20142061:pet_fonce:4230:20269887,20142062:pet_fonce:4230:20270231,20142063:pet_fonce:4230:20373774,20142064:pet_fonce:4230:20270311,20142065:pet_fonce:4230:20142494,2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1580638,1583728,1590227,1590216,1599013,1599004,1598996,1598985,1601956,1604880,1607815,1610844,1613692,1614384,1614363)); after get_hostname_from_raspi hasthag : truck hasthag that could be used but not yet : _______refus SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______truck' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=1055) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=132 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((8315,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 7379),), 'material_dict': {'truck': 7379}, 'coverage_data': (('2025/02/15/', 0.965057), ('2025/02/14/', 0.965625), ('2025/02/13/', 0.967349), ('2025/02/12/', 0.960625), ('2025/02/11/', 0.961215), ('2025/02/10/', 0.963819), ('2025/02/09/', 0.958865), ('2025/02/08/', 0.962673), ('2025/02/07/', 0.961886), ('2025/02/06/', 0.0), ('2025/02/05/', 0.961713), ('2025/02/04/', 0.967199), ('2025/02/03/', 0.962824), ('2025/02/02/', 0.955428), ('2025/02/01/', 0.962384)), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.2002617398268295, 1252), (datetime.date(2025, 2, 2), 0.1999469593580446, 284), (datetime.date(2025, 2, 3), 0.2039147776940917, 347), (datetime.date(2025, 2, 4), 0.1977575739218397, 1084), (datetime.date(2025, 2, 5), 0.21235173792207362, 1286), (datetime.date(2025, 2, 6), 0.21312440973067406, 904), (datetime.date(2025, 2, 7), 0.19866998105166447, 209), (datetime.date(2025, 2, 8), 0.25763526006887966, 545), (datetime.date(2025, 2, 10), 0.2126199532268655, 272), (datetime.date(2025, 2, 11), 0.20687005698194855, 274), (datetime.date(2025, 2, 12), 0.2008330973070578, 174), (datetime.date(2025, 2, 13), 0.22967902715622965, 177), (datetime.date(2025, 2, 14), 0.23741900710716016, 426), (datetime.date(2025, 2, 15), 0.21569688595266642, 145)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 2, 1), 0.2002617398268295, 1252), (datetime.date(2025, 2, 2), 0.1999469593580446, 284), (datetime.date(2025, 2, 3), 0.2039147776940917, 347), (datetime.date(2025, 2, 4), 0.1977575739218397, 1084), (datetime.date(2025, 2, 5), 0.21235173792207362, 1286), (datetime.date(2025, 2, 6), 0.21312440973067406, 904), (datetime.date(2025, 2, 7), 0.19866998105166447, 209), (datetime.date(2025, 2, 8), 0.25763526006887966, 545), (datetime.date(2025, 2, 10), 0.2126199532268655, 272), (datetime.date(2025, 2, 11), 0.20687005698194855, 274), (datetime.date(2025, 2, 12), 0.2008330973070578, 174), (datetime.date(2025, 2, 13), 0.22967902715622965, 177), (datetime.date(2025, 2, 14), 0.23741900710716016, 426), (datetime.date(2025, 2, 15), 0.21569688595266642, 145))}, 'quality_array': [['-7.9228947891097725', '01022025'], ['-7.553744611740751', '02022025'], ['-7.781767486743617', '03022025'], ['-7.6114493096521265', '04022025'], ['-7.476955193319789', '05022025'], ['-7.4985751763100295', '06022025'], ['-7.68339308063659', '07022025'], ['-7.448041015990126', '08022025'], ['-7.742108443271337', '10022025'], ['-7.578104504095307', '11022025'], ['-7.817597311878333', '12022025'], ['-7.944881189767157', '13022025'], ['-7.637573193091037', '14022025'], ['-7.1208145427184295', '15022025']], 'number_of_batch': ((1316,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06699575400215528, 'nb_photo': 111368, 'list_port_cont': '20140918,20140953,20141037,20141226,20141407,20141731,20141850,20142142,20142310,20142503,20142544,20142645,20142829,20142953,20143113,20143265,20143438,20143498,20143532,20143661,20143753,20143842,20143887,20143933,20143963,20144078,20144109,20144147,20144266,20144385,20144456,20144578,20144702,20144796,20144847,20144925,20144995,20145094,20145229,20145334,20145376,20145460,20145576,20145700,20145836,20145945,20145992,20146094,20146220,20146356,20146510,20146550,20146650,20146842,20146880,20147031,20147097,20147144,20147181,20147214,20147259,20147284,20147320,20147472,20147553,20147586,20147634,20147677,20147732,20147839,20147915,20147947,20147985,20148089,20148143,20148256,20148356,20148393,20148507,20148547,20148610,20148727,20148799,20148887,20148929,20148971,20149027,20149073,20149107,20149234,20149292,20149320,20149367,20149563,20149646,20149705,20149767,20149904,20149985,20150080,20150116,20150230,20150340,20150420,20150460,20150510,20150661,20150817,20150894,20150927,20151013,20162787,20162862,2016291', 'assoc_port': '20140596:20256813,20140597:20257030,20140598:20257198,20140599:20257273,20140600:20257421,20140602:20141037,20140603:20140918,20140832:20257735,20140833:20257775,20140835:20258168,20140836:20258254,20140837:20435780,20140839:20259157,20140840:20259057,20140841:20259115,20140842:20362988,20140843:20259666,20140844:20260537,20140845:20260144,20140846:20260480,20140847:20260651,20140848:20260856,20140849:20363623,20140850:20141407,20140851:20140953,20140852:20141226,20141296:20261889,20141297:20262215,20141298:20261832,20141299:20261773,20141300:20262176,20141301:20363531,20141302:20141731,20141657:20263090,20141658:20262856,20141659:20263260,20141660:20263480,20141661:20263784,20141662:20264172,20141663:20264241,20141664:20264498,20141665:20264548,20141666:20264803,20141667:20264885,20141668:20371198,20141669:20265230,20141670:20265468,20141671:20265816,20141672:20266157,20141673:20266136,20141674:20266318,20141675:20266424,20141676:20266608,20141677:20266712,20141678:20372241,20141679:20266931,20141680:2014214', 'assoc_mat': '20140596:autre:4230:20256813,20140597:autre:4230:20257030,20140598:autre:4230:20257198,20140599:autre:4230:20257273,20140600:autre:4230:20257421,20140602:autre:4230:20141037,20140603:autre:4230:20140918,20140832:autre:4230:20257735,20140833:autre:4230:20257775,20140835:autre:4230:20258168,20140836:autre:4230:20258254,20140837:autre:4230:20435780,20140839:autre:4230:20259157,20140840:autre:4230:20259057,20140841:autre:4230:20259115,20140842:autre:4230:20362988,20140843:autre:4230:20259666,20140844:autre:4230:20260537,20140845:autre:4230:20260144,20140846:autre:4230:20260480,20140847:autre:4230:20260651,20140848:autre:4230:20260856,20140849:autre:4230:20363623,20140850:autre:4230:20141407,20140851:autre:4230:20140953,20140852:autre:4230:20141226,20141296:autre:4230:20261889,20141297:autre:4230:20262215,20141298:autre:4230:20261832,20141299:autre:4230:20261773,20141300:autre:4230:20262176,20141301:autre:4230:20363531,20141302:autre:4230:20141731,20141657:autre:4230:20263090,20141658:autre:4230:20262856,20141659:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.030385603058127545, 'nb_photo': 113606, 'list_port_cont': '20140912,20140958,20141033,20141230,20141419,20141737,20141858,20142146,20142317,20142496,20142551,20142644,20142841,20142951,20143111,20143257,20143451,20143501,20143541,20143678,20143760,20143836,20143884,20143937,20143976,20144083,20144119,20144155,20144275,20144398,20144447,20144567,20144697,20144789,20144858,20144932,20145003,20145091,20145236,20145328,20145389,20145458,20145568,20145710,20145847,20145947,20145984,20146088,20146231,20146369,20146506,20146566,20146657,20146841,20146873,20147034,20147105,20147145,20147172,20147215,20147256,20147298,20147334,20147476,20147560,20147592,20147645,20147683,20147728,20147843,20147909,20147948,20147991,20148099,20148142,20148250,20148365,20148400,20148512,20148539,20148626,20148729,20148804,20148891,20148926,20148960,20149033,20149074,20149102,20149235,20149290,20149328,20149376,20149562,20149645,20149706,20149759,20149903,20149981,20150075,20150110,20150220,20150352,20150430,20150472,20150508,20150656,20150815,20150890,20150930,20151011,20162792,20162866,2016291', 'assoc_port': '20140596:20256816,20140597:20257046,20140598:20257205,20140599:20257285,20140600:20257423,20140602:20141033,20140603:20140912,20140832:20257730,20140833:20257770,20140835:20258175,20140836:20258253,20140837:20435789,20140839:20259168,20140840:20259067,20140841:20259130,20140842:20363003,20140843:20259657,20140844:20260550,20140845:20260142,20140846:20260485,20140847:20260649,20140848:20260846,20140849:20363618,20140850:20141419,20140851:20140958,20140852:20141230,20141296:20261898,20141297:20262212,20141298:20261836,20141299:20261788,20141300:20262165,20141301:20363535,20141302:20141737,20141657:20263091,20141658:20262866,20141659:20263269,20141660:20263484,20141661:20263795,20141662:20264179,20141663:20264252,20141664:20264507,20141665:20264535,20141666:20264808,20141667:20264877,20141668:20371221,20141669:20265226,20141670:20265481,20141671:20265829,20141672:20266169,20141673:20266130,20141674:20266319,20141675:20266414,20141676:20266616,20141677:20266706,20141678:20372251,20141679:20266936,20141680:2014214', 'assoc_mat': '20140596:carton:4230:20256816,20140597:carton:4230:20257046,20140598:carton:4230:20257205,20140599:carton:4230:20257285,20140600:carton:4230:20257423,20140602:carton:4230:20141033,20140603:carton:4230:20140912,20140832:carton:4230:20257730,20140833:carton:4230:20257770,20140835:carton:4230:20258175,20140836:carton:4230:20258253,20140837:carton:4230:20435789,20140839:carton:4230:20259168,20140840:carton:4230:20259067,20140841:carton:4230:20259130,20140842:carton:4230:20363003,20140843:carton:4230:20259657,20140844:carton:4230:20260550,20140845:carton:4230:20260142,20140846:carton:4230:20260485,20140847:carton:4230:20260649,20140848:carton:4230:20260846,20140849:carton:4230:20363618,20140850:carton:4230:20141419,20140851:carton:4230:20140958,20140852:carton:4230:20141230,20141296:carton:4230:20261898,20141297:carton:4230:20262212,20141298:carton:4230:20261836,20141299:carton:4230:20261788,20141300:carton:4230:20262165,20141301:carton:4230:20363535,20141302:carton:4230:20141737,20141657:carton:4230:20263091,2014'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004915529001885848, 'nb_photo': 4056, 'list_port_cont': '20140923,20140959,20141032,20141235,20141405,20141736,20141856,20142147,20142308,20142537,20143109,20143258,20143453,20143491,20143535,20143669,20143745,20143839,20143878,20143935,20143972,20144077,20144124,20144151,20144278,20144399,20144449,20144576,20144689,20144792,20144863,20144931,20144990,20145095,20145223,20145336,20145373,20145454,20145575,20145695,20145845,20145954,20145983,20146089,20146219,20146367,20146508,20146567,20146646,20146831,20146877,20147036,20147107,20147138,20147180,20147205,20147255,20147289,20147325,20147469,20147549,20147591,20147643,20147684,20147724,20147837,20147906,20147943,20148084,20148138,20148258,20148406,20148516,20148613,20148737,20148800,20148888,20148933,20148965,20149024,20149062,20149224,20149293,20149312,20149368,20149559,20149639,20149762,20149890,20149986,20150076,20150105,20150217,20150350,20150469,20150500,20150827,20150901,20150924,20151012,20162798,20162875,20162974,20163058,20163313,20163419,20163766,20163905,20164051,20164908,20165676,20165824,20166235,2016752', 'assoc_port': '20140596:20256807,20140597:20257044,20140599:20257280,20140600:20257418,20140602:20141032,20140603:20140923,20140832:20257732,20140833:20257768,20140835:20258163,20140837:20435791,20140839:20259158,20140840:20259053,20140841:20259124,20140843:20259663,20140844:20260541,20140845:20260135,20140846:20260484,20140847:20260650,20140848:20260849,20140849:20363621,20140850:20141405,20140851:20140959,20140852:20141235,20141296:20261899,20141297:20262214,20141298:20261839,20141299:20261778,20141300:20262170,20141301:20363548,20141302:20141736,20141657:20263089,20141659:20263266,20141660:20263487,20141661:20263786,20141662:20264184,20141663:20264248,20141664:20264505,20141665:20264538,20141666:20264798,20141667:20264879,20141668:20371223,20141670:20265474,20141671:20265818,20141672:20266160,20141673:20266134,20141674:20266306,20141675:20266420,20141676:20266611,20141677:20266697,20141678:20372238,20141679:20266921,20141680:20142147,20141681:20141856,20142049:20267222,20142050:20267576,20142051:20267929,20142052:2026807', 'assoc_mat': '20140596:metal:4230:20256807,20140597:metal:4230:20257044,20140599:metal:4230:20257280,20140600:metal:4230:20257418,20140602:metal:4230:20141032,20140603:metal:4230:20140923,20140832:metal:4230:20257732,20140833:metal:4230:20257768,20140835:metal:4230:20258163,20140837:metal:4230:20435791,20140839:metal:4230:20259158,20140840:metal:4230:20259053,20140841:metal:4230:20259124,20140843:metal:4230:20259663,20140844:metal:4230:20260541,20140845:metal:4230:20260135,20140846:metal:4230:20260484,20140847:metal:4230:20260650,20140848:metal:4230:20260849,20140849:metal:4230:20363621,20140850:metal:4230:20141405,20140851:metal:4230:20140959,20140852:metal:4230:20141235,20141296:metal:4230:20261899,20141297:metal:4230:20262214,20141298:metal:4230:20261839,20141299:metal:4230:20261778,20141300:metal:4230:20262170,20141301:metal:4230:20363548,20141302:metal:4230:20141736,20141657:metal:4230:20263089,20141659:metal:4230:20263266,20141660:metal:4230:20263487,20141661:metal:4230:20263786,20141662:metal:4230:20264184,20141663:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10159311143251597, 'nb_photo': 305919, 'list_port_cont': '20140919,20140960,20141035,20141232,20141414,20141729,20141859,20142152,20142319,20142502,20142545,20142651,20142834,20142943,20143106,20143260,20143448,20143505,20143546,20143674,20143757,20143838,20143885,20143931,20143967,20144079,20144123,20144161,20144281,20144391,20144446,20144581,20144699,20144790,20144860,20144917,20145005,20145086,20145228,20145323,20145378,20145457,20145574,20145707,20145840,20145952,20145981,20146091,20146233,20146362,20146514,20146560,20146655,20146839,20146876,20147032,20147101,20147141,20147174,20147220,20147252,20147297,20147329,20147475,20147559,20147593,20147650,20147680,20147737,20147844,20147911,20147951,20147978,20148098,20148145,20148248,20148362,20148392,20148515,20148549,20148625,20148736,20148807,20148885,20148931,20148966,20149039,20149075,20149112,20149232,20149284,20149381,20149575,20149644,20149707,20149770,20149902,20149997,20150085,20150114,20150228,20150353,20150431,20150461,20150511,20150652,20150821,20150903,20150928,20151005,20162791,20162867,20162907,2016298', 'assoc_port': '20140596:20256809,20140597:20257040,20140598:20257202,20140599:20257286,20140600:20257424,20140602:20141035,20140603:20140919,20140832:20257733,20140833:20257774,20140835:20258173,20140836:20258255,20140837:20435794,20140839:20259169,20140840:20259064,20140841:20259129,20140842:20363000,20140843:20259671,20140844:20260545,20140845:20260141,20140846:20260488,20140847:20260652,20140848:20260841,20140849:20363610,20140850:20141414,20140851:20140960,20140852:20141232,20141296:20261897,20141297:20262204,20141298:20261837,20141299:20261783,20141300:20262178,20141301:20363541,20141302:20141729,20141657:20263098,20141658:20262864,20141659:20263267,20141660:20263494,20141661:20263797,20141662:20264181,20141663:20264254,20141664:20264508,20141665:20264547,20141666:20264805,20141667:20264888,20141668:20371222,20141669:20265231,20141670:20265475,20141671:20265830,20141672:20266164,20141673:20266129,20141674:20266315,20141675:20266418,20141676:20266613,20141677:20266713,20141678:20372246,20141679:20266938,20141680:2014215', 'assoc_mat': '20140596:papier:4230:20256809,20140597:papier:4230:20257040,20140598:papier:4230:20257202,20140599:papier:4230:20257286,20140600:papier:4230:20257424,20140602:papier:4230:20141035,20140603:papier:4230:20140919,20140832:papier:4230:20257733,20140833:papier:4230:20257774,20140835:papier:4230:20258173,20140836:papier:4230:20258255,20140837:papier:4230:20435794,20140839:papier:4230:20259169,20140840:papier:4230:20259064,20140841:papier:4230:20259129,20140842:papier:4230:20363000,20140843:papier:4230:20259671,20140844:papier:4230:20260545,20140845:papier:4230:20260141,20140846:papier:4230:20260488,20140847:papier:4230:20260652,20140848:papier:4230:20260841,20140849:papier:4230:20363610,20140850:papier:4230:20141414,20140851:papier:4230:20140960,20140852:papier:4230:20141232,20141296:papier:4230:20261897,20141297:papier:4230:20262204,20141298:papier:4230:20261837,20141299:papier:4230:20261783,20141300:papier:4230:20262178,20141301:papier:4230:20363541,20141302:papier:4230:20141729,20141657:papier:4230:20263098,2014'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.002278633600684754, 'nb_photo': 1489, 'list_port_cont': '20140925,20141031,20142550,20144113,20147029,20147109,20147250,20149291,20149377,20149631,20150078,20150470,20150506,20150653,20150816,20150938,20178866,20180384,20182608,20183637,20184614,20186419,20187142,20187609,20192864,20195378,20195573,20196117,20196313,20196528,20211329,20220117,20239893,20239935,20240706,20242205,20242285,20244346,20256815,20257036,20257586,20257736,20258179,20259166,20261895,20262210,20264185,20265831,20266581,20268689,20268922,20271192,20278144,20278193,20278301,20278751,20279405,20287665,20287726,20289115,20289763,20292761,20295368,20298068,20300346,20301695,20306759,20307606,20309281,20309647,20312457,20313466,20313677,20314024,20314164,20314292,20314513,20315166,20317878,20319598,20321438,20324226,20333551,20334151,20334444,20336454,20337270,20338767,20344199,20346953,20347089,20348333,20349323,20350228,20351335,20352379,20352444,20353460,20354037,20354251,20359098,20359159,20359294,20359350,20362088,20362406,20362627,20362860,20363130,20363539,20363689,20363850,20363976,2036458', 'assoc_port': '20140596:20256815,20140597:20257036,20140602:20141031,20140603:20140925,20140832:20257736,20140835:20258179,20140837:20435784,20140839:20259166,20141296:20261895,20141297:20262210,20141301:20363539,20141662:20264185,20141671:20265831,20142057:20268689,20142058:20268922,20142063:20373775,20142457:20150938,20142458:20150506,20142459:20150653,20142460:20150816,20142462:20150470,20142467:20142550,20142784:20150078,20142789:20149631,20142792:20149377,20142794:20149291,20143402:20147250,20143406:20147109,20143698:20147029,20143823:20144113,20162665:20292761,20178460:20180384,20178463:20182608,20178464:20178866,20182964:20183637,20182966:20184614,20185150:20187142,20185152:20186419,20187253:20407789,20187256:20319598,20187263:20187609,20190539:20192864,20195295:20196117,20195298:20195573,20195300:20195378,20196010:20196528,20196011:20196313,20210198:20352379,20210200:20352444,20210823:20353460,20210829:20211329,20211509:20354037,20215645:20354251,20216822:20220117,20236816:20359098,20236817:20359159,20236818:2035929', 'assoc_mat': '20140596:pehd:4230:20256815,20140597:pehd:4230:20257036,20140602:pehd:4230:20141031,20140603:pehd:4230:20140925,20140832:pehd:4230:20257736,20140835:pehd:4230:20258179,20140837:pehd:4230:20435784,20140839:pehd:4230:20259166,20141296:pehd:4230:20261895,20141297:pehd:4230:20262210,20141301:pehd:4230:20363539,20141662:pehd:4230:20264185,20141671:pehd:4230:20265831,20142057:pehd:4230:20268689,20142058:pehd:4230:20268922,20142063:pehd:4230:20373775,20142457:pehd:4230:20150938,20142458:pehd:4230:20150506,20142459:pehd:4230:20150653,20142460:pehd:4230:20150816,20142462:pehd:4230:20150470,20142467:pehd:4230:20142550,20142784:pehd:4230:20150078,20142789:pehd:4230:20149631,20142792:pehd:4230:20149377,20142794:pehd:4230:20149291,20143402:pehd:4230:20147250,20143406:pehd:4230:20147109,20143698:pehd:4230:20147029,20143823:pehd:4230:20144113,20162665:pehd:4230:20292761,20178460:pehd:4230:20180384,20178463:pehd:4230:20182608,20178464:pehd:4230:20178866,20182964:pehd:4230:20183637,20182966:pehd:4230:20184614,20185150:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009948184618746149, 'nb_photo': 39644, 'list_port_cont': '20140922,20140952,20141025,20141236,20141418,20141735,20141865,20142156,20142313,20142493,20142548,20142643,20142835,20142949,20143117,20143271,20143449,20143504,20143539,20143673,20143761,20143833,20143881,20143932,20143971,20144085,20144114,20144164,20144280,20144394,20144454,20144571,20144701,20144787,20144859,20144929,20144999,20145092,20145227,20145330,20145388,20145459,20145578,20145709,20145846,20145946,20145994,20146093,20146227,20146365,20146511,20146556,20146647,20146833,20146878,20147028,20147100,20147135,20147178,20147218,20147258,20147294,20147332,20147464,20147556,20147597,20147649,20147678,20147739,20147846,20147918,20147955,20147988,20148096,20148144,20148255,20148366,20148404,20148509,20148544,20148619,20148728,20148809,20148896,20148934,20148970,20149041,20149070,20149105,20149231,20149289,20149325,20149382,20149573,20149635,20149715,20149774,20149906,20149993,20150071,20150120,20150229,20150356,20150428,20150464,20150509,20150659,20150823,20150899,20150937,20151008,20162788,20162878,2016290', 'assoc_port': '20140596:20256808,20140597:20257047,20140598:20257207,20140599:20257278,20140600:20257417,20140602:20141025,20140603:20140922,20140832:20257738,20140833:20257771,20140835:20258170,20140836:20258245,20140837:20435796,20140839:20259159,20140840:20259069,20140841:20259132,20140842:20362997,20140843:20259667,20140844:20260553,20140845:20260146,20140846:20260491,20140847:20260659,20140848:20260857,20140849:20363612,20140850:20141418,20140851:20140952,20140852:20141236,20141296:20261890,20141297:20262201,20141298:20261835,20141299:20261774,20141300:20262171,20141301:20363540,20141302:20141735,20141657:20263096,20141658:20262865,20141659:20263276,20141660:20263483,20141661:20263796,20141662:20264182,20141663:20264249,20141664:20264497,20141665:20264537,20141666:20264797,20141667:20264882,20141668:20371212,20141669:20265221,20141670:20265477,20141671:20265826,20141672:20266161,20141673:20266135,20141674:20266317,20141675:20266425,20141676:20266618,20141677:20266711,20141678:20372255,20141679:20266935,20141680:2014215', 'assoc_mat': '20140596:pet_clair:4230:20256808,20140597:pet_clair:4230:20257047,20140598:pet_clair:4230:20257207,20140599:pet_clair:4230:20257278,20140600:pet_clair:4230:20257417,20140602:pet_clair:4230:20141025,20140603:pet_clair:4230:20140922,20140832:pet_clair:4230:20257738,20140833:pet_clair:4230:20257771,20140835:pet_clair:4230:20258170,20140836:pet_clair:4230:20258245,20140837:pet_clair:4230:20435796,20140839:pet_clair:4230:20259159,20140840:pet_clair:4230:20259069,20140841:pet_clair:4230:20259132,20140842:pet_clair:4230:20362997,20140843:pet_clair:4230:20259667,20140844:pet_clair:4230:20260553,20140845:pet_clair:4230:20260146,20140846:pet_clair:4230:20260491,20140847:pet_clair:4230:20260659,20140848:pet_clair:4230:20260857,20140849:pet_clair:4230:20363612,20140850:pet_clair:4230:20141418,20140851:pet_clair:4230:20140952,20140852:pet_clair:4230:20141236,20141296:pet_clair:4230:20261890,20141297:pet_clair:4230:20262201,20141298:pet_clair:4230:20261835,20141299:pet_clair:4230:20261774,20141300:pet_clair:4230:20262171,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.1026244355772286, 'nb_photo': 3247, 'list_port_cont': '20140920,20141857,20142150,20142318,20142494,20142549,20142646,20142950,20143118,20143270,20143452,20143496,20143542,20143677,20143759,20143848,20144089,20144122,20144276,20144444,20144698,20144793,20144933,20145001,20145088,20145233,20145331,20145385,20145451,20145581,20145831,20145951,20145986,20146082,20146230,20146361,20146505,20146558,20146651,20146828,20146871,20147033,20147093,20147140,20147173,20147219,20147257,20147291,20147328,20147461,20147546,20147596,20147644,20147686,20147730,20147835,20147904,20147954,20147987,20148094,20148146,20148249,20148364,20148394,20148503,20148542,20148621,20148730,20148803,20148892,20148930,20148969,20149031,20149063,20149115,20149225,20149283,20149316,20149374,20149571,20149642,20149704,20149772,20149894,20149990,20150079,20150113,20150227,20150435,20150467,20150824,20150892,20150939,20151004,20166488,20168414,20180383,20187136,20188276,20188917,20190643,20193024,20195382,20195505,20195584,20196122,20196300,20196527,20197497,20199044,20209179,20209974,20210088,2021795', 'assoc_port': '20140596:20256812,20140597:20257045,20140603:20140920,20140832:20257728,20140837:20435781,20140841:20259126,20140844:20260552,20140846:20260487,20140847:20260657,20141296:20261901,20141297:20262209,20141300:20262177,20141670:20265471,20141671:20265820,20141672:20266168,20141673:20266124,20141674:20266314,20141679:20266937,20141680:20142150,20141681:20141857,20142050:20267580,20142051:20267936,20142052:20268072,20142054:20476260,20142055:20268509,20142056:20268589,20142061:20269887,20142062:20270231,20142063:20373774,20142064:20270311,20142065:20142494,20142066:20270346,20142067:20142318,20142453:20151004,20142454:20372175,20142455:20270657,20142456:20150892,20142457:20150939,20142460:20150824,20142461:20284131,20142462:20150467,20142463:20150435,20142466:20142646,20142467:20142549,20142783:20150113,20142784:20150079,20142785:20149772,20142786:20149894,20142787:20149990,20142788:20149704,20142789:20149642,20142790:20150227,20142791:20149316,20142792:20149374,20142793:20143118,20142794:20149283,20142795:2014295', 'assoc_mat': '20140596:pet_fonce:4230:20256812,20140597:pet_fonce:4230:20257045,20140603:pet_fonce:4230:20140920,20140832:pet_fonce:4230:20257728,20140837:pet_fonce:4230:20435781,20140841:pet_fonce:4230:20259126,20140844:pet_fonce:4230:20260552,20140846:pet_fonce:4230:20260487,20140847:pet_fonce:4230:20260657,20141296:pet_fonce:4230:20261901,20141297:pet_fonce:4230:20262209,20141300:pet_fonce:4230:20262177,20141670:pet_fonce:4230:20265471,20141671:pet_fonce:4230:20265820,20141672:pet_fonce:4230:20266168,20141673:pet_fonce:4230:20266124,20141674:pet_fonce:4230:20266314,20141679:pet_fonce:4230:20266937,20141680:pet_fonce:4230:20142150,20141681:pet_fonce:4230:20141857,20142050:pet_fonce:4230:20267580,20142051:pet_fonce:4230:20267936,20142052:pet_fonce:4230:20268072,20142054:pet_fonce:4230:20476260,20142055:pet_fonce:4230:20268509,20142056:pet_fonce:4230:20268589,20142061:pet_fonce:4230:20269887,20142062:pet_fonce:4230:20270231,20142063:pet_fonce:4230:20373774,20142064:pet_fonce:4230:20270311,20142065:pet_fonce:4230:20142494,2'}), 'main_stat': {'nb_photos': 8315}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': '4311', 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="dechet_Valcor_v2"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4311 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4311 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4311 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4311 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! {"input_values":[]} We expected an STS datou with a camera_place_name, so there is a PB, datou_id: 4311 ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? {'id': 4311, 'name': 'sts_dechet_valcor_matching_v2_2022Q3', 'limit_max': 100, 'nb_steps': 2, 'estimated_time': 8640, 'list_steps': [{'id': 11939, 'type': 'matching_dashboard', 'param': '0', 'json_param_as_string': "{'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}", 'json_param': {'camera_matching': 'plaque_Valcor', 'max_time_diff': 120, 'matching_method': '1_vs_n', 'input_default_values': []}, 'nb_input': 1, 'nb_output': 0, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11939, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}]}, {'id': 11940, 'type': 'split_time_score', 'param': '0', 'json_param_as_string': "{'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}", 'json_param': {'camera_place_name': 'dechet_Valcor_v2', 'ETA': 8640, 'param_moyenne_mobile': 5, 'thcl': 3442, 'list_task_complete': [''], 'list_tasks': 'LOAD,ORDER,CONVENTION,SPLIT_TRUCK,merge_port_according_to_plate_info,remove_no_plate_batch,CREATE_PORT_LAUNCH_CARAC_FILL_DASHBOARD', 'forced_hashtag': 'truck', 'list_hashtag_class_create': 'truck', 'ponderation': '0.001,0.001,0.001,0.001,0.001', 'host': 'www.fotonower.com', 'datou_proportion_papier': {'test': 370, 'truck': 4234}, 'datou_matching_id': 4311, 'cod': 1, 'min_number_photo_per_batch': 2, 'datou_truck_for_info': 4234}, 'nb_input': 2, 'nb_output': 1, 'prod': False, 'is_local': False, 'is_datou_depend': False, 'is_photo_id_local': False, 'list_data': [{'step_id': 11940, 'datou_id': 4311, 'type_id': 18, 'name': 'portfolio_id', 'output_or_input': False, 'data_order_id': 0, 'type_python': 'int'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 10, 'name': 'data_string', 'output_or_input': False, 'data_order_id': 1, 'type_python': 'string'}, {'step_id': 11940, 'datou_id': 4311, 'type_id': 22, 'name': 'portfolios_ids_list', 'output_or_input': True, 'data_order_id': 0, 'type_python': 'liste_de_int'}]}], 'depends_step': [{'output': 11939, 'output_id': 0, 'input': 11940, 'input_id': 2}]} check if it is the case where we have multiple sts in one datou no, it is not this case SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=370 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=370 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 370 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=370 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'min_score': 0.7, 'name_pipeline': 'proportion_papier_tapis', 'hashtag_type': 705, 'hashtag_proportion': 492668766, 'hashtag_parmi': 538914404, 'hashtag_to_consider': 'papier_only', 'hashtag_background': 493012381} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier ventilate_hashtags_in_portfolio step not found ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=4234 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=4234 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 4234 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=4234 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11415 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11419 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11419 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11416 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11417 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11417 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11422 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 2 of step 11418 have datatype=6 We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of input 2 of step 11419 doesn't seem to be define in the database( WARNING : output 1 of step 11415 have datatype=7 whereas input 2 of step 11419 have datatype=None WARNING : type of output 3 of step 11419 doesn't seem to be define in the database( WARNING : type of input 1 of step 11416 doesn't seem to be define in the database( WARNING : type of output 1 of step 11416 doesn't seem to be define in the database( WARNING : type of input 3 of step 11417 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11416 have datatype=10 whereas input 0 of step 11420 have datatype=18 WARNING : type of input 5 of step 11418 doesn't seem to be define in the database( WARNING : output 0 of step 11420 have datatype=11 whereas input 5 of step 11418 have datatype=None WARNING : type of input 2 of step 11416 doesn't seem to be define in the database( WARNING : output 0 of step 11421 have datatype=5 whereas input 2 of step 11416 have datatype=None WARNING : output 0 of step 11418 have datatype=10 whereas input 0 of step 11422 have datatype=18 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 4230, 'hashtag_proportion': 'papier,carton,metal,pet_clair,autre,pehd,pet_fonce', 'hashtag_parmi': 'refus', 'hashtag_weights': {'autre': 3.0, 'barquette_avec_film': 3.0, 'carton': 3.0, 'metal': 3.0, 'papier': 3.0, 'pehd': 3.0, 'pet_fonce': 3.0, 'pet_clair': 1.0, 'flou': 1.0, 'mal_croppe': 1.0}, 'option_sccu': 1} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((8315,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('truck', 7379),), 'material_dict': {'truck': 7379}, 'coverage_data': (('2025/02/15/', 0.965057), ('2025/02/14/', 0.965625), ('2025/02/13/', 0.967349), ('2025/02/12/', 0.960625), ('2025/02/11/', 0.961215), ('2025/02/10/', 0.963819), ('2025/02/09/', 0.958865), ('2025/02/08/', 0.962673), ('2025/02/07/', 0.961886), ('2025/02/06/', 0.0), ('2025/02/05/', 0.961713), ('2025/02/04/', 0.967199), ('2025/02/03/', 0.962824), ('2025/02/02/', 0.955428), ('2025/02/01/', 0.962384)), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.2002617398268295, 1252), (datetime.date(2025, 2, 2), 0.1999469593580446, 284), (datetime.date(2025, 2, 3), 0.2039147776940917, 347), (datetime.date(2025, 2, 4), 0.1977575739218397, 1084), (datetime.date(2025, 2, 5), 0.21235173792207362, 1286), (datetime.date(2025, 2, 6), 0.21312440973067406, 904), (datetime.date(2025, 2, 7), 0.19866998105166447, 209), (datetime.date(2025, 2, 8), 0.25763526006887966, 545), (datetime.date(2025, 2, 10), 0.2126199532268655, 272), (datetime.date(2025, 2, 11), 0.20687005698194855, 274), (datetime.date(2025, 2, 12), 0.2008330973070578, 174), (datetime.date(2025, 2, 13), 0.22967902715622965, 177), (datetime.date(2025, 2, 14), 0.23741900710716016, 426), (datetime.date(2025, 2, 15), 0.21569688595266642, 145)), 'impurety_average_data_per_hashtag': {'truck': ((datetime.date(2025, 2, 1), 0.2002617398268295, 1252), (datetime.date(2025, 2, 2), 0.1999469593580446, 284), (datetime.date(2025, 2, 3), 0.2039147776940917, 347), (datetime.date(2025, 2, 4), 0.1977575739218397, 1084), (datetime.date(2025, 2, 5), 0.21235173792207362, 1286), (datetime.date(2025, 2, 6), 0.21312440973067406, 904), (datetime.date(2025, 2, 7), 0.19866998105166447, 209), (datetime.date(2025, 2, 8), 0.25763526006887966, 545), (datetime.date(2025, 2, 10), 0.2126199532268655, 272), (datetime.date(2025, 2, 11), 0.20687005698194855, 274), (datetime.date(2025, 2, 12), 0.2008330973070578, 174), (datetime.date(2025, 2, 13), 0.22967902715622965, 177), (datetime.date(2025, 2, 14), 0.23741900710716016, 426), (datetime.date(2025, 2, 15), 0.21569688595266642, 145))}, 'quality_array': [['-7.9228947891097725', '01022025'], ['-7.553744611740751', '02022025'], ['-7.781767486743617', '03022025'], ['-7.6114493096521265', '04022025'], ['-7.476955193319789', '05022025'], ['-7.4985751763100295', '06022025'], ['-7.68339308063659', '07022025'], ['-7.448041015990126', '08022025'], ['-7.742108443271337', '10022025'], ['-7.578104504095307', '11022025'], ['-7.817597311878333', '12022025'], ['-7.944881189767157', '13022025'], ['-7.637573193091037', '14022025'], ['-7.1208145427184295', '15022025']], 'number_of_batch': ((1316,),), 'datou_id_sts': 4311, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.06699575400215528, 'nb_photo': 111368, 'list_port_cont': '20140918,20140953,20141037,20141226,20141407,20141731,20141850,20142142,20142310,20142503,20142544,20142645,20142829,20142953,20143113,20143265,20143438,20143498,20143532,20143661,20143753,20143842,20143887,20143933,20143963,20144078,20144109,20144147,20144266,20144385,20144456,20144578,20144702,20144796,20144847,20144925,20144995,20145094,20145229,20145334,20145376,20145460,20145576,20145700,20145836,20145945,20145992,20146094,20146220,20146356,20146510,20146550,20146650,20146842,20146880,20147031,20147097,20147144,20147181,20147214,20147259,20147284,20147320,20147472,20147553,20147586,20147634,20147677,20147732,20147839,20147915,20147947,20147985,20148089,20148143,20148256,20148356,20148393,20148507,20148547,20148610,20148727,20148799,20148887,20148929,20148971,20149027,20149073,20149107,20149234,20149292,20149320,20149367,20149563,20149646,20149705,20149767,20149904,20149985,20150080,20150116,20150230,20150340,20150420,20150460,20150510,20150661,20150817,20150894,20150927,20151013,20162787,20162862,2016291', 'assoc_port': '20140596:20256813,20140597:20257030,20140598:20257198,20140599:20257273,20140600:20257421,20140602:20141037,20140603:20140918,20140832:20257735,20140833:20257775,20140835:20258168,20140836:20258254,20140837:20435780,20140839:20259157,20140840:20259057,20140841:20259115,20140842:20362988,20140843:20259666,20140844:20260537,20140845:20260144,20140846:20260480,20140847:20260651,20140848:20260856,20140849:20363623,20140850:20141407,20140851:20140953,20140852:20141226,20141296:20261889,20141297:20262215,20141298:20261832,20141299:20261773,20141300:20262176,20141301:20363531,20141302:20141731,20141657:20263090,20141658:20262856,20141659:20263260,20141660:20263480,20141661:20263784,20141662:20264172,20141663:20264241,20141664:20264498,20141665:20264548,20141666:20264803,20141667:20264885,20141668:20371198,20141669:20265230,20141670:20265468,20141671:20265816,20141672:20266157,20141673:20266136,20141674:20266318,20141675:20266424,20141676:20266608,20141677:20266712,20141678:20372241,20141679:20266931,20141680:2014214', 'assoc_mat': '20140596:autre:4230:20256813,20140597:autre:4230:20257030,20140598:autre:4230:20257198,20140599:autre:4230:20257273,20140600:autre:4230:20257421,20140602:autre:4230:20141037,20140603:autre:4230:20140918,20140832:autre:4230:20257735,20140833:autre:4230:20257775,20140835:autre:4230:20258168,20140836:autre:4230:20258254,20140837:autre:4230:20435780,20140839:autre:4230:20259157,20140840:autre:4230:20259057,20140841:autre:4230:20259115,20140842:autre:4230:20362988,20140843:autre:4230:20259666,20140844:autre:4230:20260537,20140845:autre:4230:20260144,20140846:autre:4230:20260480,20140847:autre:4230:20260651,20140848:autre:4230:20260856,20140849:autre:4230:20363623,20140850:autre:4230:20141407,20140851:autre:4230:20140953,20140852:autre:4230:20141226,20141296:autre:4230:20261889,20141297:autre:4230:20262215,20141298:autre:4230:20261832,20141299:autre:4230:20261773,20141300:autre:4230:20262176,20141301:autre:4230:20363531,20141302:autre:4230:20141731,20141657:autre:4230:20263090,20141658:autre:4230:20262856,20141659:'}, {'unwanted_material': 'carton', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.030385603058127545, 'nb_photo': 113606, 'list_port_cont': '20140912,20140958,20141033,20141230,20141419,20141737,20141858,20142146,20142317,20142496,20142551,20142644,20142841,20142951,20143111,20143257,20143451,20143501,20143541,20143678,20143760,20143836,20143884,20143937,20143976,20144083,20144119,20144155,20144275,20144398,20144447,20144567,20144697,20144789,20144858,20144932,20145003,20145091,20145236,20145328,20145389,20145458,20145568,20145710,20145847,20145947,20145984,20146088,20146231,20146369,20146506,20146566,20146657,20146841,20146873,20147034,20147105,20147145,20147172,20147215,20147256,20147298,20147334,20147476,20147560,20147592,20147645,20147683,20147728,20147843,20147909,20147948,20147991,20148099,20148142,20148250,20148365,20148400,20148512,20148539,20148626,20148729,20148804,20148891,20148926,20148960,20149033,20149074,20149102,20149235,20149290,20149328,20149376,20149562,20149645,20149706,20149759,20149903,20149981,20150075,20150110,20150220,20150352,20150430,20150472,20150508,20150656,20150815,20150890,20150930,20151011,20162792,20162866,2016291', 'assoc_port': '20140596:20256816,20140597:20257046,20140598:20257205,20140599:20257285,20140600:20257423,20140602:20141033,20140603:20140912,20140832:20257730,20140833:20257770,20140835:20258175,20140836:20258253,20140837:20435789,20140839:20259168,20140840:20259067,20140841:20259130,20140842:20363003,20140843:20259657,20140844:20260550,20140845:20260142,20140846:20260485,20140847:20260649,20140848:20260846,20140849:20363618,20140850:20141419,20140851:20140958,20140852:20141230,20141296:20261898,20141297:20262212,20141298:20261836,20141299:20261788,20141300:20262165,20141301:20363535,20141302:20141737,20141657:20263091,20141658:20262866,20141659:20263269,20141660:20263484,20141661:20263795,20141662:20264179,20141663:20264252,20141664:20264507,20141665:20264535,20141666:20264808,20141667:20264877,20141668:20371221,20141669:20265226,20141670:20265481,20141671:20265829,20141672:20266169,20141673:20266130,20141674:20266319,20141675:20266414,20141676:20266616,20141677:20266706,20141678:20372251,20141679:20266936,20141680:2014214', 'assoc_mat': '20140596:carton:4230:20256816,20140597:carton:4230:20257046,20140598:carton:4230:20257205,20140599:carton:4230:20257285,20140600:carton:4230:20257423,20140602:carton:4230:20141033,20140603:carton:4230:20140912,20140832:carton:4230:20257730,20140833:carton:4230:20257770,20140835:carton:4230:20258175,20140836:carton:4230:20258253,20140837:carton:4230:20435789,20140839:carton:4230:20259168,20140840:carton:4230:20259067,20140841:carton:4230:20259130,20140842:carton:4230:20363003,20140843:carton:4230:20259657,20140844:carton:4230:20260550,20140845:carton:4230:20260142,20140846:carton:4230:20260485,20140847:carton:4230:20260649,20140848:carton:4230:20260846,20140849:carton:4230:20363618,20140850:carton:4230:20141419,20140851:carton:4230:20140958,20140852:carton:4230:20141230,20141296:carton:4230:20261898,20141297:carton:4230:20262212,20141298:carton:4230:20261836,20141299:carton:4230:20261788,20141300:carton:4230:20262165,20141301:carton:4230:20363535,20141302:carton:4230:20141737,20141657:carton:4230:20263091,2014'}, {'unwanted_material': 'metal', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.004915529001885848, 'nb_photo': 4056, 'list_port_cont': '20140923,20140959,20141032,20141235,20141405,20141736,20141856,20142147,20142308,20142537,20143109,20143258,20143453,20143491,20143535,20143669,20143745,20143839,20143878,20143935,20143972,20144077,20144124,20144151,20144278,20144399,20144449,20144576,20144689,20144792,20144863,20144931,20144990,20145095,20145223,20145336,20145373,20145454,20145575,20145695,20145845,20145954,20145983,20146089,20146219,20146367,20146508,20146567,20146646,20146831,20146877,20147036,20147107,20147138,20147180,20147205,20147255,20147289,20147325,20147469,20147549,20147591,20147643,20147684,20147724,20147837,20147906,20147943,20148084,20148138,20148258,20148406,20148516,20148613,20148737,20148800,20148888,20148933,20148965,20149024,20149062,20149224,20149293,20149312,20149368,20149559,20149639,20149762,20149890,20149986,20150076,20150105,20150217,20150350,20150469,20150500,20150827,20150901,20150924,20151012,20162798,20162875,20162974,20163058,20163313,20163419,20163766,20163905,20164051,20164908,20165676,20165824,20166235,2016752', 'assoc_port': '20140596:20256807,20140597:20257044,20140599:20257280,20140600:20257418,20140602:20141032,20140603:20140923,20140832:20257732,20140833:20257768,20140835:20258163,20140837:20435791,20140839:20259158,20140840:20259053,20140841:20259124,20140843:20259663,20140844:20260541,20140845:20260135,20140846:20260484,20140847:20260650,20140848:20260849,20140849:20363621,20140850:20141405,20140851:20140959,20140852:20141235,20141296:20261899,20141297:20262214,20141298:20261839,20141299:20261778,20141300:20262170,20141301:20363548,20141302:20141736,20141657:20263089,20141659:20263266,20141660:20263487,20141661:20263786,20141662:20264184,20141663:20264248,20141664:20264505,20141665:20264538,20141666:20264798,20141667:20264879,20141668:20371223,20141670:20265474,20141671:20265818,20141672:20266160,20141673:20266134,20141674:20266306,20141675:20266420,20141676:20266611,20141677:20266697,20141678:20372238,20141679:20266921,20141680:20142147,20141681:20141856,20142049:20267222,20142050:20267576,20142051:20267929,20142052:2026807', 'assoc_mat': '20140596:metal:4230:20256807,20140597:metal:4230:20257044,20140599:metal:4230:20257280,20140600:metal:4230:20257418,20140602:metal:4230:20141032,20140603:metal:4230:20140923,20140832:metal:4230:20257732,20140833:metal:4230:20257768,20140835:metal:4230:20258163,20140837:metal:4230:20435791,20140839:metal:4230:20259158,20140840:metal:4230:20259053,20140841:metal:4230:20259124,20140843:metal:4230:20259663,20140844:metal:4230:20260541,20140845:metal:4230:20260135,20140846:metal:4230:20260484,20140847:metal:4230:20260650,20140848:metal:4230:20260849,20140849:metal:4230:20363621,20140850:metal:4230:20141405,20140851:metal:4230:20140959,20140852:metal:4230:20141235,20141296:metal:4230:20261899,20141297:metal:4230:20262214,20141298:metal:4230:20261839,20141299:metal:4230:20261778,20141300:metal:4230:20262170,20141301:metal:4230:20363548,20141302:metal:4230:20141736,20141657:metal:4230:20263089,20141659:metal:4230:20263266,20141660:metal:4230:20263487,20141661:metal:4230:20263786,20141662:metal:4230:20264184,20141663:'}, {'unwanted_material': 'papier', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.10159311143251597, 'nb_photo': 305919, 'list_port_cont': '20140919,20140960,20141035,20141232,20141414,20141729,20141859,20142152,20142319,20142502,20142545,20142651,20142834,20142943,20143106,20143260,20143448,20143505,20143546,20143674,20143757,20143838,20143885,20143931,20143967,20144079,20144123,20144161,20144281,20144391,20144446,20144581,20144699,20144790,20144860,20144917,20145005,20145086,20145228,20145323,20145378,20145457,20145574,20145707,20145840,20145952,20145981,20146091,20146233,20146362,20146514,20146560,20146655,20146839,20146876,20147032,20147101,20147141,20147174,20147220,20147252,20147297,20147329,20147475,20147559,20147593,20147650,20147680,20147737,20147844,20147911,20147951,20147978,20148098,20148145,20148248,20148362,20148392,20148515,20148549,20148625,20148736,20148807,20148885,20148931,20148966,20149039,20149075,20149112,20149232,20149284,20149381,20149575,20149644,20149707,20149770,20149902,20149997,20150085,20150114,20150228,20150353,20150431,20150461,20150511,20150652,20150821,20150903,20150928,20151005,20162791,20162867,20162907,2016298', 'assoc_port': '20140596:20256809,20140597:20257040,20140598:20257202,20140599:20257286,20140600:20257424,20140602:20141035,20140603:20140919,20140832:20257733,20140833:20257774,20140835:20258173,20140836:20258255,20140837:20435794,20140839:20259169,20140840:20259064,20140841:20259129,20140842:20363000,20140843:20259671,20140844:20260545,20140845:20260141,20140846:20260488,20140847:20260652,20140848:20260841,20140849:20363610,20140850:20141414,20140851:20140960,20140852:20141232,20141296:20261897,20141297:20262204,20141298:20261837,20141299:20261783,20141300:20262178,20141301:20363541,20141302:20141729,20141657:20263098,20141658:20262864,20141659:20263267,20141660:20263494,20141661:20263797,20141662:20264181,20141663:20264254,20141664:20264508,20141665:20264547,20141666:20264805,20141667:20264888,20141668:20371222,20141669:20265231,20141670:20265475,20141671:20265830,20141672:20266164,20141673:20266129,20141674:20266315,20141675:20266418,20141676:20266613,20141677:20266713,20141678:20372246,20141679:20266938,20141680:2014215', 'assoc_mat': '20140596:papier:4230:20256809,20140597:papier:4230:20257040,20140598:papier:4230:20257202,20140599:papier:4230:20257286,20140600:papier:4230:20257424,20140602:papier:4230:20141035,20140603:papier:4230:20140919,20140832:papier:4230:20257733,20140833:papier:4230:20257774,20140835:papier:4230:20258173,20140836:papier:4230:20258255,20140837:papier:4230:20435794,20140839:papier:4230:20259169,20140840:papier:4230:20259064,20140841:papier:4230:20259129,20140842:papier:4230:20363000,20140843:papier:4230:20259671,20140844:papier:4230:20260545,20140845:papier:4230:20260141,20140846:papier:4230:20260488,20140847:papier:4230:20260652,20140848:papier:4230:20260841,20140849:papier:4230:20363610,20140850:papier:4230:20141414,20140851:papier:4230:20140960,20140852:papier:4230:20141232,20141296:papier:4230:20261897,20141297:papier:4230:20262204,20141298:papier:4230:20261837,20141299:papier:4230:20261783,20141300:papier:4230:20262178,20141301:papier:4230:20363541,20141302:papier:4230:20141729,20141657:papier:4230:20263098,2014'}, {'unwanted_material': 'pehd', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.002278633600684754, 'nb_photo': 1489, 'list_port_cont': '20140925,20141031,20142550,20144113,20147029,20147109,20147250,20149291,20149377,20149631,20150078,20150470,20150506,20150653,20150816,20150938,20178866,20180384,20182608,20183637,20184614,20186419,20187142,20187609,20192864,20195378,20195573,20196117,20196313,20196528,20211329,20220117,20239893,20239935,20240706,20242205,20242285,20244346,20256815,20257036,20257586,20257736,20258179,20259166,20261895,20262210,20264185,20265831,20266581,20268689,20268922,20271192,20278144,20278193,20278301,20278751,20279405,20287665,20287726,20289115,20289763,20292761,20295368,20298068,20300346,20301695,20306759,20307606,20309281,20309647,20312457,20313466,20313677,20314024,20314164,20314292,20314513,20315166,20317878,20319598,20321438,20324226,20333551,20334151,20334444,20336454,20337270,20338767,20344199,20346953,20347089,20348333,20349323,20350228,20351335,20352379,20352444,20353460,20354037,20354251,20359098,20359159,20359294,20359350,20362088,20362406,20362627,20362860,20363130,20363539,20363689,20363850,20363976,2036458', 'assoc_port': '20140596:20256815,20140597:20257036,20140602:20141031,20140603:20140925,20140832:20257736,20140835:20258179,20140837:20435784,20140839:20259166,20141296:20261895,20141297:20262210,20141301:20363539,20141662:20264185,20141671:20265831,20142057:20268689,20142058:20268922,20142063:20373775,20142457:20150938,20142458:20150506,20142459:20150653,20142460:20150816,20142462:20150470,20142467:20142550,20142784:20150078,20142789:20149631,20142792:20149377,20142794:20149291,20143402:20147250,20143406:20147109,20143698:20147029,20143823:20144113,20162665:20292761,20178460:20180384,20178463:20182608,20178464:20178866,20182964:20183637,20182966:20184614,20185150:20187142,20185152:20186419,20187253:20407789,20187256:20319598,20187263:20187609,20190539:20192864,20195295:20196117,20195298:20195573,20195300:20195378,20196010:20196528,20196011:20196313,20210198:20352379,20210200:20352444,20210823:20353460,20210829:20211329,20211509:20354037,20215645:20354251,20216822:20220117,20236816:20359098,20236817:20359159,20236818:2035929', 'assoc_mat': '20140596:pehd:4230:20256815,20140597:pehd:4230:20257036,20140602:pehd:4230:20141031,20140603:pehd:4230:20140925,20140832:pehd:4230:20257736,20140835:pehd:4230:20258179,20140837:pehd:4230:20435784,20140839:pehd:4230:20259166,20141296:pehd:4230:20261895,20141297:pehd:4230:20262210,20141301:pehd:4230:20363539,20141662:pehd:4230:20264185,20141671:pehd:4230:20265831,20142057:pehd:4230:20268689,20142058:pehd:4230:20268922,20142063:pehd:4230:20373775,20142457:pehd:4230:20150938,20142458:pehd:4230:20150506,20142459:pehd:4230:20150653,20142460:pehd:4230:20150816,20142462:pehd:4230:20150470,20142467:pehd:4230:20142550,20142784:pehd:4230:20150078,20142789:pehd:4230:20149631,20142792:pehd:4230:20149377,20142794:pehd:4230:20149291,20143402:pehd:4230:20147250,20143406:pehd:4230:20147109,20143698:pehd:4230:20147029,20143823:pehd:4230:20144113,20162665:pehd:4230:20292761,20178460:pehd:4230:20180384,20178463:pehd:4230:20182608,20178464:pehd:4230:20178866,20182964:pehd:4230:20183637,20182966:pehd:4230:20184614,20185150:pehd:42'}, {'unwanted_material': 'pet_clair', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.009948184618746149, 'nb_photo': 39644, 'list_port_cont': '20140922,20140952,20141025,20141236,20141418,20141735,20141865,20142156,20142313,20142493,20142548,20142643,20142835,20142949,20143117,20143271,20143449,20143504,20143539,20143673,20143761,20143833,20143881,20143932,20143971,20144085,20144114,20144164,20144280,20144394,20144454,20144571,20144701,20144787,20144859,20144929,20144999,20145092,20145227,20145330,20145388,20145459,20145578,20145709,20145846,20145946,20145994,20146093,20146227,20146365,20146511,20146556,20146647,20146833,20146878,20147028,20147100,20147135,20147178,20147218,20147258,20147294,20147332,20147464,20147556,20147597,20147649,20147678,20147739,20147846,20147918,20147955,20147988,20148096,20148144,20148255,20148366,20148404,20148509,20148544,20148619,20148728,20148809,20148896,20148934,20148970,20149041,20149070,20149105,20149231,20149289,20149325,20149382,20149573,20149635,20149715,20149774,20149906,20149993,20150071,20150120,20150229,20150356,20150428,20150464,20150509,20150659,20150823,20150899,20150937,20151008,20162788,20162878,2016290', 'assoc_port': '20140596:20256808,20140597:20257047,20140598:20257207,20140599:20257278,20140600:20257417,20140602:20141025,20140603:20140922,20140832:20257738,20140833:20257771,20140835:20258170,20140836:20258245,20140837:20435796,20140839:20259159,20140840:20259069,20140841:20259132,20140842:20362997,20140843:20259667,20140844:20260553,20140845:20260146,20140846:20260491,20140847:20260659,20140848:20260857,20140849:20363612,20140850:20141418,20140851:20140952,20140852:20141236,20141296:20261890,20141297:20262201,20141298:20261835,20141299:20261774,20141300:20262171,20141301:20363540,20141302:20141735,20141657:20263096,20141658:20262865,20141659:20263276,20141660:20263483,20141661:20263796,20141662:20264182,20141663:20264249,20141664:20264497,20141665:20264537,20141666:20264797,20141667:20264882,20141668:20371212,20141669:20265221,20141670:20265477,20141671:20265826,20141672:20266161,20141673:20266135,20141674:20266317,20141675:20266425,20141676:20266618,20141677:20266711,20141678:20372255,20141679:20266935,20141680:2014215', 'assoc_mat': '20140596:pet_clair:4230:20256808,20140597:pet_clair:4230:20257047,20140598:pet_clair:4230:20257207,20140599:pet_clair:4230:20257278,20140600:pet_clair:4230:20257417,20140602:pet_clair:4230:20141025,20140603:pet_clair:4230:20140922,20140832:pet_clair:4230:20257738,20140833:pet_clair:4230:20257771,20140835:pet_clair:4230:20258170,20140836:pet_clair:4230:20258245,20140837:pet_clair:4230:20435796,20140839:pet_clair:4230:20259159,20140840:pet_clair:4230:20259069,20140841:pet_clair:4230:20259132,20140842:pet_clair:4230:20362997,20140843:pet_clair:4230:20259667,20140844:pet_clair:4230:20260553,20140845:pet_clair:4230:20260146,20140846:pet_clair:4230:20260491,20140847:pet_clair:4230:20260659,20140848:pet_clair:4230:20260857,20140849:pet_clair:4230:20363612,20140850:pet_clair:4230:20141418,20140851:pet_clair:4230:20140952,20140852:pet_clair:4230:20141236,20141296:pet_clair:4230:20261890,20141297:pet_clair:4230:20262201,20141298:pet_clair:4230:20261835,20141299:pet_clair:4230:20261774,20141300:pet_clair:4230:20262171,2'}, {'unwanted_material': 'pet_fonce', 'main_material': 'truck', 'pht_type': 4230, 'ratio': 0.1026244355772286, 'nb_photo': 3247, 'list_port_cont': '20140920,20141857,20142150,20142318,20142494,20142549,20142646,20142950,20143118,20143270,20143452,20143496,20143542,20143677,20143759,20143848,20144089,20144122,20144276,20144444,20144698,20144793,20144933,20145001,20145088,20145233,20145331,20145385,20145451,20145581,20145831,20145951,20145986,20146082,20146230,20146361,20146505,20146558,20146651,20146828,20146871,20147033,20147093,20147140,20147173,20147219,20147257,20147291,20147328,20147461,20147546,20147596,20147644,20147686,20147730,20147835,20147904,20147954,20147987,20148094,20148146,20148249,20148364,20148394,20148503,20148542,20148621,20148730,20148803,20148892,20148930,20148969,20149031,20149063,20149115,20149225,20149283,20149316,20149374,20149571,20149642,20149704,20149772,20149894,20149990,20150079,20150113,20150227,20150435,20150467,20150824,20150892,20150939,20151004,20166488,20168414,20180383,20187136,20188276,20188917,20190643,20193024,20195382,20195505,20195584,20196122,20196300,20196527,20197497,20199044,20209179,20209974,20210088,2021795', 'assoc_port': '20140596:20256812,20140597:20257045,20140603:20140920,20140832:20257728,20140837:20435781,20140841:20259126,20140844:20260552,20140846:20260487,20140847:20260657,20141296:20261901,20141297:20262209,20141300:20262177,20141670:20265471,20141671:20265820,20141672:20266168,20141673:20266124,20141674:20266314,20141679:20266937,20141680:20142150,20141681:20141857,20142050:20267580,20142051:20267936,20142052:20268072,20142054:20476260,20142055:20268509,20142056:20268589,20142061:20269887,20142062:20270231,20142063:20373774,20142064:20270311,20142065:20142494,20142066:20270346,20142067:20142318,20142453:20151004,20142454:20372175,20142455:20270657,20142456:20150892,20142457:20150939,20142460:20150824,20142461:20284131,20142462:20150467,20142463:20150435,20142466:20142646,20142467:20142549,20142783:20150113,20142784:20150079,20142785:20149772,20142786:20149894,20142787:20149990,20142788:20149704,20142789:20149642,20142790:20150227,20142791:20149316,20142792:20149374,20142793:20143118,20142794:20149283,20142795:2014295', 'assoc_mat': '20140596:pet_fonce:4230:20256812,20140597:pet_fonce:4230:20257045,20140603:pet_fonce:4230:20140920,20140832:pet_fonce:4230:20257728,20140837:pet_fonce:4230:20435781,20140841:pet_fonce:4230:20259126,20140844:pet_fonce:4230:20260552,20140846:pet_fonce:4230:20260487,20140847:pet_fonce:4230:20260657,20141296:pet_fonce:4230:20261901,20141297:pet_fonce:4230:20262209,20141300:pet_fonce:4230:20262177,20141670:pet_fonce:4230:20265471,20141671:pet_fonce:4230:20265820,20141672:pet_fonce:4230:20266168,20141673:pet_fonce:4230:20266124,20141674:pet_fonce:4230:20266314,20141679:pet_fonce:4230:20266937,20141680:pet_fonce:4230:20142150,20141681:pet_fonce:4230:20141857,20142050:pet_fonce:4230:20267580,20142051:pet_fonce:4230:20267936,20142052:pet_fonce:4230:20268072,20142054:pet_fonce:4230:20476260,20142055:pet_fonce:4230:20268509,20142056:pet_fonce:4230:20268589,20142061:pet_fonce:4230:20269887,20142062:pet_fonce:4230:20270231,20142063:pet_fonce:4230:20373774,20142064:pet_fonce:4230:20270311,20142065:pet_fonce:4230:20142494,2'}), 'main_stat': {'nb_photos': 8315}}, 'hostname': (('raspi-84',),), 'impurety_average_per_hashtag': []} filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_02_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11939 matching_dashboard is not consistent : 1 used against 0 in the step definition ! Step 11940 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 0 of step 11939 doesn't seem to be define in the database( WARNING : type of input 2 of step 11940 doesn't seem to be define in the database( DataTypes for each output/input checked ! None was removed should we ? None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'truck': {'autre': ['autre', '6.7%', 111368], 'carton': ['carton', '3.04%', 113606], 'metal': ['metal', '0.49%', 4056], 'papier': ['papier', '10.16%', 305919], 'pehd': ['pehd', '0.23%', 1489], 'pet_clair': ['pet_clair', '0.99%', 39644], 'pet_fonce': ['pet_fonce', '10.26%', 3247]}} before organize_and_plot_coverage_data Warning a wrong coverage has been found : 0.0 before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/dechet_Valcor_v2/sla_mensuel_dechet_Valcor_v2_mois_02_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/dechet_Valcor_v2 3.07user 2.45system 0:20.64elapsed 26%CPU (0avgtext+0avgdata 195712maxresident)k 200inputs+528outputs (0major+62634minor)pagefaults 0swaps