python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py --job=sla_mensuel --raspi=20062 --dashboard_places=arc_en_ciel_jrm_peu_dense --rootfolder_sla=/data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense -v --mtr_id=979 --date=`date -d"$nowdate 15 day ago" +%Y-%m` ' -s sla_mensuel -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) Need env var : LOGRASPI Raspi : 20062, Date : 2025-02 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier Fonction SLA_MENSUEL nb_day : (5, 28) VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier place_id : 25 month : 02 mtr_id : 979 dashboard_places : arc_en_ciel_jrm_peu_dense date : 2025-02 year : 2025 raspi : 20062 select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select id from MTRUser.mtr_portfolios where id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id in (select id from MTRPhoto.dashboard_places where name = 'arc_en_ciel_jrm_peu_dense' and date like '%2025-02%') and created_at like '%2025-02%'))); nb_day : (5, 28) after unwanted_material_data nb_day : (5, 28) SQL: SELECT ms.id, ms.name, mst.name as type, ms.test_group, ms.test_name, ms.server, ms.version_code, ms.result_str, ms.result_bool, ms.result_float, ms.lien, ms.created_at FROM MTRAdmin.monitor_sys ms INNER JOIN MTRAdmin.monitor_sys_type mst on mst.id = ms.type WHERE ms.test_name like '%20062%' AND ms.result_str like '%2025/02%'ORDER BY ms.id desc LIMIT 0, 1000000; Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! Missing day sla_per_day needs to be called ! We will need to call the sla_per_day for these missing days : 2025-02-01 00:00:00,2025-02-03 00:00:00,2025-02-04 00:00:00,2025-02-05 00:00:00,2025-02-06 00:00:00,2025-02-07 00:00:00,2025-02-08 00:00:00,2025-02-10 00:00:00,2025-02-11 00:00:00,2025-02-12 00:00:00,2025-02-13 00:00:00,2025-02-14 00:00:00,2025-02-15 00:00:00,2025-02-17 00:00:00,2025-02-18 00:00:00,2025-02-19 00:00:00,2025-02-20 00:00:00,2025-02-21 00:00:00,2025-02-22 00:00:00,2025-02-24 00:00:00,2025-02-25 00:00:00,2025-02-26 00:00:00,2025-02-27 00:00:00,2025-02-28 00:00:00 after coverage_data SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and ded.dashboard_place_id = 25 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; SELECT DATE(date_debut) as date, sum(qualite*nombre_balle)/sum(nombre_balle), count(distinct mtr_photo_id) FROM MTRPhoto.dashboard_results dr, MTRUser.mtr_portfolio_photos mpp, MTRPhoto.dashboard_entry_day ded where mpp.mtr_portfolio_id=dr.mtr_portfolio_id and dr.hashtag = '_______JRM' and ded.dashboard_place_id = 25 and month(ded.date) = 02 and year(ded.date) = 2025 and dr.dashboard_run_id=ded.last_run_id and dr.qualite>=0 GROUP BY ded.date order by dr.date_debut; select avg(cps.score) as score, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'__', -1), '_', 1) as sbstr, SUBSTRING_INDEX(SUBSTRING_INDEX(mp.name,'_', -2), '_', 1) as sbstr2, SUBSTRING_INDEX(mp.name,'_', -1) as sbstr3 FROM MTRUser.mtr_portfolio_photos mpp, MTRUser.mtr_portfolios mp,MTRPhoto.class_photo_score cps,MTRBack.hashtags h,MTRPhoto.dashboard_results dr,MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE mp.id=mpp.mtr_portfolio_id and cps.photo_id=mpp.mtr_photo_id and h.hashtag_id=cps.hashtag_id and dr.mtr_portfolio_id = mpp.mtr_portfolio_id and dr.dashboard_run_id = ded.last_run_id and ded.dashboard_place_id = dp.id and h.hashtag in ('blur', 'mean_blur', 'clear') and dp.id = 25 and mp.name like '%022025%' and cps.thcl = 1533 GROUP BY sbstr ; after number_of_batch date_start : 2025-02-01 : dt_date_just_month_year : 2025-02-01 00:00:00 : VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! Error parsing crontab ! [Errno 2] No such file or directory: '' You better check your LOGRASPI env !!! after pl.get_datou_sts_from_crontab : verbose : True no sts found, try to find from database SELECT dri.id FROM MTRPhoto.dashboard_run_ids dri, MTRPhoto.dashboard_entry_day ded, MTRPhoto.dashboard_places dp WHERE dp.name= "arc_en_ciel_jrm_peu_dense" AND ded.dashboard_place_id=dp.id AND dri.dashboard_entry_day=ded.id AND dri.id=ded.last_run_id AND ded.date >= "2025-02-01" AND ded.date <= "2025-02-28" apple3 {'JRM': {'mat': 'JRM', 'pht': 3726, 'datou_carac_id': 3459, 'unwanted_material': [], 'hashtag_majoritaire_from_carac': 'papier'}} SELECT h.hashtag as unwanted_material, substr(dr.hashtag,8) as main_material, ptp.type as pht_type, sum(pcr.value*dr.nombre_balle)/sum(dr.nombre_balle) as ratio, count(distinct mpp.mtr_photo_id) as nb_photo, group_concat(distinct ptp.mtr_portfolio_id_2) as list_port_cont, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_port, group_concat(distinct concat(cast(ptp.mtr_portfolio_id_1 as char), ":", h.hashtag, ":", cast(ptp.type as char), ":", cast(ptp.mtr_portfolio_id_2 as char))) as assoc_mat FROM MTRPhoto.dashboard_results dr, MTRPhoto.mtr_port_to_port_ids ptp, MTRUser.mtr_portfolio_photos mpp, MTRUser.portfolio_carac_ratio pcr, MTRBack.hashtags h WHERE dr.dashboard_run_id IN (1579645,1581541,1583734,1586735,1590200,1593218,1596115,1597462,1605371,1600978,1604875,1607811,1610839,1613689,1614383) AND dr.mtr_portfolio_id=ptp.mtr_portfolio_id_1 AND dr.qualite >= 0 AND mpp.mtr_portfolio_id=ptp.mtr_portfolio_id_2 AND pcr.portfolio_id=ptp.mtr_portfolio_id_1 AND h.hashtag_id = pcr.hashtag_id AND ptp.type = pcr.hashtag_type AND mpp.hide_status = 0 AND ptp.hashtag_id=h.hashtag_id group by h.hashtag, dr.hashtag, ptp.type; VR TODO TO BETTER PARSE ! ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0067290292957817004, 'nb_photo': 326, 'list_port_cont': '20137970,20139118,20139205,20139328,20139439,20139664,20140079,20140203,20140549,20140781,20141449,20141576,20142003,20142588,20143208,20143427,20143915,20144010,20144185,20172759,20173357,20175129,20177641,20188753,20190756,20195318,20196455,20199217,20203499,20206085,20209137,20210431,20212710,20214124,20222091,20222968,20226980,20227408,20227823,20227889,20229165,20231333,20231856,20232423,20233883,20234034,20246949,20247926,20248616,20249062,20251811,20252027,20253289,20254311,20255979,20256677,20257173,20257352,20260077,20260422,20262639,20267174,20268433,20269131,20275121,20275248,20276935,20276972,20277294,20292948,20293615,20294377,20295402,20300536,20300756,20303366,20308062,20311291,20313619,20314201,20324664,20325629,20328033,20329337,20333780,20334119,20334628,20335730,20339165,20339460,20341277,20343489,20343569,20343605,20344299,20347999,20350855,20351168,20358682,20358990,20359939,20360195,20360299,20360737,20360888,20360899,20361777,20361797,20362009,20392431,20394709,20395028,20395213,2039762', 'assoc_port': '20137964:20137970,20138425:20144185,20138426:20144010,20138427:20143915,20139056:20139118,20139200:20139205,20139318:20139328,20139389:20139439,20139549:20139664,20140005:20140079,20140122:20140203,20140506:20140549,20140742:20140781,20141169:20143208,20141364:20141449,20141528:20141576,20141995:20142003,20142523:20142588,20143389:20143427,20172044:20172759,20172870:20173357,20174066:20190756,20174067:20175129,20175420:20188753,20177161:20177641,20194943:20234034,20194945:20233883,20194949:20203499,20194951:20199217,20194954:20196455,20194961:20195318,20205161:20206085,20207272:20210431,20207273:20209137,20211703:20212710,20213264:20214124,20217072:20222091,20222896:20222968,20222897:20227408,20222898:20227823,20226864:20226980,20227864:20227889,20229146:20229165,20230568:20231333,20231750:20231856,20232251:20232423,20246747:20246949,20247805:20247926,20248588:20248616,20248590:20249062,20251768:20252027,20251769:20251811,20253236:20254311,20253238:20253289,20254520:20257352,20255781:20255979,20256548:2025667', 'assoc_mat': '20137964:autre_refus:3726:20137970,20138425:autre_refus:3726:20144185,20138426:autre_refus:3726:20144010,20138427:autre_refus:3726:20143915,20139056:autre_refus:3726:20139118,20139200:autre_refus:3726:20139205,20139318:autre_refus:3726:20139328,20139389:autre_refus:3726:20139439,20139549:autre_refus:3726:20139664,20140005:autre_refus:3726:20140079,20140122:autre_refus:3726:20140203,20140506:autre_refus:3726:20140549,20140742:autre_refus:3726:20140781,20141169:autre_refus:3726:20143208,20141364:autre_refus:3726:20141449,20141528:autre_refus:3726:20141576,20141995:autre_refus:3726:20142003,20142523:autre_refus:3726:20142588,20143389:autre_refus:3726:20143427,20172044:autre_refus:3726:20172759,20172870:autre_refus:3726:20173357,20174066:autre_refus:3726:20190756,20174067:autre_refus:3726:20175129,20175420:autre_refus:3726:20188753,20177161:autre_refus:3726:20177641,20194943:autre_refus:3726:20234034,20194945:autre_refus:3726:20233883,20194949:autre_refus:3726:20203499,20194951:autre_refus:3726:20199217,20194954:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006783097436853527, 'nb_photo': 724, 'list_port_cont': '20137974,20138539,20138856,20138953,20139125,20139212,20139323,20139668,20140030,20140206,20140555,20140789,20141181,20141448,20141567,20141839,20142006,20143218,20143432,20143736,20144016,20172033,20172760,20172881,20175126,20176119,20188755,20194964,20196026,20196666,20197193,20199219,20200764,20202906,20203348,20203507,20206084,20206486,20206637,20209136,20210123,20210437,20211294,20213398,20214771,20215679,20217158,20218070,20220343,20220943,20222092,20222970,20224727,20225333,20225911,20226256,20226978,20227405,20227817,20231775,20232390,20232426,20233872,20234038,20234522,20234588,20246788,20246945,20247927,20249060,20252026,20253279,20254314,20254678,20257165,20257347,20257848,20258234,20262353,20262633,20262781,20267176,20267547,20267911,20268042,20268259,20269128,20272402,20272733,20272912,20273049,20273084,20273455,20275123,20275257,20275730,20276256,20276888,20276975,20277189,20277295,20293243,20293442,20293613,20294375,20294488,20294928,20295394,20295404,20300383,20300617,20300632,20300720,2030075', 'assoc_port': '20137964:20137974,20138426:20144016,20138516:20138539,20138772:20138856,20138915:20143736,20138916:20138953,20139056:20139125,20139200:20139212,20139318:20139323,20139549:20139668,20140004:20140030,20140122:20140206,20140506:20140555,20140742:20140789,20141169:20143218,20141170:20141181,20141364:20141448,20141528:20141567,20141794:20141839,20141995:20142006,20143389:20143432,20170850:20172033,20172043:20172881,20172044:20172760,20174067:20175126,20175420:20188755,20175421:20176119,20194938:20234588,20194939:20234522,20194941:20203348,20194943:20234038,20194944:20233872,20194949:20203507,20194950:20200764,20194951:20199219,20194955:20196666,20194956:20197193,20194957:20196026,20194960:20194964,20201732:20202906,20205158:20211294,20205159:20206486,20205160:20206637,20205161:20206084,20207272:20210437,20207273:20209136,20207275:20210123,20213265:20213398,20214646:20215679,20214647:20214771,20217072:20222092,20217073:20217158,20217074:20218070,20218531:20220943,20220318:20220343,20222896:20222970,20222897:2022740', 'assoc_mat': '20137964:cartonnette:3726:20137974,20138426:cartonnette:3726:20144016,20138516:cartonnette:3726:20138539,20138772:cartonnette:3726:20138856,20138915:cartonnette:3726:20143736,20138916:cartonnette:3726:20138953,20139056:cartonnette:3726:20139125,20139200:cartonnette:3726:20139212,20139318:cartonnette:3726:20139323,20139549:cartonnette:3726:20139668,20140004:cartonnette:3726:20140030,20140122:cartonnette:3726:20140206,20140506:cartonnette:3726:20140555,20140742:cartonnette:3726:20140789,20141169:cartonnette:3726:20143218,20141170:cartonnette:3726:20141181,20141364:cartonnette:3726:20141448,20141528:cartonnette:3726:20141567,20141794:cartonnette:3726:20141839,20141995:cartonnette:3726:20142006,20143389:cartonnette:3726:20143432,20170850:cartonnette:3726:20172033,20172043:cartonnette:3726:20172881,20172044:cartonnette:3726:20172760,20174067:cartonnette:3726:20175126,20175420:cartonnette:3726:20188755,20175421:cartonnette:3726:20176119,20194938:cartonnette:3726:20234588,20194939:cartonnette:3726:20234522,20194941:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007564944827471116, 'nb_photo': 400, 'list_port_cont': '20137746,20138540,20138849,20138954,20139207,20139332,20139433,20139669,20140075,20140196,20140546,20140791,20141178,20141445,20141569,20141845,20142585,20143739,20143911,20144013,20171471,20175123,20194974,20201711,20206491,20206638,20209253,20210435,20211792,20214129,20215683,20218068,20222081,20225336,20226983,20227410,20227819,20231323,20232400,20234043,20246782,20248609,20249061,20252030,20254315,20255982,20257355,20258758,20260415,20262354,20262638,20262788,20268043,20268442,20269129,20270508,20272916,20273085,20275122,20275255,20276882,20276971,20277192,20292944,20293245,20293443,20293624,20294383,20294480,20294924,20295415,20300378,20300531,20300626,20300639,20301260,20301566,20303372,20308067,20309822,20311293,20312170,20313610,20313717,20324658,20329072,20329334,20334120,20339169,20339961,20340382,20341274,20343101,20343210,20343483,20343577,20343596,20344301,20347998,20348254,20348636,20349286,20350634,20350685,20350854,20358690,20358734,20360506,20360738,20360879,20360890,20361518,20361774,2036193', 'assoc_port': '20137697:20137746,20138426:20144013,20138427:20143911,20138516:20138540,20138772:20138849,20138915:20143739,20138916:20138954,20139200:20139207,20139318:20139332,20139389:20139433,20139549:20139669,20140005:20140075,20140122:20140196,20140506:20140546,20140742:20140791,20141170:20141178,20141364:20141445,20141528:20141569,20141794:20141845,20142523:20142585,20170849:20171471,20174067:20175123,20194943:20234043,20194946:20201711,20194960:20194974,20205159:20206491,20205160:20206638,20207272:20210435,20209244:20209253,20211704:20211792,20213264:20214129,20214646:20215683,20217072:20222081,20217074:20218068,20222897:20227410,20222898:20227819,20224663:20225336,20226864:20226983,20230568:20231323,20232250:20232400,20246748:20246782,20248588:20248609,20248590:20249061,20251768:20252030,20253236:20254315,20254520:20257355,20255781:20255982,20258695:20258758,20259986:20260415,20262310:20262788,20262312:20262638,20262313:20262354,20267130:20268442,20267131:20270508,20267132:20268043,20269028:20269129,20272327:2027308', 'assoc_mat': '20137697:Carton_brun:3726:20137746,20138426:Carton_brun:3726:20144013,20138427:Carton_brun:3726:20143911,20138516:Carton_brun:3726:20138540,20138772:Carton_brun:3726:20138849,20138915:Carton_brun:3726:20143739,20138916:Carton_brun:3726:20138954,20139200:Carton_brun:3726:20139207,20139318:Carton_brun:3726:20139332,20139389:Carton_brun:3726:20139433,20139549:Carton_brun:3726:20139669,20140005:Carton_brun:3726:20140075,20140122:Carton_brun:3726:20140196,20140506:Carton_brun:3726:20140546,20140742:Carton_brun:3726:20140791,20141170:Carton_brun:3726:20141178,20141364:Carton_brun:3726:20141445,20141528:Carton_brun:3726:20141569,20141794:Carton_brun:3726:20141845,20142523:Carton_brun:3726:20142585,20170849:Carton_brun:3726:20171471,20174067:Carton_brun:3726:20175123,20194943:Carton_brun:3726:20234043,20194946:Carton_brun:3726:20201711,20194960:Carton_brun:3726:20194974,20205159:Carton_brun:3726:20206491,20205160:Carton_brun:3726:20206638,20207272:Carton_brun:3726:20210435,20209244:Carton_brun:3726:20209253,20211704:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008609438775156165, 'nb_photo': 641, 'list_port_cont': '20137745,20137978,20138850,20138955,20139203,20139322,20139432,20139670,20140033,20140082,20140202,20140554,20140784,20141182,20141441,20141574,20141837,20142593,20143210,20143425,20143732,20144019,20144189,20172041,20173347,20176118,20177644,20190750,20195327,20195717,20195774,20196032,20196459,20196663,20197187,20197670,20197692,20199223,20199867,20200766,20201708,20202901,20202974,20205992,20206086,20206639,20209132,20209252,20211288,20211803,20212703,20214761,20215676,20217161,20218067,20218563,20220146,20220352,20220937,20222975,20224726,20225341,20226258,20226987,20227404,20227822,20229155,20230601,20231328,20231778,20231854,20232429,20234041,20234152,20246785,20246950,20247259,20248614,20249045,20249063,20250424,20251803,20252024,20253288,20254312,20256681,20257174,20257345,20257841,20258227,20260078,20260417,20262360,20262785,20267175,20267546,20267908,20268255,20268437,20268446,20269124,20270500,20272396,20272722,20272906,20273057,20273082,20275254,20275472,20275727,20276251,20276885,20276973,2027718', 'assoc_port': '20137697:20137745,20137964:20137978,20138425:20144189,20138426:20144019,20138772:20138850,20138915:20143732,20138916:20138955,20139200:20139203,20139318:20139322,20139389:20139432,20139549:20139670,20140004:20140033,20140005:20140082,20140122:20140202,20140506:20140554,20140742:20140784,20141169:20143210,20141170:20141182,20141364:20141441,20141528:20141574,20141794:20141837,20142523:20142593,20143389:20143425,20170850:20172041,20172870:20173347,20174066:20190750,20175421:20176118,20177161:20177644,20194937:20205992,20194940:20234152,20194942:20202974,20194943:20234041,20194946:20201708,20194948:20199867,20194950:20200766,20194951:20199223,20194952:20197692,20194953:20197670,20194954:20196459,20194955:20196663,20194956:20197187,20194957:20196032,20194958:20195774,20194959:20195717,20194961:20195327,20201732:20202901,20205158:20211288,20205160:20206639,20205161:20206086,20207273:20209132,20209244:20209252,20211703:20212703,20211704:20211803,20214646:20215676,20214647:20214761,20217073:20217161,20217074:2021806', 'assoc_mat': '20137697:Carton_gris:3726:20137745,20137964:Carton_gris:3726:20137978,20138425:Carton_gris:3726:20144189,20138426:Carton_gris:3726:20144019,20138772:Carton_gris:3726:20138850,20138915:Carton_gris:3726:20143732,20138916:Carton_gris:3726:20138955,20139200:Carton_gris:3726:20139203,20139318:Carton_gris:3726:20139322,20139389:Carton_gris:3726:20139432,20139549:Carton_gris:3726:20139670,20140004:Carton_gris:3726:20140033,20140005:Carton_gris:3726:20140082,20140122:Carton_gris:3726:20140202,20140506:Carton_gris:3726:20140554,20140742:Carton_gris:3726:20140784,20141169:Carton_gris:3726:20143210,20141170:Carton_gris:3726:20141182,20141364:Carton_gris:3726:20141441,20141528:Carton_gris:3726:20141574,20141794:Carton_gris:3726:20141837,20142523:Carton_gris:3726:20142593,20143389:Carton_gris:3726:20143425,20170850:Carton_gris:3726:20172041,20172870:Carton_gris:3726:20173347,20174066:Carton_gris:3726:20190750,20175421:Carton_gris:3726:20176118,20177161:Carton_gris:3726:20177644,20194937:Carton_gris:3726:20205992,20194940:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.002325712217462401, 'nb_photo': 49, 'list_port_cont': '20138534,20143733,20143916,20144021,20210118,20226989,20233885,20262632,20275251,20293249,20293448,20293616,20294381,20294483,20324159,20358687,20361772,20392545,20392642,20397635,20407298,20410438,20419883,20433935,20435099,20435315,20440171,20440944,20458975,20459373,20459554,20472936,20480205,20482378,20487083,20488720,20491440,20514046,20526618,20528118,20529473,20549333,20557158,20565312,20585493', 'assoc_port': '20138426:20144021,20138427:20143916,20138516:20138534,20138915:20143733,20194945:20233885,20207275:20210118,20226864:20226989,20262312:20262632,20275037:20275251,20292713:20293616,20292714:20293249,20292715:20293448,20294016:20294483,20294017:20294381,20324083:20324159,20358676:20358687,20361769:20361772,20392423:20392642,20392425:20392545,20397546:20397635,20406407:20407298,20410244:20410438,20419803:20419883,20433799:20433935,20435008:20435099,20435009:20435315,20439419:20440171,20440654:20440944,20458150:20458975,20459305:20459554,20459306:20459373,20472818:20472936,20480195:20480205,20481911:20482378,20483422:20488720,20486638:20487083,20491390:20491440,20513318:20514046,20525510:20528118,20526609:20526618,20526610:20529473,20549109:20549333,20557095:20557158,20565256:20565312,20584687:20585493', 'assoc_mat': '20138426:kraft:3726:20144021,20138427:kraft:3726:20143916,20138516:kraft:3726:20138534,20138915:kraft:3726:20143733,20194945:kraft:3726:20233885,20207275:kraft:3726:20210118,20226864:kraft:3726:20226989,20262312:kraft:3726:20262632,20275037:kraft:3726:20275251,20292713:kraft:3726:20293616,20292714:kraft:3726:20293249,20292715:kraft:3726:20293448,20294016:kraft:3726:20294483,20294017:kraft:3726:20294381,20324083:kraft:3726:20324159,20358676:kraft:3726:20358687,20361769:kraft:3726:20361772,20392423:kraft:3726:20392642,20392425:kraft:3726:20392545,20397546:kraft:3726:20397635,20406407:kraft:3726:20407298,20410244:kraft:3726:20410438,20419803:kraft:3726:20419883,20433799:kraft:3726:20433935,20435008:kraft:3726:20435099,20435009:kraft:3726:20435315,20439419:kraft:3726:20440171,20440654:kraft:3726:20440944,20458150:kraft:3726:20458975,20459305:kraft:3726:20459554,20459306:kraft:3726:20459373,20472818:kraft:3726:20472936,20480195:kraft:3726:20480205,20481911:kraft:3726:20482378,20483422:kraft:3726:20488720,20486638:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0013051165888281256, 'nb_photo': 25, 'list_port_cont': '20141836,20143217,20197672,20206490,20234361,20301261,20306107,20328031,20395207,20400560,20414902,20418064,20421101,20438252,20453630,20458194,20469630,20487075,20487961,20509786,20516587,20520707,20522705,20530359,20572876', 'assoc_port': '20141169:20143217,20141794:20141836,20194953:20197672,20201733:20234361,20205159:20206490,20300370:20301261,20306051:20306107,20327872:20328031,20394564:20395207,20400442:20400560,20414779:20414902,20417280:20418064,20418451:20421101,20438219:20438252,20453511:20453630,20458152:20458194,20469535:20469630,20486638:20487075,20487879:20487961,20508594:20516587,20509634:20509786,20517667:20520707,20522695:20522705,20527976:20530359,20571908:20572876', 'assoc_mat': '20141169:metal:3726:20143217,20141794:metal:3726:20141836,20194953:metal:3726:20197672,20201733:metal:3726:20234361,20205159:metal:3726:20206490,20300370:metal:3726:20301261,20306051:metal:3726:20306107,20327872:metal:3726:20328031,20394564:metal:3726:20395207,20400442:metal:3726:20400560,20414779:metal:3726:20414902,20417280:metal:3726:20418064,20418451:metal:3726:20421101,20438219:metal:3726:20438252,20453511:metal:3726:20453630,20458152:metal:3726:20458194,20469535:metal:3726:20469630,20486638:metal:3726:20487075,20487879:metal:3726:20487961,20508594:metal:3726:20516587,20509634:metal:3726:20509786,20517667:metal:3726:20520707,20522695:metal:3726:20522705,20527976:metal:3726:20530359,20571908:metal:3726:20572876'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007337143311042502, 'nb_photo': 794, 'list_port_cont': '20137981,20138536,20138847,20138960,20139115,20139211,20139327,20139436,20139666,20140029,20140081,20140198,20140552,20140785,20141173,20141444,20141572,20141847,20141997,20142584,20143213,20143424,20143743,20143910,20144194,20170665,20171479,20172758,20172880,20173355,20175131,20176125,20177649,20188763,20194971,20195324,20195721,20195778,20196035,20196664,20197671,20200759,20201715,20202907,20206487,20210116,20210438,20210552,20211289,20211799,20212700,20213395,20214127,20214764,20217166,20218064,20219007,20220350,20220946,20222088,20222966,20224724,20225339,20226261,20226984,20227826,20227885,20229157,20231325,20231781,20231850,20232397,20232419,20232830,20233707,20233864,20233884,20234040,20234146,20234518,20234593,20246944,20247255,20247935,20248607,20249043,20249058,20250423,20251802,20252031,20253280,20254313,20254687,20255978,20256680,20257171,20257354,20257843,20258753,20260072,20260421,20262352,20262635,20262789,20265265,20267183,20267553,20267917,20268261,20268441,20268455,20269127,20270505,2027272', 'assoc_port': '20137964:20137981,20138425:20144194,20138427:20143910,20138516:20138536,20138772:20138847,20138915:20143743,20138916:20138960,20139056:20139115,20139200:20139211,20139318:20139327,20139389:20139436,20139549:20139666,20140004:20140029,20140005:20140081,20140122:20140198,20140506:20140552,20140742:20140785,20141169:20143213,20141170:20141173,20141364:20141444,20141528:20141572,20141794:20141847,20141995:20141997,20142523:20142584,20143389:20143424,20170003:20170665,20170849:20171479,20172043:20172880,20172044:20172758,20172870:20173355,20174067:20175131,20175420:20188763,20175421:20176125,20177161:20177649,20194938:20234593,20194939:20234518,20194940:20234146,20194943:20234040,20194944:20233864,20194945:20233884,20194946:20201715,20194947:20233707,20194950:20200759,20194953:20197671,20194955:20196664,20194957:20196035,20194958:20195778,20194959:20195721,20194960:20194971,20194961:20195324,20201732:20202907,20205158:20211289,20205159:20206487,20207259:20210552,20207272:20210438,20207275:20210116,20211703:2021270', 'assoc_mat': '20137964:plastique:3726:20137981,20138425:plastique:3726:20144194,20138427:plastique:3726:20143910,20138516:plastique:3726:20138536,20138772:plastique:3726:20138847,20138915:plastique:3726:20143743,20138916:plastique:3726:20138960,20139056:plastique:3726:20139115,20139200:plastique:3726:20139211,20139318:plastique:3726:20139327,20139389:plastique:3726:20139436,20139549:plastique:3726:20139666,20140004:plastique:3726:20140029,20140005:plastique:3726:20140081,20140122:plastique:3726:20140198,20140506:plastique:3726:20140552,20140742:plastique:3726:20140785,20141169:plastique:3726:20143213,20141170:plastique:3726:20141173,20141364:plastique:3726:20141444,20141528:plastique:3726:20141572,20141794:plastique:3726:20141847,20141995:plastique:3726:20141997,20142523:plastique:3726:20142584,20143389:plastique:3726:20143424,20170003:plastique:3726:20170665,20170849:plastique:3726:20171479,20172043:plastique:3726:20172880,20172044:plastique:3726:20172758,20172870:plastique:3726:20173355,20174067:plastique:3726:20175131,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007102655526567405, 'nb_photo': 1243, 'list_port_cont': '20137972,20138535,20138854,20138959,20139117,20139206,20139331,20139672,20140023,20140076,20140205,20140556,20140783,20141177,20141450,20141571,20141841,20141999,20142587,20143211,20143433,20143741,20143912,20144011,20144192,20171480,20172039,20172872,20173352,20176126,20194965,20195320,20195773,20196667,20197194,20197674,20199220,20199864,20200761,20201705,20202982,20203339,20203504,20205985,20206489,20206636,20209135,20210433,20210547,20211290,20211800,20212704,20213396,20214132,20214765,20215681,20217155,20218074,20218568,20219005,20220138,20220348,20220945,20222082,20222976,20224723,20225337,20225916,20226257,20226982,20227403,20227713,20227827,20227882,20229154,20230599,20231326,20231777,20231852,20232428,20232838,20233711,20233868,20233878,20234044,20234149,20234359,20234513,20234599,20246790,20247253,20247928,20248608,20249048,20249056,20251801,20252034,20253287,20254317,20254684,20255984,20256675,20257164,20257346,20258231,20258755,20260413,20262355,20262636,20262790,20267555,20267907,20268049,2026825', 'assoc_port': '20137964:20137972,20138425:20144192,20138426:20144011,20138427:20143912,20138516:20138535,20138772:20138854,20138915:20143741,20138916:20138959,20139056:20139117,20139200:20139206,20139318:20139331,20139549:20139672,20140004:20140023,20140005:20140076,20140122:20140205,20140506:20140556,20140742:20140783,20141169:20143211,20141170:20141177,20141364:20141450,20141528:20141571,20141794:20141841,20141995:20141999,20142523:20142587,20143389:20143433,20170849:20171480,20170850:20172039,20172043:20172872,20172870:20173352,20175421:20176126,20194937:20205985,20194938:20234599,20194939:20234513,20194940:20234149,20194941:20203339,20194942:20202982,20194943:20234044,20194944:20233868,20194945:20233878,20194946:20201705,20194947:20233711,20194948:20199864,20194949:20203504,20194950:20200761,20194951:20199220,20194953:20197674,20194955:20196667,20194956:20197194,20194958:20195773,20194960:20194965,20194961:20195320,20201733:20234359,20205158:20211290,20205159:20206489,20205160:20206636,20207259:20210547,20207272:2021043', 'assoc_mat': '20137964:Teint_Dans_La_Masse:3726:20137972,20138425:Teint_Dans_La_Masse:3726:20144192,20138426:Teint_Dans_La_Masse:3726:20144011,20138427:Teint_Dans_La_Masse:3726:20143912,20138516:Teint_Dans_La_Masse:3726:20138535,20138772:Teint_Dans_La_Masse:3726:20138854,20138915:Teint_Dans_La_Masse:3726:20143741,20138916:Teint_Dans_La_Masse:3726:20138959,20139056:Teint_Dans_La_Masse:3726:20139117,20139200:Teint_Dans_La_Masse:3726:20139206,20139318:Teint_Dans_La_Masse:3726:20139331,20139549:Teint_Dans_La_Masse:3726:20139672,20140004:Teint_Dans_La_Masse:3726:20140023,20140005:Teint_Dans_La_Masse:3726:20140076,20140122:Teint_Dans_La_Masse:3726:20140205,20140506:Teint_Dans_La_Masse:3726:20140556,20140742:Teint_Dans_La_Masse:3726:20140783,20141169:Teint_Dans_La_Masse:3726:20143211,20141170:Teint_Dans_La_Masse:3726:20141177,20141364:Teint_Dans_La_Masse:3726:20141450,20141528:Teint_Dans_La_Masse:3726:20141571,20141794:Teint_Dans_La_Masse:3726:20141841,20141995:Teint_Dans_La_Masse:3726:20141999,20142523:Teint_Dans_La_Masse:3726:2'}) select count(distinct mtr_photo_id) from MTRUser.mtr_portfolio_photos where mtr_portfolio_id in (select mtr_portfolio_id from MTRPhoto.dashboard_results where dashboard_run_id in(1579645,1581541,1583734,1586735,1590200,1593218,1596115,1597462,1605371,1600978,1604875,1607811,1610839,1613689,1614383)); after get_hostname_from_raspi SELECT substr(hashtag,8), substr(date_debut,1,7) as month, (sum(qualite*nombre_balle)/sum(nombre_balle)) FROM MTRPhoto.dashboard_results WHERE hashtag = '_______JRM' and mtr_portfolio_id in (select id FROM MTRUser.mtr_portfolios where mtr_user_id=979) and qualite >=0 and dashboard_run_id in (select last_run_id from MTRPhoto.dashboard_entry_day where dashboard_place_id=25 and date >='2025-02-01' and date <= '2025-02-28') GROUP BY month order by month; after impurety_average_per_hashtag {'number_of_analysed_photos': ((12527,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('JRM', 12527),), 'material_dict': {'JRM': 12527}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.03700727289841163, 734), (datetime.date(2025, 2, 3), 0.023240220546250117, 809), (datetime.date(2025, 2, 4), 0.022119732720480734, 1155), (datetime.date(2025, 2, 5), 0.024656121474557265, 1309), (datetime.date(2025, 2, 6), 0.03270009785879391, 930), (datetime.date(2025, 2, 7), 0.02839511109726169, 1098), (datetime.date(2025, 2, 8), 0.026862292626681748, 629), (datetime.date(2025, 2, 10), 0.02866386978447009, 1103), (datetime.date(2025, 2, 11), 0.02861834325042108, 1127), (datetime.date(2025, 2, 12), 0.03281127472803736, 744), (datetime.date(2025, 2, 13), 0.03324084682636766, 1096), (datetime.date(2025, 2, 14), 0.03195167135886276, 1165), (datetime.date(2025, 2, 15), 0.027847011266956538, 628)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 2, 1), 0.03700727289841163, 734), (datetime.date(2025, 2, 3), 0.023240220546250117, 809), (datetime.date(2025, 2, 4), 0.022119732720480734, 1155), (datetime.date(2025, 2, 5), 0.024656121474557265, 1309), (datetime.date(2025, 2, 6), 0.03270009785879391, 930), (datetime.date(2025, 2, 7), 0.02839511109726169, 1098), (datetime.date(2025, 2, 8), 0.026862292626681748, 629), (datetime.date(2025, 2, 10), 0.02866386978447009, 1103), (datetime.date(2025, 2, 11), 0.02861834325042108, 1127), (datetime.date(2025, 2, 12), 0.03281127472803736, 744), (datetime.date(2025, 2, 13), 0.03324084682636766, 1096), (datetime.date(2025, 2, 14), 0.03195167135886276, 1165), (datetime.date(2025, 2, 15), 0.027847011266956538, 628))}, 'quality_array': [], 'number_of_batch': ((502,),), 'datou_id_sts': 3385, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0067290292957817004, 'nb_photo': 326, 'list_port_cont': '20137970,20139118,20139205,20139328,20139439,20139664,20140079,20140203,20140549,20140781,20141449,20141576,20142003,20142588,20143208,20143427,20143915,20144010,20144185,20172759,20173357,20175129,20177641,20188753,20190756,20195318,20196455,20199217,20203499,20206085,20209137,20210431,20212710,20214124,20222091,20222968,20226980,20227408,20227823,20227889,20229165,20231333,20231856,20232423,20233883,20234034,20246949,20247926,20248616,20249062,20251811,20252027,20253289,20254311,20255979,20256677,20257173,20257352,20260077,20260422,20262639,20267174,20268433,20269131,20275121,20275248,20276935,20276972,20277294,20292948,20293615,20294377,20295402,20300536,20300756,20303366,20308062,20311291,20313619,20314201,20324664,20325629,20328033,20329337,20333780,20334119,20334628,20335730,20339165,20339460,20341277,20343489,20343569,20343605,20344299,20347999,20350855,20351168,20358682,20358990,20359939,20360195,20360299,20360737,20360888,20360899,20361777,20361797,20362009,20392431,20394709,20395028,20395213,2039762', 'assoc_port': '20137964:20137970,20138425:20144185,20138426:20144010,20138427:20143915,20139056:20139118,20139200:20139205,20139318:20139328,20139389:20139439,20139549:20139664,20140005:20140079,20140122:20140203,20140506:20140549,20140742:20140781,20141169:20143208,20141364:20141449,20141528:20141576,20141995:20142003,20142523:20142588,20143389:20143427,20172044:20172759,20172870:20173357,20174066:20190756,20174067:20175129,20175420:20188753,20177161:20177641,20194943:20234034,20194945:20233883,20194949:20203499,20194951:20199217,20194954:20196455,20194961:20195318,20205161:20206085,20207272:20210431,20207273:20209137,20211703:20212710,20213264:20214124,20217072:20222091,20222896:20222968,20222897:20227408,20222898:20227823,20226864:20226980,20227864:20227889,20229146:20229165,20230568:20231333,20231750:20231856,20232251:20232423,20246747:20246949,20247805:20247926,20248588:20248616,20248590:20249062,20251768:20252027,20251769:20251811,20253236:20254311,20253238:20253289,20254520:20257352,20255781:20255979,20256548:2025667', 'assoc_mat': '20137964:autre_refus:3726:20137970,20138425:autre_refus:3726:20144185,20138426:autre_refus:3726:20144010,20138427:autre_refus:3726:20143915,20139056:autre_refus:3726:20139118,20139200:autre_refus:3726:20139205,20139318:autre_refus:3726:20139328,20139389:autre_refus:3726:20139439,20139549:autre_refus:3726:20139664,20140005:autre_refus:3726:20140079,20140122:autre_refus:3726:20140203,20140506:autre_refus:3726:20140549,20140742:autre_refus:3726:20140781,20141169:autre_refus:3726:20143208,20141364:autre_refus:3726:20141449,20141528:autre_refus:3726:20141576,20141995:autre_refus:3726:20142003,20142523:autre_refus:3726:20142588,20143389:autre_refus:3726:20143427,20172044:autre_refus:3726:20172759,20172870:autre_refus:3726:20173357,20174066:autre_refus:3726:20190756,20174067:autre_refus:3726:20175129,20175420:autre_refus:3726:20188753,20177161:autre_refus:3726:20177641,20194943:autre_refus:3726:20234034,20194945:autre_refus:3726:20233883,20194949:autre_refus:3726:20203499,20194951:autre_refus:3726:20199217,20194954:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006783097436853527, 'nb_photo': 724, 'list_port_cont': '20137974,20138539,20138856,20138953,20139125,20139212,20139323,20139668,20140030,20140206,20140555,20140789,20141181,20141448,20141567,20141839,20142006,20143218,20143432,20143736,20144016,20172033,20172760,20172881,20175126,20176119,20188755,20194964,20196026,20196666,20197193,20199219,20200764,20202906,20203348,20203507,20206084,20206486,20206637,20209136,20210123,20210437,20211294,20213398,20214771,20215679,20217158,20218070,20220343,20220943,20222092,20222970,20224727,20225333,20225911,20226256,20226978,20227405,20227817,20231775,20232390,20232426,20233872,20234038,20234522,20234588,20246788,20246945,20247927,20249060,20252026,20253279,20254314,20254678,20257165,20257347,20257848,20258234,20262353,20262633,20262781,20267176,20267547,20267911,20268042,20268259,20269128,20272402,20272733,20272912,20273049,20273084,20273455,20275123,20275257,20275730,20276256,20276888,20276975,20277189,20277295,20293243,20293442,20293613,20294375,20294488,20294928,20295394,20295404,20300383,20300617,20300632,20300720,2030075', 'assoc_port': '20137964:20137974,20138426:20144016,20138516:20138539,20138772:20138856,20138915:20143736,20138916:20138953,20139056:20139125,20139200:20139212,20139318:20139323,20139549:20139668,20140004:20140030,20140122:20140206,20140506:20140555,20140742:20140789,20141169:20143218,20141170:20141181,20141364:20141448,20141528:20141567,20141794:20141839,20141995:20142006,20143389:20143432,20170850:20172033,20172043:20172881,20172044:20172760,20174067:20175126,20175420:20188755,20175421:20176119,20194938:20234588,20194939:20234522,20194941:20203348,20194943:20234038,20194944:20233872,20194949:20203507,20194950:20200764,20194951:20199219,20194955:20196666,20194956:20197193,20194957:20196026,20194960:20194964,20201732:20202906,20205158:20211294,20205159:20206486,20205160:20206637,20205161:20206084,20207272:20210437,20207273:20209136,20207275:20210123,20213265:20213398,20214646:20215679,20214647:20214771,20217072:20222092,20217073:20217158,20217074:20218070,20218531:20220943,20220318:20220343,20222896:20222970,20222897:2022740', 'assoc_mat': '20137964:cartonnette:3726:20137974,20138426:cartonnette:3726:20144016,20138516:cartonnette:3726:20138539,20138772:cartonnette:3726:20138856,20138915:cartonnette:3726:20143736,20138916:cartonnette:3726:20138953,20139056:cartonnette:3726:20139125,20139200:cartonnette:3726:20139212,20139318:cartonnette:3726:20139323,20139549:cartonnette:3726:20139668,20140004:cartonnette:3726:20140030,20140122:cartonnette:3726:20140206,20140506:cartonnette:3726:20140555,20140742:cartonnette:3726:20140789,20141169:cartonnette:3726:20143218,20141170:cartonnette:3726:20141181,20141364:cartonnette:3726:20141448,20141528:cartonnette:3726:20141567,20141794:cartonnette:3726:20141839,20141995:cartonnette:3726:20142006,20143389:cartonnette:3726:20143432,20170850:cartonnette:3726:20172033,20172043:cartonnette:3726:20172881,20172044:cartonnette:3726:20172760,20174067:cartonnette:3726:20175126,20175420:cartonnette:3726:20188755,20175421:cartonnette:3726:20176119,20194938:cartonnette:3726:20234588,20194939:cartonnette:3726:20234522,20194941:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007564944827471116, 'nb_photo': 400, 'list_port_cont': '20137746,20138540,20138849,20138954,20139207,20139332,20139433,20139669,20140075,20140196,20140546,20140791,20141178,20141445,20141569,20141845,20142585,20143739,20143911,20144013,20171471,20175123,20194974,20201711,20206491,20206638,20209253,20210435,20211792,20214129,20215683,20218068,20222081,20225336,20226983,20227410,20227819,20231323,20232400,20234043,20246782,20248609,20249061,20252030,20254315,20255982,20257355,20258758,20260415,20262354,20262638,20262788,20268043,20268442,20269129,20270508,20272916,20273085,20275122,20275255,20276882,20276971,20277192,20292944,20293245,20293443,20293624,20294383,20294480,20294924,20295415,20300378,20300531,20300626,20300639,20301260,20301566,20303372,20308067,20309822,20311293,20312170,20313610,20313717,20324658,20329072,20329334,20334120,20339169,20339961,20340382,20341274,20343101,20343210,20343483,20343577,20343596,20344301,20347998,20348254,20348636,20349286,20350634,20350685,20350854,20358690,20358734,20360506,20360738,20360879,20360890,20361518,20361774,2036193', 'assoc_port': '20137697:20137746,20138426:20144013,20138427:20143911,20138516:20138540,20138772:20138849,20138915:20143739,20138916:20138954,20139200:20139207,20139318:20139332,20139389:20139433,20139549:20139669,20140005:20140075,20140122:20140196,20140506:20140546,20140742:20140791,20141170:20141178,20141364:20141445,20141528:20141569,20141794:20141845,20142523:20142585,20170849:20171471,20174067:20175123,20194943:20234043,20194946:20201711,20194960:20194974,20205159:20206491,20205160:20206638,20207272:20210435,20209244:20209253,20211704:20211792,20213264:20214129,20214646:20215683,20217072:20222081,20217074:20218068,20222897:20227410,20222898:20227819,20224663:20225336,20226864:20226983,20230568:20231323,20232250:20232400,20246748:20246782,20248588:20248609,20248590:20249061,20251768:20252030,20253236:20254315,20254520:20257355,20255781:20255982,20258695:20258758,20259986:20260415,20262310:20262788,20262312:20262638,20262313:20262354,20267130:20268442,20267131:20270508,20267132:20268043,20269028:20269129,20272327:2027308', 'assoc_mat': '20137697:Carton_brun:3726:20137746,20138426:Carton_brun:3726:20144013,20138427:Carton_brun:3726:20143911,20138516:Carton_brun:3726:20138540,20138772:Carton_brun:3726:20138849,20138915:Carton_brun:3726:20143739,20138916:Carton_brun:3726:20138954,20139200:Carton_brun:3726:20139207,20139318:Carton_brun:3726:20139332,20139389:Carton_brun:3726:20139433,20139549:Carton_brun:3726:20139669,20140005:Carton_brun:3726:20140075,20140122:Carton_brun:3726:20140196,20140506:Carton_brun:3726:20140546,20140742:Carton_brun:3726:20140791,20141170:Carton_brun:3726:20141178,20141364:Carton_brun:3726:20141445,20141528:Carton_brun:3726:20141569,20141794:Carton_brun:3726:20141845,20142523:Carton_brun:3726:20142585,20170849:Carton_brun:3726:20171471,20174067:Carton_brun:3726:20175123,20194943:Carton_brun:3726:20234043,20194946:Carton_brun:3726:20201711,20194960:Carton_brun:3726:20194974,20205159:Carton_brun:3726:20206491,20205160:Carton_brun:3726:20206638,20207272:Carton_brun:3726:20210435,20209244:Carton_brun:3726:20209253,20211704:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008609438775156165, 'nb_photo': 641, 'list_port_cont': '20137745,20137978,20138850,20138955,20139203,20139322,20139432,20139670,20140033,20140082,20140202,20140554,20140784,20141182,20141441,20141574,20141837,20142593,20143210,20143425,20143732,20144019,20144189,20172041,20173347,20176118,20177644,20190750,20195327,20195717,20195774,20196032,20196459,20196663,20197187,20197670,20197692,20199223,20199867,20200766,20201708,20202901,20202974,20205992,20206086,20206639,20209132,20209252,20211288,20211803,20212703,20214761,20215676,20217161,20218067,20218563,20220146,20220352,20220937,20222975,20224726,20225341,20226258,20226987,20227404,20227822,20229155,20230601,20231328,20231778,20231854,20232429,20234041,20234152,20246785,20246950,20247259,20248614,20249045,20249063,20250424,20251803,20252024,20253288,20254312,20256681,20257174,20257345,20257841,20258227,20260078,20260417,20262360,20262785,20267175,20267546,20267908,20268255,20268437,20268446,20269124,20270500,20272396,20272722,20272906,20273057,20273082,20275254,20275472,20275727,20276251,20276885,20276973,2027718', 'assoc_port': '20137697:20137745,20137964:20137978,20138425:20144189,20138426:20144019,20138772:20138850,20138915:20143732,20138916:20138955,20139200:20139203,20139318:20139322,20139389:20139432,20139549:20139670,20140004:20140033,20140005:20140082,20140122:20140202,20140506:20140554,20140742:20140784,20141169:20143210,20141170:20141182,20141364:20141441,20141528:20141574,20141794:20141837,20142523:20142593,20143389:20143425,20170850:20172041,20172870:20173347,20174066:20190750,20175421:20176118,20177161:20177644,20194937:20205992,20194940:20234152,20194942:20202974,20194943:20234041,20194946:20201708,20194948:20199867,20194950:20200766,20194951:20199223,20194952:20197692,20194953:20197670,20194954:20196459,20194955:20196663,20194956:20197187,20194957:20196032,20194958:20195774,20194959:20195717,20194961:20195327,20201732:20202901,20205158:20211288,20205160:20206639,20205161:20206086,20207273:20209132,20209244:20209252,20211703:20212703,20211704:20211803,20214646:20215676,20214647:20214761,20217073:20217161,20217074:2021806', 'assoc_mat': '20137697:Carton_gris:3726:20137745,20137964:Carton_gris:3726:20137978,20138425:Carton_gris:3726:20144189,20138426:Carton_gris:3726:20144019,20138772:Carton_gris:3726:20138850,20138915:Carton_gris:3726:20143732,20138916:Carton_gris:3726:20138955,20139200:Carton_gris:3726:20139203,20139318:Carton_gris:3726:20139322,20139389:Carton_gris:3726:20139432,20139549:Carton_gris:3726:20139670,20140004:Carton_gris:3726:20140033,20140005:Carton_gris:3726:20140082,20140122:Carton_gris:3726:20140202,20140506:Carton_gris:3726:20140554,20140742:Carton_gris:3726:20140784,20141169:Carton_gris:3726:20143210,20141170:Carton_gris:3726:20141182,20141364:Carton_gris:3726:20141441,20141528:Carton_gris:3726:20141574,20141794:Carton_gris:3726:20141837,20142523:Carton_gris:3726:20142593,20143389:Carton_gris:3726:20143425,20170850:Carton_gris:3726:20172041,20172870:Carton_gris:3726:20173347,20174066:Carton_gris:3726:20190750,20175421:Carton_gris:3726:20176118,20177161:Carton_gris:3726:20177644,20194937:Carton_gris:3726:20205992,20194940:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.002325712217462401, 'nb_photo': 49, 'list_port_cont': '20138534,20143733,20143916,20144021,20210118,20226989,20233885,20262632,20275251,20293249,20293448,20293616,20294381,20294483,20324159,20358687,20361772,20392545,20392642,20397635,20407298,20410438,20419883,20433935,20435099,20435315,20440171,20440944,20458975,20459373,20459554,20472936,20480205,20482378,20487083,20488720,20491440,20514046,20526618,20528118,20529473,20549333,20557158,20565312,20585493', 'assoc_port': '20138426:20144021,20138427:20143916,20138516:20138534,20138915:20143733,20194945:20233885,20207275:20210118,20226864:20226989,20262312:20262632,20275037:20275251,20292713:20293616,20292714:20293249,20292715:20293448,20294016:20294483,20294017:20294381,20324083:20324159,20358676:20358687,20361769:20361772,20392423:20392642,20392425:20392545,20397546:20397635,20406407:20407298,20410244:20410438,20419803:20419883,20433799:20433935,20435008:20435099,20435009:20435315,20439419:20440171,20440654:20440944,20458150:20458975,20459305:20459554,20459306:20459373,20472818:20472936,20480195:20480205,20481911:20482378,20483422:20488720,20486638:20487083,20491390:20491440,20513318:20514046,20525510:20528118,20526609:20526618,20526610:20529473,20549109:20549333,20557095:20557158,20565256:20565312,20584687:20585493', 'assoc_mat': '20138426:kraft:3726:20144021,20138427:kraft:3726:20143916,20138516:kraft:3726:20138534,20138915:kraft:3726:20143733,20194945:kraft:3726:20233885,20207275:kraft:3726:20210118,20226864:kraft:3726:20226989,20262312:kraft:3726:20262632,20275037:kraft:3726:20275251,20292713:kraft:3726:20293616,20292714:kraft:3726:20293249,20292715:kraft:3726:20293448,20294016:kraft:3726:20294483,20294017:kraft:3726:20294381,20324083:kraft:3726:20324159,20358676:kraft:3726:20358687,20361769:kraft:3726:20361772,20392423:kraft:3726:20392642,20392425:kraft:3726:20392545,20397546:kraft:3726:20397635,20406407:kraft:3726:20407298,20410244:kraft:3726:20410438,20419803:kraft:3726:20419883,20433799:kraft:3726:20433935,20435008:kraft:3726:20435099,20435009:kraft:3726:20435315,20439419:kraft:3726:20440171,20440654:kraft:3726:20440944,20458150:kraft:3726:20458975,20459305:kraft:3726:20459554,20459306:kraft:3726:20459373,20472818:kraft:3726:20472936,20480195:kraft:3726:20480205,20481911:kraft:3726:20482378,20483422:kraft:3726:20488720,20486638:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0013051165888281256, 'nb_photo': 25, 'list_port_cont': '20141836,20143217,20197672,20206490,20234361,20301261,20306107,20328031,20395207,20400560,20414902,20418064,20421101,20438252,20453630,20458194,20469630,20487075,20487961,20509786,20516587,20520707,20522705,20530359,20572876', 'assoc_port': '20141169:20143217,20141794:20141836,20194953:20197672,20201733:20234361,20205159:20206490,20300370:20301261,20306051:20306107,20327872:20328031,20394564:20395207,20400442:20400560,20414779:20414902,20417280:20418064,20418451:20421101,20438219:20438252,20453511:20453630,20458152:20458194,20469535:20469630,20486638:20487075,20487879:20487961,20508594:20516587,20509634:20509786,20517667:20520707,20522695:20522705,20527976:20530359,20571908:20572876', 'assoc_mat': '20141169:metal:3726:20143217,20141794:metal:3726:20141836,20194953:metal:3726:20197672,20201733:metal:3726:20234361,20205159:metal:3726:20206490,20300370:metal:3726:20301261,20306051:metal:3726:20306107,20327872:metal:3726:20328031,20394564:metal:3726:20395207,20400442:metal:3726:20400560,20414779:metal:3726:20414902,20417280:metal:3726:20418064,20418451:metal:3726:20421101,20438219:metal:3726:20438252,20453511:metal:3726:20453630,20458152:metal:3726:20458194,20469535:metal:3726:20469630,20486638:metal:3726:20487075,20487879:metal:3726:20487961,20508594:metal:3726:20516587,20509634:metal:3726:20509786,20517667:metal:3726:20520707,20522695:metal:3726:20522705,20527976:metal:3726:20530359,20571908:metal:3726:20572876'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007337143311042502, 'nb_photo': 794, 'list_port_cont': '20137981,20138536,20138847,20138960,20139115,20139211,20139327,20139436,20139666,20140029,20140081,20140198,20140552,20140785,20141173,20141444,20141572,20141847,20141997,20142584,20143213,20143424,20143743,20143910,20144194,20170665,20171479,20172758,20172880,20173355,20175131,20176125,20177649,20188763,20194971,20195324,20195721,20195778,20196035,20196664,20197671,20200759,20201715,20202907,20206487,20210116,20210438,20210552,20211289,20211799,20212700,20213395,20214127,20214764,20217166,20218064,20219007,20220350,20220946,20222088,20222966,20224724,20225339,20226261,20226984,20227826,20227885,20229157,20231325,20231781,20231850,20232397,20232419,20232830,20233707,20233864,20233884,20234040,20234146,20234518,20234593,20246944,20247255,20247935,20248607,20249043,20249058,20250423,20251802,20252031,20253280,20254313,20254687,20255978,20256680,20257171,20257354,20257843,20258753,20260072,20260421,20262352,20262635,20262789,20265265,20267183,20267553,20267917,20268261,20268441,20268455,20269127,20270505,2027272', 'assoc_port': '20137964:20137981,20138425:20144194,20138427:20143910,20138516:20138536,20138772:20138847,20138915:20143743,20138916:20138960,20139056:20139115,20139200:20139211,20139318:20139327,20139389:20139436,20139549:20139666,20140004:20140029,20140005:20140081,20140122:20140198,20140506:20140552,20140742:20140785,20141169:20143213,20141170:20141173,20141364:20141444,20141528:20141572,20141794:20141847,20141995:20141997,20142523:20142584,20143389:20143424,20170003:20170665,20170849:20171479,20172043:20172880,20172044:20172758,20172870:20173355,20174067:20175131,20175420:20188763,20175421:20176125,20177161:20177649,20194938:20234593,20194939:20234518,20194940:20234146,20194943:20234040,20194944:20233864,20194945:20233884,20194946:20201715,20194947:20233707,20194950:20200759,20194953:20197671,20194955:20196664,20194957:20196035,20194958:20195778,20194959:20195721,20194960:20194971,20194961:20195324,20201732:20202907,20205158:20211289,20205159:20206487,20207259:20210552,20207272:20210438,20207275:20210116,20211703:2021270', 'assoc_mat': '20137964:plastique:3726:20137981,20138425:plastique:3726:20144194,20138427:plastique:3726:20143910,20138516:plastique:3726:20138536,20138772:plastique:3726:20138847,20138915:plastique:3726:20143743,20138916:plastique:3726:20138960,20139056:plastique:3726:20139115,20139200:plastique:3726:20139211,20139318:plastique:3726:20139327,20139389:plastique:3726:20139436,20139549:plastique:3726:20139666,20140004:plastique:3726:20140029,20140005:plastique:3726:20140081,20140122:plastique:3726:20140198,20140506:plastique:3726:20140552,20140742:plastique:3726:20140785,20141169:plastique:3726:20143213,20141170:plastique:3726:20141173,20141364:plastique:3726:20141444,20141528:plastique:3726:20141572,20141794:plastique:3726:20141847,20141995:plastique:3726:20141997,20142523:plastique:3726:20142584,20143389:plastique:3726:20143424,20170003:plastique:3726:20170665,20170849:plastique:3726:20171479,20172043:plastique:3726:20172880,20172044:plastique:3726:20172758,20172870:plastique:3726:20173355,20174067:plastique:3726:20175131,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007102655526567405, 'nb_photo': 1243, 'list_port_cont': '20137972,20138535,20138854,20138959,20139117,20139206,20139331,20139672,20140023,20140076,20140205,20140556,20140783,20141177,20141450,20141571,20141841,20141999,20142587,20143211,20143433,20143741,20143912,20144011,20144192,20171480,20172039,20172872,20173352,20176126,20194965,20195320,20195773,20196667,20197194,20197674,20199220,20199864,20200761,20201705,20202982,20203339,20203504,20205985,20206489,20206636,20209135,20210433,20210547,20211290,20211800,20212704,20213396,20214132,20214765,20215681,20217155,20218074,20218568,20219005,20220138,20220348,20220945,20222082,20222976,20224723,20225337,20225916,20226257,20226982,20227403,20227713,20227827,20227882,20229154,20230599,20231326,20231777,20231852,20232428,20232838,20233711,20233868,20233878,20234044,20234149,20234359,20234513,20234599,20246790,20247253,20247928,20248608,20249048,20249056,20251801,20252034,20253287,20254317,20254684,20255984,20256675,20257164,20257346,20258231,20258755,20260413,20262355,20262636,20262790,20267555,20267907,20268049,2026825', 'assoc_port': '20137964:20137972,20138425:20144192,20138426:20144011,20138427:20143912,20138516:20138535,20138772:20138854,20138915:20143741,20138916:20138959,20139056:20139117,20139200:20139206,20139318:20139331,20139549:20139672,20140004:20140023,20140005:20140076,20140122:20140205,20140506:20140556,20140742:20140783,20141169:20143211,20141170:20141177,20141364:20141450,20141528:20141571,20141794:20141841,20141995:20141999,20142523:20142587,20143389:20143433,20170849:20171480,20170850:20172039,20172043:20172872,20172870:20173352,20175421:20176126,20194937:20205985,20194938:20234599,20194939:20234513,20194940:20234149,20194941:20203339,20194942:20202982,20194943:20234044,20194944:20233868,20194945:20233878,20194946:20201705,20194947:20233711,20194948:20199864,20194949:20203504,20194950:20200761,20194951:20199220,20194953:20197674,20194955:20196667,20194956:20197194,20194958:20195773,20194960:20194965,20194961:20195320,20201733:20234359,20205158:20211290,20205159:20206489,20205160:20206636,20207259:20210547,20207272:2021043', 'assoc_mat': '20137964:Teint_Dans_La_Masse:3726:20137972,20138425:Teint_Dans_La_Masse:3726:20144192,20138426:Teint_Dans_La_Masse:3726:20144011,20138427:Teint_Dans_La_Masse:3726:20143912,20138516:Teint_Dans_La_Masse:3726:20138535,20138772:Teint_Dans_La_Masse:3726:20138854,20138915:Teint_Dans_La_Masse:3726:20143741,20138916:Teint_Dans_La_Masse:3726:20138959,20139056:Teint_Dans_La_Masse:3726:20139117,20139200:Teint_Dans_La_Masse:3726:20139206,20139318:Teint_Dans_La_Masse:3726:20139331,20139549:Teint_Dans_La_Masse:3726:20139672,20140004:Teint_Dans_La_Masse:3726:20140023,20140005:Teint_Dans_La_Masse:3726:20140076,20140122:Teint_Dans_La_Masse:3726:20140205,20140506:Teint_Dans_La_Masse:3726:20140556,20140742:Teint_Dans_La_Masse:3726:20140783,20141169:Teint_Dans_La_Masse:3726:20143211,20141170:Teint_Dans_La_Masse:3726:20141177,20141364:Teint_Dans_La_Masse:3726:20141450,20141528:Teint_Dans_La_Masse:3726:20141571,20141794:Teint_Dans_La_Masse:3726:20141841,20141995:Teint_Dans_La_Masse:3726:20141999,20142523:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 12527}}, 'hostname': (), 'impurety_average_per_hashtag': []} VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! VR TODO TOCHECK : due to this bug it shouldn't have being able to work, or maybe it was due to a change directory not done ! SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier TODO : Insert select and so on SELECT id, name, misc_info, datou_id_for_right FROM MTRPhoto.dashboard_places WHERE name="arc_en_ciel_jrm_peu_dense"; SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3385 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3385 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3385 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3385 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! {"input_values":[]} SELECT name, created_at,limit_max FROM MTRDatou.mtr_datou WHERE id=3459 SELECT mtd.id, mtdt.`type`, mtd.`param`, mtd.param_json, mtdt.nb_input, mtdt.nb_output, mtdt.prod, mtdt.is_local, mtdt.is_datou_depend, mtdt.is_photo_id_local FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_step_types mtdt WHERE mtdt.`id`=mtd.`type` AND mtd.mtd_id=3459 SELECT mtd.id, mtd.mtd_id, mdsdt.id, mdsdt.name, mdsdt.description, msid.output_or_input, msid.data_order_id, mdsdt.type FROM MTRDatou.mtr_datou_step mtd, MTRDatou.mtr_datou_steptype_io_datatypes msid, MTRDatou.mtr_datou_step_data_types mdsdt WHERE mtd.`type`=msid.`mtr_datou_step_type` AND mtd.mtd_id= 3459 AND msid.data_type=mdsdt.id SELECT mts_id_output, id_output, mts_id_input, id_input FROM MTRDatou.mtr_datou_step_by_step WHERE mtd_id=3459 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11449 mask_detect is not consistent : 3 used against 2 in the step definition ! Step 11452 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Step 11452 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11453 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11453 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11454 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11478 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11478 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11456 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11455 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11455 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11458 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 11449 doesn't seem to be define in the database( WARNING : type of input 2 of step 11452 doesn't seem to be define in the database( WARNING : output 1 of step 11449 have datatype=2 whereas input 1 of step 11453 have datatype=7 WARNING : type of output 2 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11454 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 11453 doesn't seem to be define in the database( WARNING : type of input 1 of step 11456 doesn't seem to be define in the database( WARNING : type of output 1 of step 11456 doesn't seem to be define in the database( WARNING : type of input 3 of step 11455 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11456 have datatype=10 whereas input 3 of step 11458 have datatype=6 WARNING : type of input 5 of step 11458 doesn't seem to be define in the database( WARNING : output 0 of step 11477 have datatype=11 whereas input 5 of step 11458 have datatype=None WARNING : output 0 of step 11456 have datatype=10 whereas input 0 of step 11477 have datatype=18 WARNING : type of input 2 of step 11478 doesn't seem to be define in the database( WARNING : output 1 of step 11454 have datatype=7 whereas input 2 of step 11478 have datatype=None WARNING : type of output 3 of step 11478 doesn't seem to be define in the database( WARNING : type of input 2 of step 11456 doesn't seem to be define in the database( WARNING : output 0 of step 11453 have datatype=1 whereas input 0 of step 11454 have datatype=2 DataTypes for each output/input checked ! {"input_values":[]} Unexpected error treated as WARNING for now expected given param in final step {'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 1.5, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}} Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier {'number_of_analysed_photos': ((12527,),), 'unwanted_material_monthly_percentage': 0, 'material_repartition': (('JRM', 12527),), 'material_dict': {'JRM': 12527}, 'coverage_data': (), 'impurety_average_data': ((datetime.date(2025, 2, 1), 0.03700727289841163, 734), (datetime.date(2025, 2, 3), 0.023240220546250117, 809), (datetime.date(2025, 2, 4), 0.022119732720480734, 1155), (datetime.date(2025, 2, 5), 0.024656121474557265, 1309), (datetime.date(2025, 2, 6), 0.03270009785879391, 930), (datetime.date(2025, 2, 7), 0.02839511109726169, 1098), (datetime.date(2025, 2, 8), 0.026862292626681748, 629), (datetime.date(2025, 2, 10), 0.02866386978447009, 1103), (datetime.date(2025, 2, 11), 0.02861834325042108, 1127), (datetime.date(2025, 2, 12), 0.03281127472803736, 744), (datetime.date(2025, 2, 13), 0.03324084682636766, 1096), (datetime.date(2025, 2, 14), 0.03195167135886276, 1165), (datetime.date(2025, 2, 15), 0.027847011266956538, 628)), 'impurety_average_data_per_hashtag': {'JRM': ((datetime.date(2025, 2, 1), 0.03700727289841163, 734), (datetime.date(2025, 2, 3), 0.023240220546250117, 809), (datetime.date(2025, 2, 4), 0.022119732720480734, 1155), (datetime.date(2025, 2, 5), 0.024656121474557265, 1309), (datetime.date(2025, 2, 6), 0.03270009785879391, 930), (datetime.date(2025, 2, 7), 0.02839511109726169, 1098), (datetime.date(2025, 2, 8), 0.026862292626681748, 629), (datetime.date(2025, 2, 10), 0.02866386978447009, 1103), (datetime.date(2025, 2, 11), 0.02861834325042108, 1127), (datetime.date(2025, 2, 12), 0.03281127472803736, 744), (datetime.date(2025, 2, 13), 0.03324084682636766, 1096), (datetime.date(2025, 2, 14), 0.03195167135886276, 1165), (datetime.date(2025, 2, 15), 0.027847011266956538, 628))}, 'quality_array': [], 'number_of_batch': ((502,),), 'datou_id_sts': 3385, 'map_hashtag_number_mat': {'hash_to_mat_nb': ({'unwanted_material': 'autre_refus', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0067290292957817004, 'nb_photo': 326, 'list_port_cont': '20137970,20139118,20139205,20139328,20139439,20139664,20140079,20140203,20140549,20140781,20141449,20141576,20142003,20142588,20143208,20143427,20143915,20144010,20144185,20172759,20173357,20175129,20177641,20188753,20190756,20195318,20196455,20199217,20203499,20206085,20209137,20210431,20212710,20214124,20222091,20222968,20226980,20227408,20227823,20227889,20229165,20231333,20231856,20232423,20233883,20234034,20246949,20247926,20248616,20249062,20251811,20252027,20253289,20254311,20255979,20256677,20257173,20257352,20260077,20260422,20262639,20267174,20268433,20269131,20275121,20275248,20276935,20276972,20277294,20292948,20293615,20294377,20295402,20300536,20300756,20303366,20308062,20311291,20313619,20314201,20324664,20325629,20328033,20329337,20333780,20334119,20334628,20335730,20339165,20339460,20341277,20343489,20343569,20343605,20344299,20347999,20350855,20351168,20358682,20358990,20359939,20360195,20360299,20360737,20360888,20360899,20361777,20361797,20362009,20392431,20394709,20395028,20395213,2039762', 'assoc_port': '20137964:20137970,20138425:20144185,20138426:20144010,20138427:20143915,20139056:20139118,20139200:20139205,20139318:20139328,20139389:20139439,20139549:20139664,20140005:20140079,20140122:20140203,20140506:20140549,20140742:20140781,20141169:20143208,20141364:20141449,20141528:20141576,20141995:20142003,20142523:20142588,20143389:20143427,20172044:20172759,20172870:20173357,20174066:20190756,20174067:20175129,20175420:20188753,20177161:20177641,20194943:20234034,20194945:20233883,20194949:20203499,20194951:20199217,20194954:20196455,20194961:20195318,20205161:20206085,20207272:20210431,20207273:20209137,20211703:20212710,20213264:20214124,20217072:20222091,20222896:20222968,20222897:20227408,20222898:20227823,20226864:20226980,20227864:20227889,20229146:20229165,20230568:20231333,20231750:20231856,20232251:20232423,20246747:20246949,20247805:20247926,20248588:20248616,20248590:20249062,20251768:20252027,20251769:20251811,20253236:20254311,20253238:20253289,20254520:20257352,20255781:20255979,20256548:2025667', 'assoc_mat': '20137964:autre_refus:3726:20137970,20138425:autre_refus:3726:20144185,20138426:autre_refus:3726:20144010,20138427:autre_refus:3726:20143915,20139056:autre_refus:3726:20139118,20139200:autre_refus:3726:20139205,20139318:autre_refus:3726:20139328,20139389:autre_refus:3726:20139439,20139549:autre_refus:3726:20139664,20140005:autre_refus:3726:20140079,20140122:autre_refus:3726:20140203,20140506:autre_refus:3726:20140549,20140742:autre_refus:3726:20140781,20141169:autre_refus:3726:20143208,20141364:autre_refus:3726:20141449,20141528:autre_refus:3726:20141576,20141995:autre_refus:3726:20142003,20142523:autre_refus:3726:20142588,20143389:autre_refus:3726:20143427,20172044:autre_refus:3726:20172759,20172870:autre_refus:3726:20173357,20174066:autre_refus:3726:20190756,20174067:autre_refus:3726:20175129,20175420:autre_refus:3726:20188753,20177161:autre_refus:3726:20177641,20194943:autre_refus:3726:20234034,20194945:autre_refus:3726:20233883,20194949:autre_refus:3726:20203499,20194951:autre_refus:3726:20199217,20194954:'}, {'unwanted_material': 'cartonnette', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.006783097436853527, 'nb_photo': 724, 'list_port_cont': '20137974,20138539,20138856,20138953,20139125,20139212,20139323,20139668,20140030,20140206,20140555,20140789,20141181,20141448,20141567,20141839,20142006,20143218,20143432,20143736,20144016,20172033,20172760,20172881,20175126,20176119,20188755,20194964,20196026,20196666,20197193,20199219,20200764,20202906,20203348,20203507,20206084,20206486,20206637,20209136,20210123,20210437,20211294,20213398,20214771,20215679,20217158,20218070,20220343,20220943,20222092,20222970,20224727,20225333,20225911,20226256,20226978,20227405,20227817,20231775,20232390,20232426,20233872,20234038,20234522,20234588,20246788,20246945,20247927,20249060,20252026,20253279,20254314,20254678,20257165,20257347,20257848,20258234,20262353,20262633,20262781,20267176,20267547,20267911,20268042,20268259,20269128,20272402,20272733,20272912,20273049,20273084,20273455,20275123,20275257,20275730,20276256,20276888,20276975,20277189,20277295,20293243,20293442,20293613,20294375,20294488,20294928,20295394,20295404,20300383,20300617,20300632,20300720,2030075', 'assoc_port': '20137964:20137974,20138426:20144016,20138516:20138539,20138772:20138856,20138915:20143736,20138916:20138953,20139056:20139125,20139200:20139212,20139318:20139323,20139549:20139668,20140004:20140030,20140122:20140206,20140506:20140555,20140742:20140789,20141169:20143218,20141170:20141181,20141364:20141448,20141528:20141567,20141794:20141839,20141995:20142006,20143389:20143432,20170850:20172033,20172043:20172881,20172044:20172760,20174067:20175126,20175420:20188755,20175421:20176119,20194938:20234588,20194939:20234522,20194941:20203348,20194943:20234038,20194944:20233872,20194949:20203507,20194950:20200764,20194951:20199219,20194955:20196666,20194956:20197193,20194957:20196026,20194960:20194964,20201732:20202906,20205158:20211294,20205159:20206486,20205160:20206637,20205161:20206084,20207272:20210437,20207273:20209136,20207275:20210123,20213265:20213398,20214646:20215679,20214647:20214771,20217072:20222092,20217073:20217158,20217074:20218070,20218531:20220943,20220318:20220343,20222896:20222970,20222897:2022740', 'assoc_mat': '20137964:cartonnette:3726:20137974,20138426:cartonnette:3726:20144016,20138516:cartonnette:3726:20138539,20138772:cartonnette:3726:20138856,20138915:cartonnette:3726:20143736,20138916:cartonnette:3726:20138953,20139056:cartonnette:3726:20139125,20139200:cartonnette:3726:20139212,20139318:cartonnette:3726:20139323,20139549:cartonnette:3726:20139668,20140004:cartonnette:3726:20140030,20140122:cartonnette:3726:20140206,20140506:cartonnette:3726:20140555,20140742:cartonnette:3726:20140789,20141169:cartonnette:3726:20143218,20141170:cartonnette:3726:20141181,20141364:cartonnette:3726:20141448,20141528:cartonnette:3726:20141567,20141794:cartonnette:3726:20141839,20141995:cartonnette:3726:20142006,20143389:cartonnette:3726:20143432,20170850:cartonnette:3726:20172033,20172043:cartonnette:3726:20172881,20172044:cartonnette:3726:20172760,20174067:cartonnette:3726:20175126,20175420:cartonnette:3726:20188755,20175421:cartonnette:3726:20176119,20194938:cartonnette:3726:20234588,20194939:cartonnette:3726:20234522,20194941:'}, {'unwanted_material': 'Carton_brun', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007564944827471116, 'nb_photo': 400, 'list_port_cont': '20137746,20138540,20138849,20138954,20139207,20139332,20139433,20139669,20140075,20140196,20140546,20140791,20141178,20141445,20141569,20141845,20142585,20143739,20143911,20144013,20171471,20175123,20194974,20201711,20206491,20206638,20209253,20210435,20211792,20214129,20215683,20218068,20222081,20225336,20226983,20227410,20227819,20231323,20232400,20234043,20246782,20248609,20249061,20252030,20254315,20255982,20257355,20258758,20260415,20262354,20262638,20262788,20268043,20268442,20269129,20270508,20272916,20273085,20275122,20275255,20276882,20276971,20277192,20292944,20293245,20293443,20293624,20294383,20294480,20294924,20295415,20300378,20300531,20300626,20300639,20301260,20301566,20303372,20308067,20309822,20311293,20312170,20313610,20313717,20324658,20329072,20329334,20334120,20339169,20339961,20340382,20341274,20343101,20343210,20343483,20343577,20343596,20344301,20347998,20348254,20348636,20349286,20350634,20350685,20350854,20358690,20358734,20360506,20360738,20360879,20360890,20361518,20361774,2036193', 'assoc_port': '20137697:20137746,20138426:20144013,20138427:20143911,20138516:20138540,20138772:20138849,20138915:20143739,20138916:20138954,20139200:20139207,20139318:20139332,20139389:20139433,20139549:20139669,20140005:20140075,20140122:20140196,20140506:20140546,20140742:20140791,20141170:20141178,20141364:20141445,20141528:20141569,20141794:20141845,20142523:20142585,20170849:20171471,20174067:20175123,20194943:20234043,20194946:20201711,20194960:20194974,20205159:20206491,20205160:20206638,20207272:20210435,20209244:20209253,20211704:20211792,20213264:20214129,20214646:20215683,20217072:20222081,20217074:20218068,20222897:20227410,20222898:20227819,20224663:20225336,20226864:20226983,20230568:20231323,20232250:20232400,20246748:20246782,20248588:20248609,20248590:20249061,20251768:20252030,20253236:20254315,20254520:20257355,20255781:20255982,20258695:20258758,20259986:20260415,20262310:20262788,20262312:20262638,20262313:20262354,20267130:20268442,20267131:20270508,20267132:20268043,20269028:20269129,20272327:2027308', 'assoc_mat': '20137697:Carton_brun:3726:20137746,20138426:Carton_brun:3726:20144013,20138427:Carton_brun:3726:20143911,20138516:Carton_brun:3726:20138540,20138772:Carton_brun:3726:20138849,20138915:Carton_brun:3726:20143739,20138916:Carton_brun:3726:20138954,20139200:Carton_brun:3726:20139207,20139318:Carton_brun:3726:20139332,20139389:Carton_brun:3726:20139433,20139549:Carton_brun:3726:20139669,20140005:Carton_brun:3726:20140075,20140122:Carton_brun:3726:20140196,20140506:Carton_brun:3726:20140546,20140742:Carton_brun:3726:20140791,20141170:Carton_brun:3726:20141178,20141364:Carton_brun:3726:20141445,20141528:Carton_brun:3726:20141569,20141794:Carton_brun:3726:20141845,20142523:Carton_brun:3726:20142585,20170849:Carton_brun:3726:20171471,20174067:Carton_brun:3726:20175123,20194943:Carton_brun:3726:20234043,20194946:Carton_brun:3726:20201711,20194960:Carton_brun:3726:20194974,20205159:Carton_brun:3726:20206491,20205160:Carton_brun:3726:20206638,20207272:Carton_brun:3726:20210435,20209244:Carton_brun:3726:20209253,20211704:'}, {'unwanted_material': 'Carton_gris', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.008609438775156165, 'nb_photo': 641, 'list_port_cont': '20137745,20137978,20138850,20138955,20139203,20139322,20139432,20139670,20140033,20140082,20140202,20140554,20140784,20141182,20141441,20141574,20141837,20142593,20143210,20143425,20143732,20144019,20144189,20172041,20173347,20176118,20177644,20190750,20195327,20195717,20195774,20196032,20196459,20196663,20197187,20197670,20197692,20199223,20199867,20200766,20201708,20202901,20202974,20205992,20206086,20206639,20209132,20209252,20211288,20211803,20212703,20214761,20215676,20217161,20218067,20218563,20220146,20220352,20220937,20222975,20224726,20225341,20226258,20226987,20227404,20227822,20229155,20230601,20231328,20231778,20231854,20232429,20234041,20234152,20246785,20246950,20247259,20248614,20249045,20249063,20250424,20251803,20252024,20253288,20254312,20256681,20257174,20257345,20257841,20258227,20260078,20260417,20262360,20262785,20267175,20267546,20267908,20268255,20268437,20268446,20269124,20270500,20272396,20272722,20272906,20273057,20273082,20275254,20275472,20275727,20276251,20276885,20276973,2027718', 'assoc_port': '20137697:20137745,20137964:20137978,20138425:20144189,20138426:20144019,20138772:20138850,20138915:20143732,20138916:20138955,20139200:20139203,20139318:20139322,20139389:20139432,20139549:20139670,20140004:20140033,20140005:20140082,20140122:20140202,20140506:20140554,20140742:20140784,20141169:20143210,20141170:20141182,20141364:20141441,20141528:20141574,20141794:20141837,20142523:20142593,20143389:20143425,20170850:20172041,20172870:20173347,20174066:20190750,20175421:20176118,20177161:20177644,20194937:20205992,20194940:20234152,20194942:20202974,20194943:20234041,20194946:20201708,20194948:20199867,20194950:20200766,20194951:20199223,20194952:20197692,20194953:20197670,20194954:20196459,20194955:20196663,20194956:20197187,20194957:20196032,20194958:20195774,20194959:20195717,20194961:20195327,20201732:20202901,20205158:20211288,20205160:20206639,20205161:20206086,20207273:20209132,20209244:20209252,20211703:20212703,20211704:20211803,20214646:20215676,20214647:20214761,20217073:20217161,20217074:2021806', 'assoc_mat': '20137697:Carton_gris:3726:20137745,20137964:Carton_gris:3726:20137978,20138425:Carton_gris:3726:20144189,20138426:Carton_gris:3726:20144019,20138772:Carton_gris:3726:20138850,20138915:Carton_gris:3726:20143732,20138916:Carton_gris:3726:20138955,20139200:Carton_gris:3726:20139203,20139318:Carton_gris:3726:20139322,20139389:Carton_gris:3726:20139432,20139549:Carton_gris:3726:20139670,20140004:Carton_gris:3726:20140033,20140005:Carton_gris:3726:20140082,20140122:Carton_gris:3726:20140202,20140506:Carton_gris:3726:20140554,20140742:Carton_gris:3726:20140784,20141169:Carton_gris:3726:20143210,20141170:Carton_gris:3726:20141182,20141364:Carton_gris:3726:20141441,20141528:Carton_gris:3726:20141574,20141794:Carton_gris:3726:20141837,20142523:Carton_gris:3726:20142593,20143389:Carton_gris:3726:20143425,20170850:Carton_gris:3726:20172041,20172870:Carton_gris:3726:20173347,20174066:Carton_gris:3726:20190750,20175421:Carton_gris:3726:20176118,20177161:Carton_gris:3726:20177644,20194937:Carton_gris:3726:20205992,20194940:'}, {'unwanted_material': 'kraft', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.002325712217462401, 'nb_photo': 49, 'list_port_cont': '20138534,20143733,20143916,20144021,20210118,20226989,20233885,20262632,20275251,20293249,20293448,20293616,20294381,20294483,20324159,20358687,20361772,20392545,20392642,20397635,20407298,20410438,20419883,20433935,20435099,20435315,20440171,20440944,20458975,20459373,20459554,20472936,20480205,20482378,20487083,20488720,20491440,20514046,20526618,20528118,20529473,20549333,20557158,20565312,20585493', 'assoc_port': '20138426:20144021,20138427:20143916,20138516:20138534,20138915:20143733,20194945:20233885,20207275:20210118,20226864:20226989,20262312:20262632,20275037:20275251,20292713:20293616,20292714:20293249,20292715:20293448,20294016:20294483,20294017:20294381,20324083:20324159,20358676:20358687,20361769:20361772,20392423:20392642,20392425:20392545,20397546:20397635,20406407:20407298,20410244:20410438,20419803:20419883,20433799:20433935,20435008:20435099,20435009:20435315,20439419:20440171,20440654:20440944,20458150:20458975,20459305:20459554,20459306:20459373,20472818:20472936,20480195:20480205,20481911:20482378,20483422:20488720,20486638:20487083,20491390:20491440,20513318:20514046,20525510:20528118,20526609:20526618,20526610:20529473,20549109:20549333,20557095:20557158,20565256:20565312,20584687:20585493', 'assoc_mat': '20138426:kraft:3726:20144021,20138427:kraft:3726:20143916,20138516:kraft:3726:20138534,20138915:kraft:3726:20143733,20194945:kraft:3726:20233885,20207275:kraft:3726:20210118,20226864:kraft:3726:20226989,20262312:kraft:3726:20262632,20275037:kraft:3726:20275251,20292713:kraft:3726:20293616,20292714:kraft:3726:20293249,20292715:kraft:3726:20293448,20294016:kraft:3726:20294483,20294017:kraft:3726:20294381,20324083:kraft:3726:20324159,20358676:kraft:3726:20358687,20361769:kraft:3726:20361772,20392423:kraft:3726:20392642,20392425:kraft:3726:20392545,20397546:kraft:3726:20397635,20406407:kraft:3726:20407298,20410244:kraft:3726:20410438,20419803:kraft:3726:20419883,20433799:kraft:3726:20433935,20435008:kraft:3726:20435099,20435009:kraft:3726:20435315,20439419:kraft:3726:20440171,20440654:kraft:3726:20440944,20458150:kraft:3726:20458975,20459305:kraft:3726:20459554,20459306:kraft:3726:20459373,20472818:kraft:3726:20472936,20480195:kraft:3726:20480205,20481911:kraft:3726:20482378,20483422:kraft:3726:20488720,20486638:'}, {'unwanted_material': 'metal', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.0013051165888281256, 'nb_photo': 25, 'list_port_cont': '20141836,20143217,20197672,20206490,20234361,20301261,20306107,20328031,20395207,20400560,20414902,20418064,20421101,20438252,20453630,20458194,20469630,20487075,20487961,20509786,20516587,20520707,20522705,20530359,20572876', 'assoc_port': '20141169:20143217,20141794:20141836,20194953:20197672,20201733:20234361,20205159:20206490,20300370:20301261,20306051:20306107,20327872:20328031,20394564:20395207,20400442:20400560,20414779:20414902,20417280:20418064,20418451:20421101,20438219:20438252,20453511:20453630,20458152:20458194,20469535:20469630,20486638:20487075,20487879:20487961,20508594:20516587,20509634:20509786,20517667:20520707,20522695:20522705,20527976:20530359,20571908:20572876', 'assoc_mat': '20141169:metal:3726:20143217,20141794:metal:3726:20141836,20194953:metal:3726:20197672,20201733:metal:3726:20234361,20205159:metal:3726:20206490,20300370:metal:3726:20301261,20306051:metal:3726:20306107,20327872:metal:3726:20328031,20394564:metal:3726:20395207,20400442:metal:3726:20400560,20414779:metal:3726:20414902,20417280:metal:3726:20418064,20418451:metal:3726:20421101,20438219:metal:3726:20438252,20453511:metal:3726:20453630,20458152:metal:3726:20458194,20469535:metal:3726:20469630,20486638:metal:3726:20487075,20487879:metal:3726:20487961,20508594:metal:3726:20516587,20509634:metal:3726:20509786,20517667:metal:3726:20520707,20522695:metal:3726:20522705,20527976:metal:3726:20530359,20571908:metal:3726:20572876'}, {'unwanted_material': 'plastique', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007337143311042502, 'nb_photo': 794, 'list_port_cont': '20137981,20138536,20138847,20138960,20139115,20139211,20139327,20139436,20139666,20140029,20140081,20140198,20140552,20140785,20141173,20141444,20141572,20141847,20141997,20142584,20143213,20143424,20143743,20143910,20144194,20170665,20171479,20172758,20172880,20173355,20175131,20176125,20177649,20188763,20194971,20195324,20195721,20195778,20196035,20196664,20197671,20200759,20201715,20202907,20206487,20210116,20210438,20210552,20211289,20211799,20212700,20213395,20214127,20214764,20217166,20218064,20219007,20220350,20220946,20222088,20222966,20224724,20225339,20226261,20226984,20227826,20227885,20229157,20231325,20231781,20231850,20232397,20232419,20232830,20233707,20233864,20233884,20234040,20234146,20234518,20234593,20246944,20247255,20247935,20248607,20249043,20249058,20250423,20251802,20252031,20253280,20254313,20254687,20255978,20256680,20257171,20257354,20257843,20258753,20260072,20260421,20262352,20262635,20262789,20265265,20267183,20267553,20267917,20268261,20268441,20268455,20269127,20270505,2027272', 'assoc_port': '20137964:20137981,20138425:20144194,20138427:20143910,20138516:20138536,20138772:20138847,20138915:20143743,20138916:20138960,20139056:20139115,20139200:20139211,20139318:20139327,20139389:20139436,20139549:20139666,20140004:20140029,20140005:20140081,20140122:20140198,20140506:20140552,20140742:20140785,20141169:20143213,20141170:20141173,20141364:20141444,20141528:20141572,20141794:20141847,20141995:20141997,20142523:20142584,20143389:20143424,20170003:20170665,20170849:20171479,20172043:20172880,20172044:20172758,20172870:20173355,20174067:20175131,20175420:20188763,20175421:20176125,20177161:20177649,20194938:20234593,20194939:20234518,20194940:20234146,20194943:20234040,20194944:20233864,20194945:20233884,20194946:20201715,20194947:20233707,20194950:20200759,20194953:20197671,20194955:20196664,20194957:20196035,20194958:20195778,20194959:20195721,20194960:20194971,20194961:20195324,20201732:20202907,20205158:20211289,20205159:20206487,20207259:20210552,20207272:20210438,20207275:20210116,20211703:2021270', 'assoc_mat': '20137964:plastique:3726:20137981,20138425:plastique:3726:20144194,20138427:plastique:3726:20143910,20138516:plastique:3726:20138536,20138772:plastique:3726:20138847,20138915:plastique:3726:20143743,20138916:plastique:3726:20138960,20139056:plastique:3726:20139115,20139200:plastique:3726:20139211,20139318:plastique:3726:20139327,20139389:plastique:3726:20139436,20139549:plastique:3726:20139666,20140004:plastique:3726:20140029,20140005:plastique:3726:20140081,20140122:plastique:3726:20140198,20140506:plastique:3726:20140552,20140742:plastique:3726:20140785,20141169:plastique:3726:20143213,20141170:plastique:3726:20141173,20141364:plastique:3726:20141444,20141528:plastique:3726:20141572,20141794:plastique:3726:20141847,20141995:plastique:3726:20141997,20142523:plastique:3726:20142584,20143389:plastique:3726:20143424,20170003:plastique:3726:20170665,20170849:plastique:3726:20171479,20172043:plastique:3726:20172880,20172044:plastique:3726:20172758,20172870:plastique:3726:20173355,20174067:plastique:3726:20175131,2'}, {'unwanted_material': 'Teint_Dans_La_Masse', 'main_material': 'JRM', 'pht_type': 3726, 'ratio': 0.007102655526567405, 'nb_photo': 1243, 'list_port_cont': '20137972,20138535,20138854,20138959,20139117,20139206,20139331,20139672,20140023,20140076,20140205,20140556,20140783,20141177,20141450,20141571,20141841,20141999,20142587,20143211,20143433,20143741,20143912,20144011,20144192,20171480,20172039,20172872,20173352,20176126,20194965,20195320,20195773,20196667,20197194,20197674,20199220,20199864,20200761,20201705,20202982,20203339,20203504,20205985,20206489,20206636,20209135,20210433,20210547,20211290,20211800,20212704,20213396,20214132,20214765,20215681,20217155,20218074,20218568,20219005,20220138,20220348,20220945,20222082,20222976,20224723,20225337,20225916,20226257,20226982,20227403,20227713,20227827,20227882,20229154,20230599,20231326,20231777,20231852,20232428,20232838,20233711,20233868,20233878,20234044,20234149,20234359,20234513,20234599,20246790,20247253,20247928,20248608,20249048,20249056,20251801,20252034,20253287,20254317,20254684,20255984,20256675,20257164,20257346,20258231,20258755,20260413,20262355,20262636,20262790,20267555,20267907,20268049,2026825', 'assoc_port': '20137964:20137972,20138425:20144192,20138426:20144011,20138427:20143912,20138516:20138535,20138772:20138854,20138915:20143741,20138916:20138959,20139056:20139117,20139200:20139206,20139318:20139331,20139549:20139672,20140004:20140023,20140005:20140076,20140122:20140205,20140506:20140556,20140742:20140783,20141169:20143211,20141170:20141177,20141364:20141450,20141528:20141571,20141794:20141841,20141995:20141999,20142523:20142587,20143389:20143433,20170849:20171480,20170850:20172039,20172043:20172872,20172870:20173352,20175421:20176126,20194937:20205985,20194938:20234599,20194939:20234513,20194940:20234149,20194941:20203339,20194942:20202982,20194943:20234044,20194944:20233868,20194945:20233878,20194946:20201705,20194947:20233711,20194948:20199864,20194949:20203504,20194950:20200761,20194951:20199220,20194953:20197674,20194955:20196667,20194956:20197194,20194958:20195773,20194960:20194965,20194961:20195320,20201733:20234359,20205158:20211290,20205159:20206489,20205160:20206636,20207259:20210547,20207272:2021043', 'assoc_mat': '20137964:Teint_Dans_La_Masse:3726:20137972,20138425:Teint_Dans_La_Masse:3726:20144192,20138426:Teint_Dans_La_Masse:3726:20144011,20138427:Teint_Dans_La_Masse:3726:20143912,20138516:Teint_Dans_La_Masse:3726:20138535,20138772:Teint_Dans_La_Masse:3726:20138854,20138915:Teint_Dans_La_Masse:3726:20143741,20138916:Teint_Dans_La_Masse:3726:20138959,20139056:Teint_Dans_La_Masse:3726:20139117,20139200:Teint_Dans_La_Masse:3726:20139206,20139318:Teint_Dans_La_Masse:3726:20139331,20139549:Teint_Dans_La_Masse:3726:20139672,20140004:Teint_Dans_La_Masse:3726:20140023,20140005:Teint_Dans_La_Masse:3726:20140076,20140122:Teint_Dans_La_Masse:3726:20140205,20140506:Teint_Dans_La_Masse:3726:20140556,20140742:Teint_Dans_La_Masse:3726:20140783,20141169:Teint_Dans_La_Masse:3726:20143211,20141170:Teint_Dans_La_Masse:3726:20141177,20141364:Teint_Dans_La_Masse:3726:20141450,20141528:Teint_Dans_La_Masse:3726:20141571,20141794:Teint_Dans_La_Masse:3726:20141841,20141995:Teint_Dans_La_Masse:3726:20141999,20142523:Teint_Dans_La_Masse:3726:2'}), 'main_stat': {'nb_photos': 12527}}, 'hostname': (), 'impurety_average_per_hashtag': []} filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense/sla_mensuel_arc_en_ciel_jrm_peu_dense_mois_02_annee_2025.pdf Before plot_photos_and_unwanted_material_summary # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? Before organize_and_plot_unwanted_material_stats {'JRM': {'autre_refus': ['autre_refus', '0.67%', 326], 'cartonnette': ['cartonnette', '0.68%', 724], 'Carton_brun': ['Carton_brun', '0.76%', 400], 'Carton_gris': ['Carton_gris', '0.86%', 641], 'kraft': ['kraft', '0.23%', 49], 'metal': ['metal', '0.13%', 25], 'plastique': ['plastique', '0.73%', 794], 'Teint_Dans_La_Masse': ['Teint_Dans_La_Masse', '0.71%', 1243]}} before organize_and_plot_impurety_average_data before organize_and_plot_quality_photo_data finish generating filepath : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense/sla_mensuel_arc_en_ciel_jrm_peu_dense_mois_02_annee_2025.pdf le fichier se trouve ici : /data_2/data_log/job/memo/arc_en_ciel_jrm_peu_dense 2.97user 2.39system 0:11.23elapsed 47%CPU (0avgtext+0avgdata 195372maxresident)k 19168inputs+432outputs (7major+74387minor)pagefaults 0swaps