python /home/admin/mtr/script_for_cron.py -j default -m 30 -a 'python3 /home/admin/workarea/git/Velours/python/prod/memo/memo.py -j create_report_from_API --date_start=2025-01-02 --date_end=2025-01-06 --dashboard_places=arc_en_ciel_jrm --mail_list=kexin@fotonower.com' -s rubbia_report -M 0 -S 0 -U 120,120,120
 import MySQLdb succeeded 
Import error (python version)
Need env var : LOGRASPI
Raspi : , Date : 
 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py
 _cr_cnf_ : /home/admin/mtr/.credentials/credentials.py
warning , we can't find thcl infos in json_data
warning , we can't find pdt infos in json_data
TODO : Insert select and so on
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
 DONE and to test : checkNoCycle !
We are managing only one step so we do not consider checkConsistencyNbInputNbOutput !
We are managing only one step so we do not consider checkConsistencyTypeOutputInput !
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
 DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs !
Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition !
Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6
WARNING : type of output 1 of step 13596 doesn't seem to be define in the database(
WARNING : type of input 3 of step 11881 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18
WARNING : type of output 1 of step 13625 doesn't seem to be define in the database(
WARNING : type of input 5 of step 11884 doesn't seem to be define in the database(
DataTypes for each output/input checked !
Unexpected error treated as WARNING for now expected given param in final step
{'name_pipeline': 'aggregate_carac_ratio', 'hashtag_type': 3726, 'hashtag_proportion': 'Carton_brun,Carton_gris,Teint_Dans_La_Masse,autre_refus,cartonnette,kraft,metal,plastique', 'hashtag_parmi': 'papier', 'hashtag_weights': {'Carton_brun': 2, 'Carton_gris': 1.5, 'Teint_Dans_La_Masse': 1.0, 'autre_refus': 1.5, 'cartonnette': 1.0, 'kraft': 1.5, 'metal': 3, 'plastique': 1}}
Found hashtag_parmi in final step, will be used and useful if different from matiere_majoritaire in classifier 
search info for 2025-01-02
datou_id: 4878, portfolio_id: 19362610, portfolio_name: arc_en_ciel_jrm_02012025, dashboard_place_id: 10
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
 DONE and to test : checkNoCycle !
We are managing only one step so we do not consider checkConsistencyNbInputNbOutput !
We are managing only one step so we do not consider checkConsistencyTypeOutputInput !
{'JRM': 4302}
4302
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
 DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs !
Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition !
Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6
WARNING : type of output 1 of step 13596 doesn't seem to be define in the database(
WARNING : type of input 3 of step 11881 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18
WARNING : type of output 1 of step 13625 doesn't seem to be define in the database(
WARNING : type of input 5 of step 11884 doesn't seem to be define in the database(
DataTypes for each output/input checked !
{'JRM': 3726}
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
search info for 2025-01-03
datou_id: 4878, portfolio_id: 19382293, portfolio_name: arc_en_ciel_jrm_03012025, dashboard_place_id: 10
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
 DONE and to test : checkNoCycle !
We are managing only one step so we do not consider checkConsistencyNbInputNbOutput !
We are managing only one step so we do not consider checkConsistencyTypeOutputInput !
{'JRM': 4302}
4302
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
 DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs !
Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition !
Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6
WARNING : type of output 1 of step 13596 doesn't seem to be define in the database(
WARNING : type of input 3 of step 11881 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18
WARNING : type of output 1 of step 13625 doesn't seem to be define in the database(
WARNING : type of input 5 of step 11884 doesn't seem to be define in the database(
DataTypes for each output/input checked !
{'JRM': 3726}
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
search info for 2025-01-04
datou_id: 4878, portfolio_id: 19402941, portfolio_name: arc_en_ciel_jrm_04012025, dashboard_place_id: 10
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
 DONE and to test : checkNoCycle !
We are managing only one step so we do not consider checkConsistencyNbInputNbOutput !
We are managing only one step so we do not consider checkConsistencyTypeOutputInput !
{'JRM': 4302}
4302
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
 DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs !
Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition !
Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6
WARNING : type of output 1 of step 13596 doesn't seem to be define in the database(
WARNING : type of input 3 of step 11881 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18
WARNING : type of output 1 of step 13625 doesn't seem to be define in the database(
WARNING : type of input 5 of step 11884 doesn't seem to be define in the database(
DataTypes for each output/input checked !
{'JRM': 3726}
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
search info for 2025-01-05
tuple index out of range
search info for 2025-01-06
datou_id: 4878, portfolio_id: 19427968, portfolio_name: arc_en_ciel_jrm_06012025, dashboard_place_id: 10
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
 DONE and to test : checkNoCycle !
We are managing only one step so we do not consider checkConsistencyNbInputNbOutput !
We are managing only one step so we do not consider checkConsistencyTypeOutputInput !
{'JRM': 4302}
4302
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
 Tree builded and cycle checked, now we need to re-order the steps ! 
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
 DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 13596 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 11881 final have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs !
Step 11881 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
WARNING : number of outputs for step 13625 velours_tree is not consistent : 2 used against 1 in the step definition !
Step 11884 send_mail_cod have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 3 of step 11884 have datatype=6
WARNING : type of output 1 of step 13596 doesn't seem to be define in the database(
WARNING : type of input 3 of step 11881 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18
WARNING : type of output 1 of step 13625 doesn't seem to be define in the database(
WARNING : type of input 5 of step 11884 doesn't seem to be define in the database(
DataTypes for each output/input checked !
{'JRM': 3726}
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
calcul order for each photo with time
calcul time for a portfolio
calcul order for each photo with time
calcul time for a portfolio
on calcule le portfolio_carac ratio
dans le csv
202
b''
Server: nginx
Date: Fri, 25 Apr 2025 13:04:26 GMT
Content-Length: 0
Connection: close
X-Message-Id: Kq-RaRerQ6uUagOW6Sc9bg
Access-Control-Allow-Origin: https://sendgrid.api-docs.io
Access-Control-Allow-Methods: POST
Access-Control-Allow-Headers: Authorization, Content-Type, On-behalf-of, x-sg-elas-acl
Access-Control-Max-Age: 600
X-No-CORS-Reason: https://sendgrid.com/docs/Classroom/Basics/API/cors.html
Strict-Transport-Security: max-age=31536000; includeSubDomains
Content-Security-Policy: frame-ancestors 'none'
Cache-Control: no-cache
X-Content-Type-Options: no-sniff
Referrer-Policy: strict-origin-when-cross-origin


2.18user 1.01system 0:07.72elapsed 41%CPU (0avgtext+0avgdata 172268maxresident)k
54376inputs+72outputs (359major+70185minor)pagefaults 0swaps