python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/tests/python_tests.py --list_job_run=datou:[certificat_qualite_papier]' -s python_test -M 0 -S 0 -U 90,80,95 import MySQLdb succeeded Import error (python version) python version = 3 warning , we can't find thcl infos in json_data warning , we can't find pdt infos in json_data python version used : 3 #&_# BEGIN OF TEST : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/datou_test.py Datou All Test python version used : 3 ############################### TEST certificat_qualite_papier ################################ TEST certificat qualite papier Inside batchDatouExec : verbose : False # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! Step 4442 tile have less inputs used (1) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 4441 detect_points is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 4443 count_percent_refus is not consistent : 4 used against 3 in the step definition ! Step 4444 send_mail_dechet have less inputs used (3) than in the step definition (5) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : output 1 of step 4440 have datatype=1 whereas input 0 of step 4443 have datatype=2 WARNING : type of output 1 of step 4441 doesn't seem to be define in the database( WARNING : type of input 4 of step 4443 doesn't seem to be define in the database( DataTypes for each output/input checked ! List Step Type Loaded in datou : init_dechet, tile, detect_points, count_percent_refus, brightness, blur_detection, send_mail_dechet list_input_json : [] origin We have 1 , BFwe have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB length of list_filenames : 1 ; length of list_pids : 1 ; length of list_args : 1 time to download the photos : 0.13295459747314453 About to test input to load we should then remove the video here, and this would fix the bug of datou_current ! Calling datou_exec Inside datou_exec : verbose : False number of steps : 7 step1:init_dechet Thu Sep 25 15:50:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec debut step init detect dechets input : temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea.jpg ON MODIFIE NB AVEC LE INPUT map photo id path extension : temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea.jpg scale : 0.9481481481481482 FIN step init dechet Inside saveOutput : final : False verbose : False saveOutput not yet implemented for datou_step.type : init_dechet we use saveGeneral [987321136] Looping around the photos to save general results len do output : 1 /987321136Didn't retrieve data .Didn't retrieve data .Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('1848', None, None, None, None, None, None, None, None) ('1848', '1902940', '987321136', None, None, None, None, None, None) begin to insert list_values into mtr_datou_result : length of list_values in save_final : 4 time used for this insertion : 0.011686086654663086 save_final save missing photos in datou_result : time spend for datou_step_exec : 0.00029730796813964844 time spend to save output : 0.011795997619628906 total time spend for step 1 : 0.012093305587768555 step2:tile Thu Sep 25 15:50:00 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec Currently we do not manage missing dependencies information, that could maybe be correctly interpreted with default behavior Some of the step done at execution of the step could be done before when the tree of execution is build and the dependencies of different step analysed complete output_args for input 0 We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! We should have FATAL ERROR but same_nb_input_output==True : this should be an optionnal input ! VR 22-3-18 : For now we do not clean correctly the datou structure verbose : False param_json : {'token': '78d09a0790ec6ecbf119343125a81fdc', 'portfolio_name': 'tile_correct_upm', 'ETA': 86400, 'new_width': 1500, 'new_height': 20000, 'host': 'www.fotonower.com', 'protocol': 'https', 'photo_tile_type': 1522, 'option_bande': 'True'} type(crop_hashtag_type) : type(crop_hashtag_type_tiled) : We consider crop_hashtag_type is an integer ! map_chi_type_to_chi_type_cropped : {406: 410} map_filenames : {987321136: 'temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea.jpg'} list_pids : 1 list_pids : 2 list_subpids to replace list_pids : 1 batch 1 Loaded 0 chid ids of type : 0 created feed_id_new_photos : 27230759 with name tile_correct_upm feed_id_new_photos : 27230759 filename : temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea.jpg photo_id : 987321136 height_image_input : 439 width_image_input : 562 new_width : 1500 new_height : 20000 stride : 0 stride_relative : 0.1 chi to copy from the main photo to the tiled photo input_chi_for_this_image_as_chi : 0 list_bib_to_crops : 1 [(0, 562, 0, 439, 0)] new_crops_tiles : 1 crop_transformed : 0 batch 1 Loaded 1 chid ids of type : 1522 treat the image : temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea.jpg , 0 before upload mediasElapsed time : 0.01067662239074707 About to upload 1 photos upload in portfolio : 27230759 400 uploaded one batch 0 Elapsed time : 0.13702869415283203 upload mediasElapsed time : 0.14775347709655762 ERROR in datou_step_exec, will save and exit ! 'temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea_0.jpg' File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2339, in datou_exec output = datou_step_exec(sNext, args, cache, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/datou_lib.py", line 2448, in datou_step_exec return pre_process.datou_step_exec_tile(param, json_param, args, context, map_info, verbose, mtr_user_id) File "/home/admin/workarea/git/Velours/python/mtr/datou/lib_step_exec/lib_step_pre_processing.py", line 474, in datou_step_exec_tile map_new_photo_id_files = crop_and_record(photo_id, filename, new_crops_tiles, File "/home/admin/workarea/git/Velours/python/mtr/simple_image_editor/rotate_crop_and_images.py", line 1269, in crop_and_record new_photo_id = map_path_new_photo_id[path_photo_id_temp] [987321136, 987321136] begin to insert list_values into mtr_datou_result : length of list_values in save_final : 2 time used for this insertion : 0.0145111083984375 save_final ERROR in last step tile, 'temp/1758808200_3078284_987321136_6a08497399a24a3041045c21475a90ea_0.jpg' time spend for datou_step_exec : 8.514362573623657 time spend to save output : 0.023863792419433594 total time spend for step 1 : 8.53822636604309 Useless call to update_current_state caffe_path_current : About to save ! 2 After save, about to update current ! datou_cur_ids : [] len(datou.list_steps) : 7 output : None probably due to empty image bug ERROR expected : {987321136: (-110, -0.39870825574700136, -5.392404060312662, 30.0, 61.64383561643836, {'carton': 3, 'Papier_Magazine': 7}, {'refus_total': 30.0, 'carton': 30.0, 'Papier_Magazine': 70.0}, {'refus_total': 61.64383561643836, 'carton': 61.64383561643836, 'Papier_Magazine': 38.35616438356164})} got : None ERROR certificat_qualite_papier FAILED #&_#_#&_# TEST certificat_qualite_papier FAILED #&_#_#&_# #&_# TEST FAILED #&_# : tests/datou_test #&_# #&_# END OF TEST #&_# : tests/datou_test #&_# /home/admin/workarea/git/Velours/python/tests/python_tests.py:11: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses import imp #######all_test_python_finish###### insert result in bdd : Test are not running on charlot, the path should be tested ! /data_4/data_log/job/2025/September/25092025/python_test3/output_tests_python-1550.html new path : /proc/3078284/ 1.50user 2.39system 0:10.10elapsed 38%CPU (0avgtext+0avgdata 142832maxresident)k 85440inputs+336outputs (344major+60776minor)pagefaults 0swaps