python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4891' -s datou_current_4891 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2442720 load datou : 4891 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec updating current state to 1 list_input_json: [] Current got : datou_id : 4891, datou_cur_ids : ['3882074'] with mtr_portfolio_ids : ['27544537'] and first list_photo_ids : [] new path : /proc/2442720/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : [] origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.07293295860290527 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Wed Oct 8 08:40:31 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3892, 'mtr_user_id': 31, 'name': 'learn_MM_generique_26022025', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '17736100,17736101,17736102,17736103,17736104,20837895,20837896,17736107,17736108,17736109,17736110,18876169', 'photo_hashtag_type': 4989, 'photo_desc_type': 6092, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 163),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 163} 07102025 27544537 Nombre de photos uploadées : 163 / 23040 (0%) 07102025 27544537 Nombre de photos taguées (types de déchets): 163 / 163 (100%) 07102025 27544537 Nombre de photos taguées (volume) : 163 / 163 (100%) elapsed_time : load_data_split_time_score 2.6226043701171875e-06 elapsed_time : order_list_meta_photo_and_scores 0.00010967254638671875 elapsed_time : fill_and_build_computed_from_old_data 0.012314081192016602 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.6471290588378906 Creating list_photo_total elapsed_time : select_descriptors 0.019897937774658203 07102025 27544537 Nombre de photos avec descriptors (type 6092) : 0 / 0 (0%) Missing descriptors for photos 0 and 1387850427 0:00:00|ON:Missing descriptors for photos 1387850427 and 1387850429 Missing descriptors for photos 1387850429 and 1387850431 Missing descriptors for photos 1387850431 and 1387850434 Missing descriptors for photos 1387850434 and 1387850437 Missing descriptors for photos 1387850437 and 1387850439 Missing descriptors for photos 1387850439 and 1387850446 Missing descriptors for photos 1387850446 and 1387850448 Missing descriptors for photos 1387850448 and 1387850449 Missing descriptors for photos 1387850449 and 1387850452 Missing descriptors for photos 1387850452 and 1387850455 Missing descriptors for photos 1387850455 and 1387850457 Missing descriptors for photos 1387850457 and 1387850467 Missing descriptors for photos 1387850467 and 1387850470 Missing descriptors for photos 1387850470 and 1387850472 Missing descriptors for photos 1387850472 and 1387850475 Missing descriptors for photos 1387850475 and 1387850477 Missing descriptors for photos 1387850477 and 1387850480 Missing descriptors for photos 1387850480 and 1387850482 Missing descriptors for photos 1387850482 and 1387850484 Missing descriptors for photos 1387850484 and 1387850486 Missing descriptors for photos 1387850486 and 1387850488 Missing descriptors for photos 1387850488 and 1387850491 Missing descriptors for photos 1387850491 and 1387850494 Missing descriptors for photos 1387850494 and 1387850501 Missing descriptors for photos 1387850501 and 1387850505 Missing descriptors for photos 1387850505 and 1387850507 Missing descriptors for photos 1387850507 and 1387850536 Missing descriptors for photos 1387850536 and 1387850585 Missing descriptors for photos 1387850585 and 1387850633 Missing descriptors for photos 1387850633 and 1387850702 Missing descriptors for photos 1387850702 and 1387850705 Missing descriptors for photos 1387850705 and 1387850706 Missing descriptors for photos 1387850706 and 1387850707 Missing descriptors for photos 1387850707 and 1387850709 Missing descriptors for photos 1387850709 and 1387850711 Missing descriptors for photos 1387850711 and 1387850834 Missing descriptors for photos 1387850834 and 1387850883 Missing descriptors for photos 1387850883 and 1387850929 Missing descriptors for photos 1387850929 and 1387850978 Missing descriptors for photos 1387850978 and 1387851025 Missing descriptors for photos 1387851025 and 1387851077 Missing descriptors for photos 1387851077 and 1387851205 Missing descriptors for photos 1387851205 and 1387851257 Missing descriptors for photos 1387851257 and 1387851302 Missing descriptors for photos 1387851302 and 1387851355 Missing descriptors for photos 1387851355 and 1387851405 Missing descriptors for photos 1387851405 and 1387851461 Missing descriptors for photos 1387851461 and 1387851561 Missing descriptors for photos 1387851561 and 1387851604 Missing descriptors for photos 1387851604 and 1387851658 Missing descriptors for photos 1387851658 and 1387851702 Missing descriptors for photos 1387851702 and 1387851751 Missing descriptors for photos 1387851751 and 1387851806 Missing descriptors for photos 1387851806 and 1387851920 Missing descriptors for photos 1387851920 and 1387851924 Missing descriptors for photos 1387851924 and 1387851926 Missing descriptors for photos 1387851926 and 1387851928 Missing descriptors for photos 1387851928 and 1387851930 Missing descriptors for photos 1387851930 and 1387851932 Missing descriptors for photos 1387851932 and 1387852022 Missing descriptors for photos 1387852022 and 1387852071 Missing descriptors for photos 1387852071 and 1387852118 Missing descriptors for photos 1387852118 and 1387852197 Missing descriptors for photos 1387852197 and 1387852243 Missing descriptors for photos 1387852243 and 1387852246 Missing descriptors for photos 1387852246 and 1387852377 Missing descriptors for photos 1387852377 and 1387852381 Missing descriptors for photos 1387852381 and 1387852384 Missing descriptors for photos 1387852384 and 1387852386 Missing descriptors for photos 1387852386 and 1387852388 Missing descriptors for photos 1387852388 and 1387852390 Missing descriptors for photos 1387852390 and 1387852396 Missing descriptors for photos 1387852396 and 1387852398 Missing descriptors for photos 1387852398 and 1387852400 Missing descriptors for photos 1387852400 and 1387852402 Missing descriptors for photos 1387852402 and 1387852404 Missing descriptors for photos 1387852404 and 1387852409 Missing descriptors for photos 1387852409 and 1387852417 Missing descriptors for photos 1387852417 and 1387852420 Missing descriptors for photos 1387852420 and 1387852422 Missing descriptors for photos 1387852422 and 1387852423 Missing descriptors for photos 1387852423 and 1387852424 Missing descriptors for photos 1387852424 and 1387852427 Missing descriptors for photos 1387852427 and 1387852559 Missing descriptors for photos 1387852559 and 1387852609 Missing descriptors for photos 1387852609 and 1387852667 Missing descriptors for photos 1387852667 and 1387852718 Missing descriptors for photos 1387852718 and 1387852774 Missing descriptors for photos 1387852774 and 1387852820 Missing descriptors for photos 1387852820 and 1387852893 Missing descriptors for photos 1387852893 and 1387852896 Missing descriptors for photos 1387852896 and 1387852899 Missing descriptors for photos 1387852899 and 1387852900 Missing descriptors for photos 1387852900 and 1387852910 Missing descriptors for photos 1387852910 and 1387852962 Missing descriptors for photos 1387852962 and 1387853021 Missing descriptors for photos 1387853021 and 1387853041 Missing descriptors for photos 1387853041 and 1387853043 Missing descriptors for photos 1387853043 and 1387853045 Missing descriptors for photos 1387853045 and 1387853047 Missing descriptors for photos 1387853047 and 1387853049 Missing descriptors for photos 1387853049 and 1387853057 Missing descriptors for photos 1387853057 and 1387853061 Missing descriptors for photos 1387853061 and 1387853063 Missing descriptors for photos 1387853063 and 1387853065 Missing descriptors for photos 1387853065 and 1387853067 Missing descriptors for photos 1387853067 and 1387853069 Missing descriptors for photos 1387853069 and 1387853078 Missing descriptors for photos 1387853078 and 1387853080 Missing descriptors for photos 1387853080 and 1387853082 Missing descriptors for photos 1387853082 and 1387853084 Missing descriptors for photos 1387853084 and 1387853086 Missing descriptors for photos 1387853086 and 1387853087 Missing descriptors for photos 1387853087 and 1387853097 Missing descriptors for photos 1387853097 and 1387853099 Missing descriptors for photos 1387853099 and 1387853102 Missing descriptors for photos 1387853102 and 1387853104 Missing descriptors for photos 1387853104 and 1387853106 Missing descriptors for photos 1387853106 and 1387853108 Missing descriptors for photos 1387853108 and 1387853113 Missing descriptors for photos 1387853113 and 1387853116 Missing descriptors for photos 1387853116 and 1387853117 Missing descriptors for photos 1387853117 and 1387853120 Missing descriptors for photos 1387853120 and 1387853122 Missing descriptors for photos 1387853122 and 1387853124 Missing descriptors for photos 1387853124 and 1387853132 Missing descriptors for photos 1387853132 and 1387853135 Missing descriptors for photos 1387853135 and 1387853138 Missing descriptors for photos 1387853138 and 1387853140 Missing descriptors for photos 1387853140 and 1387853143 Missing descriptors for photos 1387853143 and 1387853146 Missing descriptors for photos 1387853146 and 1387853493 Missing descriptors for photos 1387853493 and 1387853593 Missing descriptors for photos 1387853593 and 1387853678 Missing descriptors for photos 1387853678 and 1387853732 Missing descriptors for photos 1387853732 and 1387853784 Missing descriptors for photos 1387853784 and 1387853882 Missing descriptors for photos 1387853882 and 1387854005 Missing descriptors for photos 1387854005 and 1387854007 Missing descriptors for photos 1387854007 and 1387854011 Missing descriptors for photos 1387854011 and 1387854014 Missing descriptors for photos 1387854014 and 1387854016 Missing descriptors for photos 1387854016 and 1387854018 Missing descriptors for photos 1387854018 and 1387854198 Missing descriptors for photos 1387854198 and 1387854224 Missing descriptors for photos 1387854224 and 1387854228 Missing descriptors for photos 1387854228 and 1387854230 Missing descriptors for photos 1387854230 and 1387854234 Missing descriptors for photos 1387854234 and 1387854237 Missing descriptors for photos 1387854237 and 1387854243 Missing descriptors for photos 1387854243 and 1387854246 Missing descriptors for photos 1387854246 and 1387854248 Missing descriptors for photos 1387854248 and 1387854250 Missing descriptors for photos 1387854250 and 1387854254 Missing descriptors for photos 1387854254 and 1387854258 Missing descriptors for photos 1387854258 and 1387854266 Missing descriptors for photos 1387854266 and 1387854271 Missing descriptors for photos 1387854271 and 1387854274 Missing descriptors for photos 1387854274 and 1387854277 Missing descriptors for photos 1387854277 and 1387854280 Missing descriptors for photos 1387854280 and 1387854282 Missing descriptors for photos 1387854282 and 1388025963 07102025 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 163 time used for this insertion : 0.0727090835571289 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.16347002983093262 Creating list_photo_total elapsed_time : count_sum_diff_and_build_graph 0.0015246868133544922 Total photos : 163 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 163 Number of lists : 0 counter photos in port : 0 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 0 photos in 0 portfolios ! hashtag : flux_dev(2107760238) : 0 photos in 0 portfolios ! hashtag : jrm(495916461) : 0 photos in 0 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 0 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.008482933044433594 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 3.0994415283203125e-06 today str has not a value , we define it as the date of the first image todaystr_first : 07102025 attention , prev_timestamp is 0 , we do nothing ***Count Time bigger than 30s : 3 #Number Photos for regression : {'07102025': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 1778.9986610412598, 2107751016: 0, 2107751017: 0}}} 07102025|aluminium, 05102018_papier_non_papier_dense:0 07102025|aluminium, 05102018_papier_non_papier_peu_dense:0 07102025|aluminium, 05102018_papier_non_papier_presque_vide:0 07102025|aluminium, 05102018_papier_non_papier_tres_dense:0 07102025|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 07102025|ela, 05102018_papier_non_papier_dense:0 07102025|ela, 05102018_papier_non_papier_peu_dense:0 07102025|ela, 05102018_papier_non_papier_presque_vide:0 07102025|ela, 05102018_papier_non_papier_tres_dense:0 07102025|ela, 05102018_papier_non_papier_tres_peu_dense:0 07102025|emr, 05102018_papier_non_papier_dense:0 07102025|emr, 05102018_papier_non_papier_peu_dense:0 07102025|emr, 05102018_papier_non_papier_presque_vide:0 07102025|emr, 05102018_papier_non_papier_tres_dense:0 07102025|emr, 05102018_papier_non_papier_tres_peu_dense:0 07102025|film_pedb, 05102018_papier_non_papier_dense:0 07102025|film_pedb, 05102018_papier_non_papier_peu_dense:0 07102025|film_pedb, 05102018_papier_non_papier_presque_vide:0 07102025|film_pedb, 05102018_papier_non_papier_tres_dense:0 07102025|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 07102025|flux_dev, 05102018_papier_non_papier_dense:0 07102025|flux_dev, 05102018_papier_non_papier_peu_dense:0 07102025|flux_dev, 05102018_papier_non_papier_presque_vide:0 07102025|flux_dev, 05102018_papier_non_papier_tres_dense:0 07102025|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 07102025|jrm, 05102018_papier_non_papier_dense:0 07102025|jrm, 05102018_papier_non_papier_peu_dense:0 07102025|jrm, 05102018_papier_non_papier_presque_vide:0 07102025|jrm, 05102018_papier_non_papier_tres_dense:0 07102025|jrm, 05102018_papier_non_papier_tres_peu_dense:0 07102025|pcm, 05102018_papier_non_papier_dense:0 07102025|pcm, 05102018_papier_non_papier_peu_dense:0 07102025|pcm, 05102018_papier_non_papier_presque_vide:0 07102025|pcm, 05102018_papier_non_papier_tres_dense:0 07102025|pcm, 05102018_papier_non_papier_tres_peu_dense:0 07102025|pcnc, 05102018_papier_non_papier_dense:0 07102025|pcnc, 05102018_papier_non_papier_peu_dense:0 07102025|pcnc, 05102018_papier_non_papier_presque_vide:0 07102025|pcnc, 05102018_papier_non_papier_tres_dense:0 07102025|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 07102025|pehd_pp, 05102018_papier_non_papier_dense:0 07102025|pehd_pp, 05102018_papier_non_papier_peu_dense:0 07102025|pehd_pp, 05102018_papier_non_papier_presque_vide:0 07102025|pehd_pp, 05102018_papier_non_papier_tres_dense:0 07102025|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 07102025|pet_clair, 05102018_papier_non_papier_dense:0 07102025|pet_clair, 05102018_papier_non_papier_peu_dense:0 07102025|pet_clair, 05102018_papier_non_papier_presque_vide:0 07102025|pet_clair, 05102018_papier_non_papier_tres_dense:0 07102025|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 07102025|refus, 05102018_papier_non_papier_dense:0 07102025|refus, 05102018_papier_non_papier_peu_dense:0 07102025|refus, 05102018_papier_non_papier_presque_vide:0 07102025|refus, 05102018_papier_non_papier_tres_dense:0 07102025|refus, 05102018_papier_non_papier_tres_peu_dense:0 07102025|tapis_vide, 05102018_papier_non_papier_dense:0 07102025|tapis_vide, 05102018_papier_non_papier_peu_dense:0 07102025|tapis_vide, 05102018_papier_non_papier_presque_vide:1778.9986610412598 07102025|tapis_vide, 05102018_papier_non_papier_tres_dense:0 07102025|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 07102025_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 0 Number amount portfolio for this type of dechet : film_pedb 0 Number amount portfolio for this type of dechet : flux_dev 0 Number amount portfolio for this type of dechet : jrm 0 Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 0 Number amount portfolio for this type of dechet : pet_clair 0 Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 162 Created to study and clean : 27580545 with name like 07102025_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 0 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['emr', 'gm', 'jrm', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev', 'aluminium', 'tapis_vide', 'refus', 'emr', 'gm'] We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 4.116522550582886 # DISPLAY ALL COLLECTED DATA : {'07102025': {'nb_upload': 163, 'nb_taggue_class': 163, 'nb_taggue_densite': 163, 'nb_descriptors': 0, 'number_port': 0, 'count_photo_in_port': 0, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 0, 'nb_portfolios': 0}, 'flux_dev': {'nb_photos': 0, 'nb_portfolios': 0}, 'jrm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1388025963, 1387854282, 1387854280, 1387854277, 1387854274, 1387854271, 1387854266, 1387854258, 1387854254, 1387854250, 1387854248, 1387854246, 1387854243, 1387854237, 1387854234, 1387854230, 1387854228, 1387854224, 1387854198, 1387854018, 1387854016, 1387854014, 1387854011, 1387854007, 1387854005, 1387853882, 1387853784, 1387853732, 1387853678, 1387853593, 1387853493, 1387853146, 1387853143, 1387853140, 1387853138, 1387853135, 1387853132, 1387853124, 1387853122, 1387853120, 1387853117, 1387853116, 1387853113, 1387853108, 1387853106, 1387853104, 1387853102, 1387853099, 1387853097, 1387853087, 1387853086, 1387853084, 1387853082, 1387853080, 1387853078, 1387853069, 1387853067, 1387853065, 1387853063, 1387853061, 1387853057, 1387853049, 1387853047, 1387853045, 1387853043, 1387853041, 1387853021, 1387852962, 1387852910, 1387852900, 1387852899, 1387852896, 1387852893, 1387852820, 1387852774, 1387852718, 1387852667, 1387852609, 1387852559, 1387852427, 1387852424, 1387852423, 1387852422, 1387852420, 1387852417, 1387852409, 1387852404, 1387852402, 1387852400, 1387852398, 1387852396, 1387852390, 1387852388, 1387852386, 1387852384, 1387852381, 1387852377, 1387852246, 1387852243, 1387852197] Looping around the photos to save general results len do output : 1 /27544537Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1388025963', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854282', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854280', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854277', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854274', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854271', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854266', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854258', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854254', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854250', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854248', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854246', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854243', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854237', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854234', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854230', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854228', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854224', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854198', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854018', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854016', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854014', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854011', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854007', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387854005', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853882', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853784', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853732', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853678', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853593', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853493', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853146', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853143', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853140', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853138', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853135', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853132', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853124', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853122', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853120', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853117', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853116', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853113', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853108', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853106', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853104', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853102', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853099', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853097', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853087', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853086', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853084', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853082', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853080', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853078', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853069', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853067', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853065', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853063', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853061', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853057', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853049', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853047', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853045', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853043', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853041', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387853021', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852962', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852910', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852900', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852899', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852896', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852893', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852820', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852774', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852718', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852667', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852609', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852559', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852427', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852424', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852423', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852422', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852420', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852417', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852409', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852404', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852402', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852400', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852398', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852396', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852390', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852388', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852386', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852384', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852381', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852377', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852246', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852243', None, None, None, None, None, '3882074') ('4891', None, None, None, None, None, None, None, '3882074') ('4891', '27544537', '1387852197', None, None, None, None, None, '3882074') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.04929208755493164 save_final save missing photos in datou_result : time spend for datou_step_exec : 5.231884241104126 time spend to save output : 0.050693511962890625 total time spend for step 1 : 5.282577753067017 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.55user 0.55system 0:10.00elapsed 21%CPU (0avgtext+0avgdata 104080maxresident)k 0inputs+88outputs (1major+49036minor)pagefaults 0swaps