python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4323' -s datou_current_4323 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3312158 load datou : 4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4323, datou_cur_ids : ['4297982'] with mtr_portfolio_ids : ['29866212'] and first list_photo_ids : [] new path : /proc/3312158/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.025484800338745117 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Jan 1 07:10:30 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3847, 'mtr_user_id': 31, 'name': 'learn_MM_generique_050224', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '13096157,13096155,13096163,13096159,13301956,13095886,13096162,13096160,13358264,13096158,5515868,13276803', 'photo_hashtag_type': 4932, 'photo_desc_type': 6032, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 58), ('01', 22), ('02', 16), ('03', 33), ('04', 2), ('05', 9), ('06', 39), ('07', 4)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 182} 01012026 29866212 Nombre de photos uploadées : 183 / 23040 (0%) 01012026 29866212 Nombre de photos taguées (types de déchets): 182 / 183 (99%) 01012026 29866212 Nombre de photos taguées (volume) : 182 / 183 (99%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 8.0108642578125e-05 ? elapsed_time : fill_and_build_computed_from_old_data 0.009807109832763672 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24714303016662598 Creating list_photo_total elapsed_time : select_descriptors 0.014117002487182617 01012026 29866212 Nombre de photos avec descriptors (type 6032) : 0 / 1 (0%) Missing descriptors for photos 0 and 1401967818 0:00:00|ON:Missing descriptors for photos 1401967818 and 1401967873 Missing descriptors for photos 1401967873 and 1401967815 Missing descriptors for photos 1401967815 and 1401967871 Missing descriptors for photos 1401967871 and 1401967864 Missing descriptors for photos 1401967864 and 1401967860 Missing descriptors for photos 1401967860 and 1401967854 Missing descriptors for photos 1401967854 and 1401967880 Missing descriptors for photos 1401967880 and 1401967877 Missing descriptors for photos 1401967877 and 1401967894 Missing descriptors for photos 1401967894 and 1401967893 Missing descriptors for photos 1401967893 and 1401967910 Missing descriptors for photos 1401967910 and 1401967909 Missing descriptors for photos 1401967909 and 1401967934 Missing descriptors for photos 1401967934 and 1401967956 Missing descriptors for photos 1401967956 and 1401967931 Missing descriptors for photos 1401967931 and 1401967958 Missing descriptors for photos 1401967958 and 1401967982 Missing descriptors for photos 1401967982 and 1401967980 Missing descriptors for photos 1401967980 and 1401967975 Missing descriptors for photos 1401967975 and 1401967972 Missing descriptors for photos 1401967972 and 1401967989 Missing descriptors for photos 1401967989 and 1401967987 Missing descriptors for photos 1401967987 and 1401968004 Missing descriptors for photos 1401968004 and 1401968055 Missing descriptors for photos 1401968055 and 1401968003 Missing descriptors for photos 1401968003 and 1401968054 Missing descriptors for photos 1401968054 and 1401968052 Missing descriptors for photos 1401968052 and 1401968050 Missing descriptors for photos 1401968050 and 1401968048 Missing descriptors for photos 1401968048 and 1401968045 Missing descriptors for photos 1401968045 and 1401968065 Missing descriptors for photos 1401968065 and 1401968062 Missing descriptors for photos 1401968062 and 1401968077 Missing descriptors for photos 1401968077 and 1401968074 Missing descriptors for photos 1401968074 and 1401968091 Missing descriptors for photos 1401968091 and 1401968116 Missing descriptors for photos 1401968116 and 1401968203 Missing descriptors for photos 1401968203 and 1401968114 Missing descriptors for photos 1401968114 and 1401968204 Missing descriptors for photos 1401968204 and 1401968206 Missing descriptors for photos 1401968206 and 1401968208 Missing descriptors for photos 1401968208 and 1401968210 Missing descriptors for photos 1401968210 and 1401968277 Missing descriptors for photos 1401968277 and 1401968214 Missing descriptors for photos 1401968214 and 1401968250 Missing descriptors for photos 1401968250 and 1401968275 Missing descriptors for photos 1401968275 and 1401968238 Missing descriptors for photos 1401968238 and 1401968273 Missing descriptors for photos 1401968273 and 1401968236 Missing descriptors for photos 1401968236 and 1401968270 Missing descriptors for photos 1401968270 and 1401968232 Missing descriptors for photos 1401968232 and 1401968230 Missing descriptors for photos 1401968230 and 1401968300 Missing descriptors for photos 1401968300 and 1401968338 Missing descriptors for photos 1401968338 and 1401968456 Missing descriptors for photos 1401968456 and 1401968335 Missing descriptors for photos 1401968335 and 1401971521 Missing descriptors for photos 1401971521 and 1401971628 Missing descriptors for photos 1401971628 and 1401971611 Missing descriptors for photos 1401971611 and 1401971645 Missing descriptors for photos 1401971645 and 1401971644 Missing descriptors for photos 1401971644 and 1401971665 Missing descriptors for photos 1401971665 and 1401971738 Missing descriptors for photos 1401971738 and 1401971748 Missing descriptors for photos 1401971748 and 1401971745 Missing descriptors for photos 1401971745 and 1401971865 Missing descriptors for photos 1401971865 and 1401971905 Missing descriptors for photos 1401971905 and 1401971902 Missing descriptors for photos 1401971902 and 1401971899 Missing descriptors for photos 1401971899 and 1401971896 Missing descriptors for photos 1401971896 and 1401972047 Missing descriptors for photos 1401972047 and 1401972066 Missing descriptors for photos 1401972066 and 1401972064 Missing descriptors for photos 1401972064 and 1401972079 Missing descriptors for photos 1401972079 and 1401972184 Missing descriptors for photos 1401972184 and 1401972181 Missing descriptors for photos 1401972181 and 1401972211 Missing descriptors for photos 1401972211 and 1401972219 Missing descriptors for photos 1401972219 and 1401976317 Missing descriptors for photos 1401976317 and 1401976371 Missing descriptors for photos 1401976371 and 1401976410 Missing descriptors for photos 1401976410 and 1401976453 Missing descriptors for photos 1401976453 and 1401976486 Missing descriptors for photos 1401976486 and 1401976529 Missing descriptors for photos 1401976529 and 1401976559 Missing descriptors for photos 1401976559 and 1401976568 Missing descriptors for photos 1401976568 and 1401976557 Missing descriptors for photos 1401976557 and 1401976593 Missing descriptors for photos 1401976593 and 1401976629 Missing descriptors for photos 1401976629 and 1401976641 Missing descriptors for photos 1401976641 and 1401976695 Missing descriptors for photos 1401976695 and 1401976734 Missing descriptors for photos 1401976734 and 1401976878 Missing descriptors for photos 1401976878 and 1401976875 Missing descriptors for photos 1401976875 and 1401978330 Missing descriptors for photos 1401978330 and 1401977814 Missing descriptors for photos 1401977814 and 1401978450 Missing descriptors for photos 1401978450 and 1401978490 Missing descriptors for photos 1401978490 and 1401978488 Missing descriptors for photos 1401978488 and 1401978653 Missing descriptors for photos 1401978653 and 1401978782 Missing descriptors for photos 1401978782 and 1401978876 Missing descriptors for photos 1401978876 and 1401978937 Missing descriptors for photos 1401978937 and 1401978938 Missing descriptors for photos 1401978938 and 1401979012 Missing descriptors for photos 1401979012 and 1401978940 Missing descriptors for photos 1401978940 and 1401979009 Missing descriptors for photos 1401979009 and 1401978943 Missing descriptors for photos 1401978943 and 1401979006 Missing descriptors for photos 1401979006 and 1401979017 Missing descriptors for photos 1401979017 and 1401978945 Missing descriptors for photos 1401978945 and 1401978955 Missing descriptors for photos 1401978955 and 1401978959 Missing descriptors for photos 1401978959 and 1401978967 Missing descriptors for photos 1401978967 and 1401978965 Missing descriptors for photos 1401978965 and 1401978983 Missing descriptors for photos 1401978983 and 1401978997 Missing descriptors for photos 1401978997 and 1401979055 Missing descriptors for photos 1401979055 and 1401978995 Missing descriptors for photos 1401978995 and 1401979053 Missing descriptors for photos 1401979053 and 1401979051 Missing descriptors for photos 1401979051 and 1401979049 Missing descriptors for photos 1401979049 and 1401979047 Missing descriptors for photos 1401979047 and 1401979045 Missing descriptors for photos 1401979045 and 1401979063 Missing descriptors for photos 1401979063 and 1401979060 Missing descriptors for photos 1401979060 and 1401979127 Missing descriptors for photos 1401979127 and 1401981562 Missing descriptors for photos 1401981562 and 1401979377 Missing descriptors for photos 1401979377 and 1401980084 Missing descriptors for photos 1401980084 and 1401981635 Missing descriptors for photos 1401981635 and 1401981745 Missing descriptors for photos 1401981745 and 1401981789 Missing descriptors for photos 1401981789 and 1401981818 Missing descriptors for photos 1401981818 and 1401981950 Missing descriptors for photos 1401981950 and 1401982158 Missing descriptors for photos 1401982158 and 1401982036 Missing descriptors for photos 1401982036 and 1401983387 Missing descriptors for photos 1401983387 and 1401985158 Missing descriptors for photos 1401985158 and 1401985156 Missing descriptors for photos 1401985156 and 1401985639 Missing descriptors for photos 1401985639 and 1401988225 Missing descriptors for photos 1401988225 and 1401988166 Missing descriptors for photos 1401988166 and 1401988596 Missing descriptors for photos 1401988596 and 1401989128 Missing descriptors for photos 1401989128 and 1401989589 Missing descriptors for photos 1401989589 and 1401989952 Missing descriptors for photos 1401989952 and 1401989965 Missing descriptors for photos 1401989965 and 1401990114 Missing descriptors for photos 1401990114 and 1401990112 Missing descriptors for photos 1401990112 and 1401990110 Missing descriptors for photos 1401990110 and 1401990391 Missing descriptors for photos 1401990391 and 1401990407 Missing descriptors for photos 1401990407 and 1401990449 Missing descriptors for photos 1401990449 and 1401990478 Missing descriptors for photos 1401990478 and 1401990509 Missing descriptors for photos 1401990509 and 1401990547 Missing descriptors for photos 1401990547 and 1401990559 Missing descriptors for photos 1401990559 and 1401990586 Missing descriptors for photos 1401990586 and 1401990636 Missing descriptors for photos 1401990636 and 1401990583 Missing descriptors for photos 1401990583 and 1401990635 Missing descriptors for photos 1401990635 and 1401990634 Missing descriptors for photos 1401990634 and 1401990633 Missing descriptors for photos 1401990633 and 1401990630 Missing descriptors for photos 1401990630 and 1401990648 Missing descriptors for photos 1401990648 and 1401990646 Missing descriptors for photos 1401990646 and 1401990660 Missing descriptors for photos 1401990660 and 1401990659 Missing descriptors for photos 1401990659 and 1401990679 Missing descriptors for photos 1401990679 and 1401990696 Missing descriptors for photos 1401990696 and 1401990722 Missing descriptors for photos 1401990722 and 1401990694 Missing descriptors for photos 1401990694 and 1401990719 Missing descriptors for photos 1401990719 and 1401990715 Missing descriptors for photos 1401990715 and 1401990918 Missing descriptors for photos 1401990918 and 1401990992 Missing descriptors for photos 1401990992 and 1401991588 Missing descriptors for photos 1401991588 and 1401991516 Missing descriptors for photos 1401991516 and 1401992351 Missing descriptors for photos 1401992351 and 1401993016 Missing descriptors for photos 1401993016 and 1401993127 01012026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 183 time used for this insertion : 0.030658721923828125 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.06801819801330566 Creating list_photo_total Warning list_scores null ERROR ! elapsed_time : count_sum_diff_and_build_graph 0.0014920234680175781 Total photos : 183 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 183 Number of lists : 0 counter photos in port : 0 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 0 photos in 0 portfolios ! hashtag : flux_dev(2107760238) : 0 photos in 0 portfolios ! hashtag : jrm(495916461) : 0 photos in 0 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 0 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.008216381072998047 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 2.1457672119140625e-06 today str has not a value , we define it as the date of the first image todaystr_first : 01012026 attention , prev_timestamp is 0 , we do nothing oo*****o*o****oo******o*o***ooo*o*o**o**********o**************o***o**o****o******oo*oo*****oo********o*****o*****o*****o**o**o*o******o*o****Unexpected type of data : ({'photo_id': 1401993127, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/1/22770da90c07b67f65467f690e1226a3.jpg', 'username': None, 'uploaded_at': 1767247756, 'text': 'image_01012026_07_04_05_30204.jpg', 'time': 1767251045.030204}, 'different') Count Time bigger than 30s : 108 #Number Photos for regression : {'01012026': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 4436.999040603638, 2107751016: 0, 2107751017: 0}}} 01012026|aluminium, 05102018_papier_non_papier_dense:0 01012026|aluminium, 05102018_papier_non_papier_peu_dense:0 01012026|aluminium, 05102018_papier_non_papier_presque_vide:0 01012026|aluminium, 05102018_papier_non_papier_tres_dense:0 01012026|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 01012026|ela, 05102018_papier_non_papier_dense:0 01012026|ela, 05102018_papier_non_papier_peu_dense:0 01012026|ela, 05102018_papier_non_papier_presque_vide:0 01012026|ela, 05102018_papier_non_papier_tres_dense:0 01012026|ela, 05102018_papier_non_papier_tres_peu_dense:0 01012026|emr, 05102018_papier_non_papier_dense:0 01012026|emr, 05102018_papier_non_papier_peu_dense:0 01012026|emr, 05102018_papier_non_papier_presque_vide:0 01012026|emr, 05102018_papier_non_papier_tres_dense:0 01012026|emr, 05102018_papier_non_papier_tres_peu_dense:0 01012026|film_pedb, 05102018_papier_non_papier_dense:0 01012026|film_pedb, 05102018_papier_non_papier_peu_dense:0 01012026|film_pedb, 05102018_papier_non_papier_presque_vide:0 01012026|film_pedb, 05102018_papier_non_papier_tres_dense:0 01012026|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 01012026|flux_dev, 05102018_papier_non_papier_dense:0 01012026|flux_dev, 05102018_papier_non_papier_peu_dense:0 01012026|flux_dev, 05102018_papier_non_papier_presque_vide:0 01012026|flux_dev, 05102018_papier_non_papier_tres_dense:0 01012026|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 01012026|jrm, 05102018_papier_non_papier_dense:0 01012026|jrm, 05102018_papier_non_papier_peu_dense:0 01012026|jrm, 05102018_papier_non_papier_presque_vide:0 01012026|jrm, 05102018_papier_non_papier_tres_dense:0 01012026|jrm, 05102018_papier_non_papier_tres_peu_dense:0 01012026|pcm, 05102018_papier_non_papier_dense:0 01012026|pcm, 05102018_papier_non_papier_peu_dense:0 01012026|pcm, 05102018_papier_non_papier_presque_vide:0 01012026|pcm, 05102018_papier_non_papier_tres_dense:0 01012026|pcm, 05102018_papier_non_papier_tres_peu_dense:0 01012026|pcnc, 05102018_papier_non_papier_dense:0 01012026|pcnc, 05102018_papier_non_papier_peu_dense:0 01012026|pcnc, 05102018_papier_non_papier_presque_vide:0 01012026|pcnc, 05102018_papier_non_papier_tres_dense:0 01012026|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 01012026|pehd_pp, 05102018_papier_non_papier_dense:0 01012026|pehd_pp, 05102018_papier_non_papier_peu_dense:0 01012026|pehd_pp, 05102018_papier_non_papier_presque_vide:0 01012026|pehd_pp, 05102018_papier_non_papier_tres_dense:0 01012026|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 01012026|pet_clair, 05102018_papier_non_papier_dense:0 01012026|pet_clair, 05102018_papier_non_papier_peu_dense:0 01012026|pet_clair, 05102018_papier_non_papier_presque_vide:0 01012026|pet_clair, 05102018_papier_non_papier_tres_dense:0 01012026|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 01012026|refus, 05102018_papier_non_papier_dense:0 01012026|refus, 05102018_papier_non_papier_peu_dense:0 01012026|refus, 05102018_papier_non_papier_presque_vide:0 01012026|refus, 05102018_papier_non_papier_tres_dense:0 01012026|refus, 05102018_papier_non_papier_tres_peu_dense:0 01012026|tapis_vide, 05102018_papier_non_papier_dense:0 01012026|tapis_vide, 05102018_papier_non_papier_peu_dense:0 01012026|tapis_vide, 05102018_papier_non_papier_presque_vide:4436.999040603638 01012026|tapis_vide, 05102018_papier_non_papier_tres_dense:0 01012026|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 01012026_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 0 Number amount portfolio for this type of dechet : film_pedb 0 Number amount portfolio for this type of dechet : flux_dev 0 Number amount portfolio for this type of dechet : jrm 0 Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 0 Number amount portfolio for this type of dechet : pet_clair 0 Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 142 Created to study and clean : 29867585 with name like 01012026_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 0 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['pcnc', 'gm', 'emr', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev_rigide', 'aluminium', 'tapis_vide', 'refus', 'gros_cartons', 'gm', 'flux_dev_rigide', 'gros_cartons'] We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 7.489565849304199 # DISPLAY ALL COLLECTED DATA : {'01012026': {'nb_upload': 183, 'nb_taggue_class': 182, 'nb_taggue_densite': 182, 'nb_descriptors': 0, 'number_port': 0, 'count_photo_in_port': 0, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 0, 'nb_portfolios': 0}, 'flux_dev': {'nb_photos': 0, 'nb_portfolios': 0}, 'jrm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1401993127, 1401993016, 1401992351, 1401991588, 1401991516, 1401990992, 1401990918, 1401990722, 1401990719, 1401990715, 1401990696, 1401990694, 1401990679, 1401990660, 1401990659, 1401990648, 1401990646, 1401990636, 1401990635, 1401990634, 1401990633, 1401990630, 1401990586, 1401990583, 1401990559, 1401990547, 1401990509, 1401990478, 1401990449, 1401990407, 1401990391, 1401990114, 1401990112, 1401990110, 1401989965, 1401989952, 1401989589, 1401989128, 1401988596, 1401988225, 1401988166, 1401985639, 1401985158, 1401985156, 1401983387, 1401982158, 1401982036, 1401981950, 1401981818, 1401981789, 1401981745, 1401981635, 1401981562, 1401980084, 1401979377, 1401979127, 1401979063, 1401979060, 1401979055, 1401979053, 1401979051, 1401979049, 1401979047, 1401979045, 1401979017, 1401979012, 1401979009, 1401979006, 1401978997, 1401978995, 1401978983, 1401978967, 1401978965, 1401978959, 1401978955, 1401978945, 1401978943, 1401978940, 1401978938, 1401978937, 1401978876, 1401978782, 1401978653, 1401978490, 1401978488, 1401978450, 1401978330, 1401977814, 1401976878, 1401976875, 1401976734, 1401976695, 1401976641, 1401976629, 1401976593, 1401976568, 1401976559, 1401976557, 1401976529, 1401976486] Looping around the photos to save general results len do output : 1 /29866212Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401993127', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401993016', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401992351', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401991588', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401991516', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990992', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990918', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990722', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990719', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990715', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990696', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990694', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990679', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990660', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990659', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990648', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990646', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990636', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990635', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990634', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990633', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990630', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990586', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990583', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990559', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990547', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990509', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990478', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990449', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990407', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990391', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990114', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990112', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401990110', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401989965', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401989952', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401989589', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401989128', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401988596', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401988225', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401988166', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401985639', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401985158', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401985156', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401983387', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401982158', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401982036', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981950', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981818', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981789', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981745', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981635', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401981562', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401980084', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979377', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979127', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979063', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979060', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979055', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979053', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979051', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979049', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979047', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979045', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979017', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979012', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979009', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401979006', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978997', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978995', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978983', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978967', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978965', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978959', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978955', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978945', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978943', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978940', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978938', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978937', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978876', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978782', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978653', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978490', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978488', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978450', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401978330', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401977814', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976878', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976875', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976734', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976695', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976641', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976629', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976593', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976568', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976559', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976557', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976529', None, None, None, None, None, '4297982') ('4323', None, None, None, None, None, None, None, '4297982') ('4323', '29866212', '1401976486', None, None, None, None, None, '4297982') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.029306411743164062 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.945124387741089 time spend to save output : 0.030108213424682617 total time spend for step 1 : 7.9752326011657715 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.61user 0.55system 0:12.97elapsed 16%CPU (0avgtext+0avgdata 107904maxresident)k 0inputs+104outputs (1major+52293minor)pagefaults 0swaps