python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2091804 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['4349007'] with mtr_portfolio_ids : ['29370555'] and first list_photo_ids : [] new path : /proc/2091804/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.13861846923828125 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Feb 19 08:45:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 381), ('14', 357)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 738} 12122025 29370555 Nombre de photos uploadées : 738 / 23040 (3%) 12122025 29370555 Nombre de photos taguées (types de déchets): 738 / 738 (100%) 12122025 29370555 Nombre de photos taguées (volume) : 738 / 738 (100%) elapsed_time : load_data_split_time_score 2.1457672119140625e-06 elapsed_time : order_list_meta_photo_and_scores 0.0002906322479248047 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.029511213302612305 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2485358715057373 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.042593955993652344 Creating list_photo_total elapsed_time : select_descriptors 28.802765130996704 12122025 29370555 Nombre de photos avec descriptors (type 5680) : 331 / 331 (100%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1399040453 photo_id_prec : 0 0:00:00|ON:LMissing descriptors for photos 1399040456 and 1399040457 LMissing descriptors for photos 1399040457 and 1399040458 LMissing descriptors for photos 1399040458 and 1399040462 LMissing descriptors for photos 1399040462 and 1399040466 LMissing descriptors for photos 1399040466 and 1399041162 LMissing descriptors for photos 1399041162 and 1399041166 LMissing descriptors for photos 1399041166 and 1399041173 LMissing descriptors for photos 1399041173 and 1399041174 LMissing descriptors for photos 1399041174 and 1399041175 LMissing descriptors for photos 1399041175 and 1399041187 LMissing descriptors for photos 1399041187 and 1399041796 LMissing descriptors for photos 1399041796 and 1399041807 L0:03:59.670972|OFF:LL0:00:59.737996|ON:LLLMissing descriptors for photos 1399051765 and 1399053295 LLL0:12:00.347434|OFF:0:00:00|ON:LL0:04:00.011394|OFF:LLLLLLLLLL0:00:59.814404|ON:LL0:00:59.769654|OFF:0:00:00|ON:LL0:02:00.443296|OFF:0:00:00|ON:LL0:00:00|OFF:0:00:00|ON:LL0:00:59.675490|OFF:LLLL0:00:00|ON:LL0:02:00.469961|OFF:0:00:00|ON:LL0:00:59.709591|OFF:LL0:00:00|ON:LMissing descriptors for photos 1399087465 and 1399087739 LMissing descriptors for photos 1399087739 and 1399087743 LMissing descriptors for photos 1399087743 and 1399087746 LMissing descriptors for photos 1399087746 and 1399087748 LMissing descriptors for photos 1399087748 and 1399087750 LMissing descriptors for photos 1399087750 and 1399087751 LMissing descriptors for photos 1399087751 and 1399088038 LMissing descriptors for photos 1399088038 and 1399088041 LMissing descriptors for photos 1399088041 and 1399088043 LMissing descriptors for photos 1399088043 and 1399088045 LMissing descriptors for photos 1399088045 and 1399088047 LMissing descriptors for photos 1399088047 and 1399088048 LMissing descriptors for photos 1399088048 and 1399088238 LMissing descriptors for photos 1399088238 and 1399088269 LMissing descriptors for photos 1399088269 and 1399088281 LMissing descriptors for photos 1399088281 and 1399088283 LMissing descriptors for photos 1399088283 and 1399088285 LMissing descriptors for photos 1399088285 and 1399088288 LMissing descriptors for photos 1399088288 and 1399088539 LMissing descriptors for photos 1399088539 and 1399088586 LMissing descriptors for photos 1399088586 and 1399088631 LMissing descriptors for photos 1399088631 and 1399088640 LMissing descriptors for photos 1399088640 and 1399088642 LMissing descriptors for photos 1399088642 and 1399088648 LMissing descriptors for photos 1399088648 and 1399089052 LMissing descriptors for photos 1399089052 and 1399089085 LMissing descriptors for photos 1399089085 and 1399089135 LMissing descriptors for photos 1399089135 and 1399089184 LLMissing descriptors for photos 1399091769 and 1399091782 LMissing descriptors for photos 1399091782 and 1399091798 LMissing descriptors for photos 1399091798 and 1399091803 LLL0:12:59.609472|OFF:0:00:00|ON:LL0:06:00.439008|OFF:0:00:00|ON:LL0:02:00.411806|OFF:L0:00:00|ON:LLLLLLLLLLLLLLLLLLLL0:02:59.431604|OFF:L0:00:00|ON:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLMissing descriptors for photos 1402499776 and 1402499779 LMissing descriptors for photos 1402499779 and 1402499819 LMissing descriptors for photos 1402499819 and 1402499825 LMissing descriptors for photos 1402499825 and 1402499830 LMissing descriptors for photos 1402499830 and 1402499832 LMissing descriptors for photos 1402499832 and 1402499835 LMissing descriptors for photos 1402499835 and 1402499838 LMissing descriptors for photos 1402499838 and 1402501041 LMissing descriptors for photos 1402501041 and 1402501045 LMissing descriptors for photos 1402501045 and 1402501050 LMissing descriptors for photos 1402501050 and 1402501054 LMissing descriptors for photos 1402501054 and 1402501058 LMissing descriptors for photos 1402501058 and 1402501061 LMissing descriptors for photos 1402501061 and 1402501085 LMissing descriptors for photos 1402501085 and 1402501089 LMissing descriptors for photos 1402501089 and 1402501095 LMissing descriptors for photos 1402501095 and 1402501097 LMissing descriptors for photos 1402501097 and 1402501099 LMissing descriptors for photos 1402501099 and 1402501101 LMissing descriptors for photos 1402501101 and 1402501568 LMissing descriptors for photos 1402501568 and 1402501615 LMissing descriptors for photos 1402501615 and 1402501660 LMissing descriptors for photos 1402501660 and 1402501662 LMissing descriptors for photos 1402501662 and 1402501663 LMissing descriptors for photos 1402501663 and 1402501705 LMissing descriptors for photos 1402501705 and 1402501961 LMissing descriptors for photos 1402501961 and 1402501965 LMissing descriptors for photos 1402501965 and 1402501967 LMissing descriptors for photos 1402501967 and 1402501968 LMissing descriptors for photos 1402501968 and 1402501969 LMissing descriptors for photos 1402501969 and 1402501971 LMissing descriptors for photos 1402501971 and 1402502056 LMissing descriptors for photos 1402502056 and 1402502109 LMissing descriptors for photos 1402502109 and 1402502160 LMissing descriptors for photos 1402502160 and 1402502208 LMissing descriptors for photos 1402502208 and 1402502253 LMissing descriptors for photos 1402502253 and 1402502305 LMissing descriptors for photos 1402502305 and 1402502543 LMissing descriptors for photos 1402502543 and 1402502671 LMissing descriptors for photos 1402502671 and 1402502854 LMissing descriptors for photos 1402502854 and 1402503044 LMissing descriptors for photos 1402503044 and 1402503192 LMissing descriptors for photos 1402503192 and 1402503328 LMissing descriptors for photos 1402503328 and 1402504044 LMissing descriptors for photos 1402504044 and 1402504058 LMissing descriptors for photos 1402504058 and 1402504070 LMissing descriptors for photos 1402504070 and 1402504071 LMissing descriptors for photos 1402504071 and 1402504073 LMissing descriptors for photos 1402504073 and 1402504088 LMissing descriptors for photos 1402504088 and 1402504107 LMissing descriptors for photos 1402504107 and 1402504108 LMissing descriptors for photos 1402504108 and 1402504127 LMissing descriptors for photos 1402504127 and 1402504129 LMissing descriptors for photos 1402504129 and 1402504131 LMissing descriptors for photos 1402504131 and 1402504136 LMissing descriptors for photos 1402504136 and 1402504140 LMissing descriptors for photos 1402504140 and 1402504141 LMissing descriptors for photos 1402504141 and 1402504143 LMissing descriptors for photos 1402504143 and 1402504146 LMissing descriptors for photos 1402504146 and 1402504148 LMissing descriptors for photos 1402504148 and 1402504150 LMissing descriptors for photos 1402504150 and 1402504157 LMissing descriptors for photos 1402504157 and 1402504158 LMissing descriptors for photos 1402504158 and 1402504160 LMissing descriptors for photos 1402504160 and 1402504162 LMissing descriptors for photos 1402504162 and 1402504164 LMissing descriptors for photos 1402504164 and 1402504167 LMissing descriptors for photos 1402504167 and 1402504180 LMissing descriptors for photos 1402504180 and 1402504190 LMissing descriptors for photos 1402504190 and 1402504192 LMissing descriptors for photos 1402504192 and 1402504194 LMissing descriptors for photos 1402504194 and 1402504198 LMissing descriptors for photos 1402504198 and 1402504202 LMissing descriptors for photos 1402504202 and 1402504988 LMissing descriptors for photos 1402504988 and 1402504991 LMissing descriptors for photos 1402504991 and 1402504992 LMissing descriptors for photos 1402504992 and 1402504994 LMissing descriptors for photos 1402504994 and 1402504996 LMissing descriptors for photos 1402504996 and 1402504998 LMissing descriptors for photos 1402504998 and 1402505304 LMissing descriptors for photos 1402505304 and 1402505305 LMissing descriptors for photos 1402505305 and 1402505307 LMissing descriptors for photos 1402505307 and 1402505310 LMissing descriptors for photos 1402505310 and 1402505315 LMissing descriptors for photos 1402505315 and 1402505320 LMissing descriptors for photos 1402505320 and 1402505327 LMissing descriptors for photos 1402505327 and 1402505328 LMissing descriptors for photos 1402505328 and 1402505331 LMissing descriptors for photos 1402505331 and 1402505332 LMissing descriptors for photos 1402505332 and 1402505335 LMissing descriptors for photos 1402505335 and 1402505337 LMissing descriptors for photos 1402505337 and 1402505343 LMissing descriptors for photos 1402505343 and 1402505345 LMissing descriptors for photos 1402505345 and 1402505347 LMissing descriptors for photos 1402505347 and 1402505350 LMissing descriptors for photos 1402505350 and 1402505355 LMissing descriptors for photos 1402505355 and 1402505357 LMissing descriptors for photos 1402505357 and 1402505376 LMissing descriptors for photos 1402505376 and 1402505378 LMissing descriptors for photos 1402505378 and 1402505381 LMissing descriptors for photos 1402505381 and 1402505385 LMissing descriptors for photos 1402505385 and 1402505387 LMissing descriptors for photos 1402505387 and 1402505390 LMissing descriptors for photos 1402505390 and 1402505403 LMissing descriptors for photos 1402505403 and 1402505404 LMissing descriptors for photos 1402505404 and 1402505405 LMissing descriptors for photos 1402505405 and 1402505408 LMissing descriptors for photos 1402505408 and 1402505410 LMissing descriptors for photos 1402505410 and 1402505415 LMissing descriptors for photos 1402505415 and 1402505431 LMissing descriptors for photos 1402505431 and 1402505432 LMissing descriptors for photos 1402505432 and 1402505433 LMissing descriptors for photos 1402505433 and 1402505436 LMissing descriptors for photos 1402505436 and 1402505444 LMissing descriptors for photos 1402505444 and 1402505456 LMissing descriptors for photos 1402505456 and 1402505550 LMissing descriptors for photos 1402505550 and 1402505595 LMissing descriptors for photos 1402505595 and 1402505668 LMissing descriptors for photos 1402505668 and 1402505728 LMissing descriptors for photos 1402505728 and 1402505751 LMissing descriptors for photos 1402505751 and 1402505794 LMissing descriptors for photos 1402505794 and 1402505868 LMissing descriptors for photos 1402505868 and 1402505900 LMissing descriptors for photos 1402505900 and 1402505909 LMissing descriptors for photos 1402505909 and 1402505912 LMissing descriptors for photos 1402505912 and 1402505939 LMissing descriptors for photos 1402505939 and 1402505959 LMissing descriptors for photos 1402505959 and 1402506166 LMissing descriptors for photos 1402506166 and 1402506221 LMissing descriptors for photos 1402506221 and 1402506265 LMissing descriptors for photos 1402506265 and 1402506298 LMissing descriptors for photos 1402506298 and 1402506300 LMissing descriptors for photos 1402506300 and 1402506303 LMissing descriptors for photos 1402506303 and 1402506372 LMissing descriptors for photos 1402506372 and 1402506495 LMissing descriptors for photos 1402506495 and 1402506508 LMissing descriptors for photos 1402506508 and 1402506511 LMissing descriptors for photos 1402506511 and 1402506513 LMissing descriptors for photos 1402506513 and 1402506536 LMissing descriptors for photos 1402506536 and 1402506582 LMissing descriptors for photos 1402506582 and 1402506585 LMissing descriptors for photos 1402506585 and 1402506625 LMissing descriptors for photos 1402506625 and 1402506649 LMissing descriptors for photos 1402506649 and 1402506650 LMissing descriptors for photos 1402506650 and 1402506651 LMissing descriptors for photos 1402506651 and 1402506660 LMissing descriptors for photos 1402506660 and 1402506662 LMissing descriptors for photos 1402506662 and 1402506664 LMissing descriptors for photos 1402506664 and 1402506665 LMissing descriptors for photos 1402506665 and 1402506666 LMissing descriptors for photos 1402506666 and 1402506667 LMissing descriptors for photos 1402506667 and 1402506685 LMissing descriptors for photos 1402506685 and 1402506714 LMissing descriptors for photos 1402506714 and 1402506716 LMissing descriptors for photos 1402506716 and 1402506717 LMissing descriptors for photos 1402506717 and 1402506718 LMissing descriptors for photos 1402506718 and 1402506719 LMissing descriptors for photos 1402506719 and 1402506730 LMissing descriptors for photos 1402506730 and 1402506733 LMissing descriptors for photos 1402506733 and 1402506735 LMissing descriptors for photos 1402506735 and 1402506738 LMissing descriptors for photos 1402506738 and 1402506739 LMissing descriptors for photos 1402506739 and 1402506755 LMissing descriptors for photos 1402506755 and 1402506815 LMissing descriptors for photos 1402506815 and 1402506818 LMissing descriptors for photos 1402506818 and 1402506823 LMissing descriptors for photos 1402506823 and 1402506826 LMissing descriptors for photos 1402506826 and 1402506831 LMissing descriptors for photos 1402506831 and 1402506842 LMissing descriptors for photos 1402506842 and 1402506855 LMissing descriptors for photos 1402506855 and 1402506856 LMissing descriptors for photos 1402506856 and 1402506857 LMissing descriptors for photos 1402506857 and 1402506882 LMissing descriptors for photos 1402506882 and 1402506925 LMissing descriptors for photos 1402506925 and 1402506971 LMissing descriptors for photos 1402506971 and 1402507189 LMissing descriptors for photos 1402507189 and 1402507190 LMissing descriptors for photos 1402507190 and 1402507196 LMissing descriptors for photos 1402507196 and 1402507201 LMissing descriptors for photos 1402507201 and 1402507248 LMissing descriptors for photos 1402507248 and 1402507296 LMissing descriptors for photos 1402507296 and 1402507319 LMissing descriptors for photos 1402507319 and 1402507321 LMissing descriptors for photos 1402507321 and 1402507322 LMissing descriptors for photos 1402507322 and 1402507323 LMissing descriptors for photos 1402507323 and 1402507325 LMissing descriptors for photos 1402507325 and 1402507327 LMissing descriptors for photos 1402507327 and 1402507343 LMissing descriptors for photos 1402507343 and 1402507345 LMissing descriptors for photos 1402507345 and 1402507346 LMissing descriptors for photos 1402507346 and 1402507347 LMissing descriptors for photos 1402507347 and 1402507349 LMissing descriptors for photos 1402507349 and 1402507351 LMissing descriptors for photos 1402507351 and 1402507366 LMissing descriptors for photos 1402507366 and 1402507369 LMissing descriptors for photos 1402507369 and 1402507370 LMissing descriptors for photos 1402507370 and 1402507371 LMissing descriptors for photos 1402507371 and 1402507373 LMissing descriptors for photos 1402507373 and 1402507375 LMissing descriptors for photos 1402507375 and 1402507394 LMissing descriptors for photos 1402507394 and 1402507407 LMissing descriptors for photos 1402507407 and 1402507408 LMissing descriptors for photos 1402507408 and 1402507418 LMissing descriptors for photos 1402507418 and 1402507420 LMissing descriptors for photos 1402507420 and 1402507422 LMissing descriptors for photos 1402507422 and 1402507437 LMissing descriptors for photos 1402507437 and 1402507439 LMissing descriptors for photos 1402507439 and 1402507440 LMissing descriptors for photos 1402507440 and 1402507441 LMissing descriptors for photos 1402507441 and 1402507443 LMissing descriptors for photos 1402507443 and 1402507445 LMissing descriptors for photos 1402507445 and 1402507488 LMissing descriptors for photos 1402507488 and 1402507489 LMissing descriptors for photos 1402507489 and 1402507490 LMissing descriptors for photos 1402507490 and 1402507497 LMissing descriptors for photos 1402507497 and 1402507504 LMissing descriptors for photos 1402507504 and 1402507506 LMissing descriptors for photos 1402507506 and 1402507522 LMissing descriptors for photos 1402507522 and 1402507523 LMissing descriptors for photos 1402507523 and 1402507524 LMissing descriptors for photos 1402507524 and 1402507527 LMissing descriptors for photos 1402507527 and 1402507529 LMissing descriptors for photos 1402507529 and 1402507533 LMissing descriptors for photos 1402507533 and 1402507561 LMissing descriptors for photos 1402507561 and 1402507563 LMissing descriptors for photos 1402507563 and 1402507565 LMissing descriptors for photos 1402507565 and 1402507567 LMissing descriptors for photos 1402507567 and 1402507572 LMissing descriptors for photos 1402507572 and 1402507575 LMissing descriptors for photos 1402507575 and 1402507801 LMissing descriptors for photos 1402507801 and 1402507846 LMissing descriptors for photos 1402507846 and 1402507893 LMissing descriptors for photos 1402507893 and 1402507947 LMissing descriptors for photos 1402507947 and 1402508001 LMissing descriptors for photos 1402508001 and 1402508057 LMissing descriptors for photos 1402508057 and 1402508471 LMissing descriptors for photos 1402508471 and 1402508573 LMissing descriptors for photos 1402508573 and 1402508632 LMissing descriptors for photos 1402508632 and 1402508693 LMissing descriptors for photos 1402508693 and 1402508780 LMissing descriptors for photos 1402508780 and 1402508828 LMissing descriptors for photos 1402508828 and 1402514134 LMissing descriptors for photos 1402514134 and 1402514135 LMissing descriptors for photos 1402514135 and 1402514139 LMissing descriptors for photos 1402514139 and 1402514144 LMissing descriptors for photos 1402514144 and 1402514177 LMissing descriptors for photos 1402514177 and 1402514194 LMissing descriptors for photos 1402514194 and 1402514246 LMissing descriptors for photos 1402514246 and 1402514255 LMissing descriptors for photos 1402514255 and 1402514260 LMissing descriptors for photos 1402514260 and 1402514268 LMissing descriptors for photos 1402514268 and 1402514276 LMissing descriptors for photos 1402514276 and 1402514298 LMissing descriptors for photos 1402514298 and 1402514312 LMissing descriptors for photos 1402514312 and 1402514315 LMissing descriptors for photos 1402514315 and 1402514318 LMissing descriptors for photos 1402514318 and 1402514322 LMissing descriptors for photos 1402514322 and 1402514324 LMissing descriptors for photos 1402514324 and 1402514331 LMissing descriptors for photos 1402514331 and 1402514350 LMissing descriptors for photos 1402514350 and 1402514352 LMissing descriptors for photos 1402514352 and 1402514356 LMissing descriptors for photos 1402514356 and 1402514359 LMissing descriptors for photos 1402514359 and 1402514361 LMissing descriptors for photos 1402514361 and 1402514363 LMissing descriptors for photos 1402514363 and 1402514388 LMissing descriptors for photos 1402514388 and 1402514391 LMissing descriptors for photos 1402514391 and 1402514394 LMissing descriptors for photos 1402514394 and 1402514396 LMissing descriptors for photos 1402514396 and 1402514403 LMissing descriptors for photos 1402514403 and 1402514408 LMissing descriptors for photos 1402514408 and 1402514510 LMissing descriptors for photos 1402514510 and 1402514557 LMissing descriptors for photos 1402514557 and 1402514576 LMissing descriptors for photos 1402514576 and 1402514607 LMissing descriptors for photos 1402514607 and 1402514655 LMissing descriptors for photos 1402514655 and 1402514704 LMissing descriptors for photos 1402514704 and 1402514883 LMissing descriptors for photos 1402514883 and 1402514897 LMissing descriptors for photos 1402514897 and 1402514899 LMissing descriptors for photos 1402514899 and 1402514909 LMissing descriptors for photos 1402514909 and 1402514959 LMissing descriptors for photos 1402514959 and 1402514975 LMissing descriptors for photos 1402514975 and 1402515128 LMissing descriptors for photos 1402515128 and 1402515129 LMissing descriptors for photos 1402515129 and 1402515130 LMissing descriptors for photos 1402515130 and 1402515136 LMissing descriptors for photos 1402515136 and 1402515137 LMissing descriptors for photos 1402515137 and 1402515138 LMissing descriptors for photos 1402515138 and 1402515151 LMissing descriptors for photos 1402515151 and 1402515157 LMissing descriptors for photos 1402515157 and 1402515167 LMissing descriptors for photos 1402515167 and 1402515169 LMissing descriptors for photos 1402515169 and 1402515172 LMissing descriptors for photos 1402515172 and 1402515176 LMissing descriptors for photos 1402515176 and 1402515200 LMissing descriptors for photos 1402515200 and 1402515201 LMissing descriptors for photos 1402515201 and 1402515202 LMissing descriptors for photos 1402515202 and 1402515203 LMissing descriptors for photos 1402515203 and 1402515220 LMissing descriptors for photos 1402515220 and 1402515262 LMissing descriptors for photos 1402515262 and 1402515300 LMissing descriptors for photos 1402515300 and 1402515303 LMissing descriptors for photos 1402515303 and 1402515306 LMissing descriptors for photos 1402515306 and 1402515308 LMissing descriptors for photos 1402515308 and 1402515309 LMissing descriptors for photos 1402515309 and 1402515312 LMissing descriptors for photos 1402515312 and 1402515608 LMissing descriptors for photos 1402515608 and 1402515664 LMissing descriptors for photos 1402515664 and 1402515707 LMissing descriptors for photos 1402515707 and 1402515754 LMissing descriptors for photos 1402515754 and 1402515759 LMissing descriptors for photos 1402515759 and 1402515761 LMissing descriptors for photos 1402515761 and 1402515872 LMissing descriptors for photos 1402515872 and 1402515914 LMissing descriptors for photos 1402515914 and 1402515976 LMissing descriptors for photos 1402515976 and 1402516022 LMissing descriptors for photos 1402516022 and 1402516044 LMissing descriptors for photos 1402516044 and 1402516064 LMissing descriptors for photos 1402516064 and 1402516157 LMissing descriptors for photos 1402516157 and 1402516158 LMissing descriptors for photos 1402516158 and 1402516160 LMissing descriptors for photos 1402516160 and 1402516209 LMissing descriptors for photos 1402516209 and 1402516267 LMissing descriptors for photos 1402516267 and 1402516314 LMissing descriptors for photos 1402516314 and 1402516513 LMissing descriptors for photos 1402516513 and 1402516515 LMissing descriptors for photos 1402516515 and 1402516518 LMissing descriptors for photos 1402516518 and 1402516530 LMissing descriptors for photos 1402516530 and 1402516544 LMissing descriptors for photos 1402516544 and 1402516549 LMissing descriptors for photos 1402516549 and 1402516568 LMissing descriptors for photos 1402516568 and 1402516577 LMissing descriptors for photos 1402516577 and 1402516581 LMissing descriptors for photos 1402516581 and 1402516590 LMissing descriptors for photos 1402516590 and 1402516596 LMissing descriptors for photos 1402516596 and 1402516600 LMissing descriptors for photos 1402516600 and 1402516648 LMissing descriptors for photos 1402516648 and 1402516653 LMissing descriptors for photos 1402516653 and 1402516661 LMissing descriptors for photos 1402516661 and 1402516702 LMissing descriptors for photos 1402516702 and 1402516759 LMissing descriptors for photos 1402516759 and 1402516803 LMissing descriptors for photos 1402516803 and 1402517025 LMissing descriptors for photos 1402517025 and 1402517030 LMissing descriptors for photos 1402517030 and 1402517035 LMissing descriptors for photos 1402517035 and 1402517052 LMissing descriptors for photos 1402517052 and 1402517098 LMissing descriptors for photos 1402517098 and 1402517142 LMissing descriptors for photos 1402517142 and 1402517254 LMissing descriptors for photos 1402517254 and 1402517258 LMissing descriptors for photos 1402517258 and 1402517261 LMissing descriptors for photos 1402517261 and 1402517316 LMissing descriptors for photos 1402517316 and 1402517395 LMissing descriptors for photos 1402517395 and 1402517442 LMissing descriptors for photos 1402517442 and 1402517547 L 12122025 Removing 24 photos because of the 'same image' condition Total on : 3059.989682 list_time_on Total off : 119.5524 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 738 time used for this insertion : 0.22725391387939453 photos_removed : len 24 elapsed_time : remove_photo_duplicate 0.2833569049835205 To do, maybe not at the correct place ! ..L.L.L.L.L.L.L.L.L.L.L.L.L..................L..............................L.......L..L.L.........................................L........................L.L.L.L.L.L......L...........L...L...L.L.L.........L.........L.L...................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..L.L.L.L...............L.....................................L.................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.026106834411621094 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '12122025', 'map_nb_amount': {0: 1, 1: 72, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.6813189983368, 'nb_balles_papier': 0.0007300000000000013, 'begin_time_port': 'image_12122025_10_00_03_068647m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007300000000000013 result_one_balle_Type_JRM:{'day': '12122025', 'map_nb_amount': {0: 11, 1: 65, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.2959318161011, 'nb_balles_papier': 0.0007700000000000014, 'begin_time_port': 'image_12122025_10_15_02_422907m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0007700000000000014 result_one_balle_Type_JRM:{'day': '12122025', 'map_nb_amount': {0: 7, 1: 54, 2: 3, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.410875082016, 'nb_balles_papier': 0.000640000000000001, 'begin_time_port': 'image_12122025_10_30_02_534349m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.000640000000000001 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '12122025', 'map_nb_amount': {0: 12, 1: 81, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.2858920097351, 'nb_balles_papier': 0.0009300000000000018, 'begin_time_port': 'image_12122025_10_45_02_725123m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009300000000000018 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 4 list_same_port_ids : [29374519] find same portfolio which already exist 29374519 , we will use it list_same_port_ids : [29377724] find same portfolio which already exist 29377724 , we will use it list_same_port_ids : [29381395] find same portfolio which already exist 29381395 , we will use it list_same_port_ids : [] Qualite : 0.14712056046103056 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29374519 AND mptpi.`type`=3726 To do Qualite : 0.13385937891132882 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29377724 AND mptpi.`type`=3726 To do Qualite : 0.14818697708964873 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29381395 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30458952 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 5.993147850036621 # DISPLAY ALL COLLECTED DATA : {'12122025': {'nb_upload': 738, 'nb_taggue_class': 738, 'nb_taggue_densite': 738, 'nb_descriptors': 331}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402517547, 1402517442, 1402517395, 1402517316, 1402517261, 1402517258, 1402517254, 1402517142, 1402517098, 1402517052, 1402517035, 1402517030, 1402517025, 1402516803, 1402516759, 1402516702, 1402516661, 1402516653, 1402516648, 1402516600, 1402516596, 1402516590, 1402516581, 1402516577, 1402516568, 1402516549, 1402516544, 1402516530, 1402516518, 1402516515, 1402516513, 1402516314, 1402516267, 1402516209, 1402516160, 1402516158, 1402516157, 1402516064, 1402516044, 1402516022, 1402515976, 1402515914, 1402515872, 1402515761, 1402515759, 1402515754, 1402515707, 1402515664, 1402515608, 1402515312, 1402515309, 1402515308, 1402515306, 1402515303, 1402515300, 1402515262, 1402515220, 1402515203, 1402515202, 1402515201, 1402515200, 1402515176, 1402515172, 1402515169, 1402515167, 1402515157, 1402515151, 1402515138, 1402515137, 1402515136, 1402515130, 1402515129, 1402515128, 1402514975, 1402514959, 1402514909, 1402514899, 1402514897, 1402514883, 1402514704, 1402514655, 1402514607, 1402514576, 1402514557, 1402514510, 1402514408, 1402514403, 1402514396, 1402514394, 1402514391, 1402514388, 1402514363, 1402514361, 1402514359, 1402514356, 1402514352, 1402514350, 1402514331, 1402514324, 1402514322] Looping around the photos to save general results len do output : 1 /29370555Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517547', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517442', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517395', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517316', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517261', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517258', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517254', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517142', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517098', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517052', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517035', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517030', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402517025', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516803', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516759', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516702', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516661', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516653', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516648', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516600', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516596', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516590', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516581', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516577', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516568', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516549', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516544', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516530', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516518', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516515', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516513', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516314', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516267', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516209', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516160', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516158', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516157', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516064', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516044', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402516022', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515976', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515914', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515872', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515761', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515759', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515754', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515707', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515664', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515608', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515312', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515309', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515308', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515306', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515303', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515300', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515262', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515220', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515203', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515202', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515201', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515200', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515176', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515172', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515169', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515167', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515157', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515151', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515138', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515137', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515136', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515130', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515129', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402515128', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514975', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514959', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514909', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514899', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514897', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514883', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514704', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514655', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514607', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514576', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514557', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514510', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514408', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514403', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514396', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514394', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514391', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514388', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514363', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514361', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514359', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514356', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514352', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514350', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514331', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514324', None, None, None, None, None, '4349007') ('4189', None, None, None, None, None, None, None, '4349007') ('4189', '29370555', '1402514322', None, None, None, None, None, '4349007') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.06674623489379883 save_final save missing photos in datou_result : time spend for datou_step_exec : 35.72337293624878 time spend to save output : 0.0675506591796875 total time spend for step 1 : 35.79092359542847 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.01user 0.96system 0:40.11elapsed 7%CPU (0avgtext+0avgdata 114124maxresident)k 0inputs+2824outputs (0major+53878minor)pagefaults 0swaps