python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1155562 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-04-23 17:00:29.528174 Current got : datou_id : 4189, datou_cur_ids : ['4376918'] with mtr_portfolio_ids : ['31016136'] and first list_photo_ids : [] new path : /proc/1155562/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.026669740676879883 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Apr 23 17:00:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 37), ('14', 129)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 148} 23042026 31016136 Nombre de photos uploadées : 166 / 23040 (0%) 23042026 31016136 Nombre de photos taguées (types de déchets): 148 / 166 (89%) 23042026 31016136 Nombre de photos taguées (volume) : 148 / 166 (89%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 6.628036499023438e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL?????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.010213375091552734 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.23333454132080078 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.04946255683898926 Creating list_photo_total [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device [Errno 28] No space left on device Unable to find some descriptors in ovh, trying to find them in s3 Number missing : 84 Warning this was a bad idea s3 ! elapsed_time : select_descriptors 4.826211929321289 Missing descriptors : 84 23042026 31016136 Nombre de photos avec descriptors (type 5680) : 0 / 102 (0%) Missing descriptors for photos 0 and 1416273295 0:00:00|ON:Missing descriptors for photos 1416273295 and 1416273296 LMissing descriptors for photos 1416273296 and 1416273297 LMissing descriptors for photos 1416273297 and 1416273298 LMissing descriptors for photos 1416273298 and 1416273300 Missing descriptors for photos 1416273300 and 1416274881 LMissing descriptors for photos 1416274881 and 1416274882 LMissing descriptors for photos 1416274882 and 1416274883 LMissing descriptors for photos 1416274883 and 1416274884 LMissing descriptors for photos 1416274884 and 1416274886 LMissing descriptors for photos 1416274886 and 1416274959 LMissing descriptors for photos 1416274959 and 1416275582 LMissing descriptors for photos 1416275582 and 1416275583 LMissing descriptors for photos 1416275583 and 1416275584 LMissing descriptors for photos 1416275584 and 1416275585 LMissing descriptors for photos 1416275585 and 1416275586 LMissing descriptors for photos 1416275586 and 1416275587 LMissing descriptors for photos 1416275587 and 1416275809 LMissing descriptors for photos 1416275809 and 1416275810 LMissing descriptors for photos 1416275810 and 1416275811 LMissing descriptors for photos 1416275811 and 1416275812 LMissing descriptors for photos 1416275812 and 1416275813 LMissing descriptors for photos 1416275813 and 1416275814 LMissing descriptors for photos 1416275814 and 1416276514 LMissing descriptors for photos 1416276514 and 1416276515 LMissing descriptors for photos 1416276515 and 1416276516 LMissing descriptors for photos 1416276516 and 1416276517 LMissing descriptors for photos 1416276517 and 1416276518 LMissing descriptors for photos 1416276518 and 1416276520 LMissing descriptors for photos 1416276520 and 1416276545 LMissing descriptors for photos 1416276545 and 1416276546 LMissing descriptors for photos 1416276546 and 1416276547 LMissing descriptors for photos 1416276547 and 1416276548 LMissing descriptors for photos 1416276548 and 1416276549 LMissing descriptors for photos 1416276549 and 1416276550 LMissing descriptors for photos 1416276550 and 1416276554 LMissing descriptors for photos 1416276554 and 1416276556 LMissing descriptors for photos 1416276556 and 1416283170 Missing descriptors for photos 1416283170 and 1416283172 Missing descriptors for photos 1416283172 and 1416283173 Missing descriptors for photos 1416283173 and 1416283174 Missing descriptors for photos 1416283174 and 1416283175 Missing descriptors for photos 1416283175 and 1416283186 Missing descriptors for photos 1416283186 and 1416283187 Missing descriptors for photos 1416283187 and 1416283188 Missing descriptors for photos 1416283188 and 1416283189 Missing descriptors for photos 1416283189 and 1416283191 Missing descriptors for photos 1416283191 and 1416283192 Missing descriptors for photos 1416283192 and 1416283204 Missing descriptors for photos 1416283204 and 1416283205 Missing descriptors for photos 1416283205 and 1416283206 Missing descriptors for photos 1416283206 and 1416283208 Missing descriptors for photos 1416283208 and 1416283210 Missing descriptors for photos 1416283210 and 1416283211 Missing descriptors for photos 1416283211 and 1416284643 LMissing descriptors for photos 1416284643 and 1416284644 Missing descriptors for photos 1416284644 and 1416284646 Missing descriptors for photos 1416284646 and 1416284647 Missing descriptors for photos 1416284647 and 1416284649 Missing descriptors for photos 1416284649 and 1416284651 Missing descriptors for photos 1416284651 and 1416284659 Missing descriptors for photos 1416284659 and 1416284661 Missing descriptors for photos 1416284661 and 1416284663 Missing descriptors for photos 1416284663 and 1416284664 Missing descriptors for photos 1416284664 and 1416284665 Missing descriptors for photos 1416284665 and 1416284666 Missing descriptors for photos 1416284666 and 1416285351 Missing descriptors for photos 1416285351 and 1416285352 Missing descriptors for photos 1416285352 and 1416285353 Missing descriptors for photos 1416285353 and 1416285354 Missing descriptors for photos 1416285354 and 1416285355 Missing descriptors for photos 1416285355 and 1416285356 Missing descriptors for photos 1416285356 and 1416287512 Missing descriptors for photos 1416287512 and 1416287513 Missing descriptors for photos 1416287513 and 1416287515 Missing descriptors for photos 1416287515 and 1416287516 Missing descriptors for photos 1416287516 and 1416287517 Missing descriptors for photos 1416287517 and 1416287518 Missing descriptors for photos 1416287518 and 1416287525 Missing descriptors for photos 1416287525 and 1416287526 Missing descriptors for photos 1416287526 and 1416287527 Missing descriptors for photos 1416287527 and 1416287528 Missing descriptors for photos 1416287528 and 1416287529 Missing descriptors for photos 1416287529 and 1416287530 Missing descriptors for photos 1416287530 and 1416287546 LMissing descriptors for photos 1416287546 and 1416287547 LMissing descriptors for photos 1416287547 and 1416287548 LMissing descriptors for photos 1416287548 and 1416287549 Missing descriptors for photos 1416287549 and 1416287550 LMissing descriptors for photos 1416287550 and 1416287551 LMissing descriptors for photos 1416287551 and 1416287562 LMissing descriptors for photos 1416287562 and 1416287563 Missing descriptors for photos 1416287563 and 1416287564 LMissing descriptors for photos 1416287564 and 1416287565 LMissing descriptors for photos 1416287565 and 1416287566 Missing descriptors for photos 1416287566 and 1416287567 LMissing descriptors for photos 1416287567 and 1416287642 LMissing descriptors for photos 1416287642 and 1416287643 LMissing descriptors for photos 1416287643 and 1416287644 LMissing descriptors for photos 1416287644 and 1416287645 LMissing descriptors for photos 1416287645 and 1416287646 LMissing descriptors for photos 1416287646 and 1416287648 LMissing descriptors for photos 1416287648 and 1416287994 LMissing descriptors for photos 1416287994 and 1416287996 LMissing descriptors for photos 1416287996 and 1416287998 LMissing descriptors for photos 1416287998 and 1416287999 LMissing descriptors for photos 1416287999 and 1416288000 LMissing descriptors for photos 1416288000 and 1416288001 LMissing descriptors for photos 1416288001 and 1416288012 LMissing descriptors for photos 1416288012 and 1416288013 Missing descriptors for photos 1416288013 and 1416288139 Missing descriptors for photos 1416288139 and 1416288302 Missing descriptors for photos 1416288302 and 1416288310 Missing descriptors for photos 1416288310 and 1416288328 LMissing descriptors for photos 1416288328 and 1416289079 Missing descriptors for photos 1416289079 and 1416289131 LMissing descriptors for photos 1416289131 and 1416289140 LMissing descriptors for photos 1416289140 and 1416289187 LMissing descriptors for photos 1416289187 and 1416289194 LMissing descriptors for photos 1416289194 and 1416289195 LMissing descriptors for photos 1416289195 and 1416289303 LMissing descriptors for photos 1416289303 and 1416289814 LMissing descriptors for photos 1416289814 and 1416289304 LMissing descriptors for photos 1416289304 and 1416289306 LMissing descriptors for photos 1416289306 and 1416289307 LMissing descriptors for photos 1416289307 and 1416289815 LMissing descriptors for photos 1416289815 and 1416289816 LMissing descriptors for photos 1416289816 and 1416289818 LMissing descriptors for photos 1416289818 and 1416289819 LMissing descriptors for photos 1416289819 and 1416289820 LMissing descriptors for photos 1416289820 and 1416290099 LMissing descriptors for photos 1416290099 and 1416290101 LMissing descriptors for photos 1416290101 and 1416290102 LMissing descriptors for photos 1416290102 and 1416290111 LMissing descriptors for photos 1416290111 and 1416290269 LMissing descriptors for photos 1416290269 and 1416290422 LMissing descriptors for photos 1416290422 and 1416291684 LMissing descriptors for photos 1416291684 and 1416291731 LMissing descriptors for photos 1416291731 and 1416291732 LMissing descriptors for photos 1416291732 and 1416291733 LMissing descriptors for photos 1416291733 and 1416291734 LMissing descriptors for photos 1416291734 and 1416291772 LMissing descriptors for photos 1416291772 and 1416292314 LMissing descriptors for photos 1416292314 and 1416292315 LMissing descriptors for photos 1416292315 and 1416292316 LMissing descriptors for photos 1416292316 and 1416292317 LMissing descriptors for photos 1416292317 and 1416292318 LMissing descriptors for photos 1416292318 and 1416292319 LMissing descriptors for photos 1416292319 and 1416292332 LMissing descriptors for photos 1416292332 and 1416292459 LMissing descriptors for photos 1416292459 and 1416292616 LMissing descriptors for photos 1416292616 and 1416292765 LMissing descriptors for photos 1416292765 and 1416292922 LMissing descriptors for photos 1416292922 and 1416293073 LMissing descriptors for photos 1416293073 and 1416293703 LMissing descriptors for photos 1416293703 and 1416293704 LMissing descriptors for photos 1416293704 and 1416293705 LMissing descriptors for photos 1416293705 and 1416293707 LMissing descriptors for photos 1416293707 and 1416293708 LMissing descriptors for photos 1416293708 and 1416293710 LMissing descriptors for photos 1416293710 and 1416293717 LMissing descriptors for photos 1416293717 and 1416293718 LMissing descriptors for photos 1416293718 and 1416293719 LMissing descriptors for photos 1416293719 and 1416293720 LMissing descriptors for photos 1416293720 and 1416293721 LMissing descriptors for photos 1416293721 and 1416293722 L 23042026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 166 time used for this insertion : 0.0423128604888916 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.07570433616638184 To do, maybe not at the correct place ! ..L.L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L..................L..............................L.L.L..L.L.L..L.L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.....L..L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.010955572128295898 NUMBER BATCH : 6 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '23042026', 'map_nb_amount': {0: 0, 1: 15, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 659.9742031097412, 'nb_balles_papier': 0.00015000000000000001, 'begin_time_port': 'image_23042026_10_00_02_355358m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00015000000000000001 LLresult_one_balle_Type_JRM:{'day': '23042026', 'map_nb_amount': {0: 6, 1: 49, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 719.9414870738983, 'nb_balles_papier': 0.0005500000000000008, 'begin_time_port': 'image_23042026_14_00_02_433400m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0005500000000000008 LLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info LLresult_one_balle_Type_JRM:{'day': '23042026', 'map_nb_amount': {0: 0, 1: 4, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 301.08925104141235, 'nb_balles_papier': 4e-05, 'begin_time_port': 'image_23042026_14_15_03_075163_0005.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 4e-05 We have rejected 10 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31017571 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31017572 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=31017573 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 7.558872222900391 # DISPLAY ALL COLLECTED DATA : {'23042026': {'nb_upload': 166, 'nb_taggue_class': 148, 'nb_taggue_densite': 148, 'nb_descriptors': 0}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1416293722, 1416293721, 1416293720, 1416293719, 1416293718, 1416293717, 1416293710, 1416293708, 1416293707, 1416293705, 1416293704, 1416293703, 1416293073, 1416292922, 1416292765, 1416292616, 1416292459, 1416292332, 1416292319, 1416292318, 1416292317, 1416292316, 1416292315, 1416292314, 1416291772, 1416291734, 1416291733, 1416291732, 1416291731, 1416291684, 1416290422, 1416290269, 1416290111, 1416290102, 1416290101, 1416290099, 1416289820, 1416289819, 1416289818, 1416289816, 1416289815, 1416289814, 1416289307, 1416289306, 1416289304, 1416289303, 1416289195, 1416289194, 1416289187, 1416289140, 1416289131, 1416289079, 1416288328, 1416288310, 1416288302, 1416288139, 1416288013, 1416288012, 1416288001, 1416288000, 1416287999, 1416287998, 1416287996, 1416287994, 1416287648, 1416287646, 1416287645, 1416287644, 1416287643, 1416287642, 1416287567, 1416287566, 1416287565, 1416287564, 1416287563, 1416287562, 1416287551, 1416287550, 1416287549, 1416287548, 1416287547, 1416287546, 1416287530, 1416287529, 1416287528, 1416287527, 1416287526, 1416287525, 1416287518, 1416287517, 1416287516, 1416287515, 1416287513, 1416287512, 1416285356, 1416285355, 1416285354, 1416285353, 1416285352, 1416285351] Looping around the photos to save general results len do output : 1 /31016136Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293722', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293721', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293720', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293719', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293718', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293717', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293710', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293708', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293707', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293705', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293704', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293703', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416293073', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292922', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292765', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292616', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292459', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292332', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292319', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292318', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292317', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292316', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292315', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416292314', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291772', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291734', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291733', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291732', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291731', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416291684', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290422', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290269', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290111', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290102', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290101', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416290099', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289820', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289819', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289818', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289816', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289815', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289814', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289307', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289306', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289304', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289303', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289195', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289194', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289187', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289140', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289131', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416289079', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288328', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288310', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288302', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288139', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288013', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288012', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288001', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416288000', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287999', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287998', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287996', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287994', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287648', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287646', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287645', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287644', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287643', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287642', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287567', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287566', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287565', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287564', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287563', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287562', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287551', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287550', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287549', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287548', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287547', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287546', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287530', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287529', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287528', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287527', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287526', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287525', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287518', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287517', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287516', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287515', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287513', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416287512', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285356', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285355', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285354', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285353', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285352', None, None, None, None, None, '4376918') ('4189', None, None, None, None, None, None, None, '4376918') ('4189', '31016136', '1416285351', None, None, None, None, None, '4376918') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.027917146682739258 save_final save missing photos in datou_result : time spend for datou_step_exec : 12.878330707550049 time spend to save output : 0.02872157096862793 total time spend for step 1 : 12.907052278518677 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.43user 0.54system 0:16.69elapsed 11%CPU (0avgtext+0avgdata 112920maxresident)k 256inputs+128outputs (5major+53079minor)pagefaults 0swaps