python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2402868 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['4111578'] with mtr_portfolio_ids : ['28871034'] and first list_photo_ids : [] new path : /proc/2402868/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.027860164642333984 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Tue Nov 25 17:35:27 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 299),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 299} L25112025 28871034 Nombre de photos uploadées : 299 / 23040 (1%) 25112025 28871034 Nombre de photos taguées (types de déchets): 299 / 299 (100%) 25112025 28871034 Nombre de photos taguées (volume) : 299 / 299 (100%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 0.0001266002655029297 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.014525651931762695 LCatched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.27143263816833496 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.043612003326416016 Creating list_photo_total elapsed_time : select_descriptors 8.40642762184143 25112025 28871034 Nombre de photos avec descriptors (type 5680) : 153 / 153 (100%) Missing descriptors for photos 0 and 1396049543 L0:00:00|ON:Missing descriptors for photos 1396049543 and 1396049546 LMissing descriptors for photos 1396049546 and 1396049550 LMissing descriptors for photos 1396049550 and 1396049555 LMissing descriptors for photos 1396049555 and 1396049561 LMissing descriptors for photos 1396049561 and 1396049565 LMissing descriptors for photos 1396049565 and 1396051919 LMissing descriptors for photos 1396051919 and 1396051980 LMissing descriptors for photos 1396051980 and 1396052072 LMissing descriptors for photos 1396052072 and 1396052169 LMissing descriptors for photos 1396052169 and 1396052224 LMissing descriptors for photos 1396052224 and 1396052242 LMissing descriptors for photos 1396052242 and 1396053633 LMissing descriptors for photos 1396053633 and 1396053656 LMissing descriptors for photos 1396053656 and 1396053658 LMissing descriptors for photos 1396053658 and 1396053695 LMissing descriptors for photos 1396053695 and 1396053746 LMissing descriptors for photos 1396053746 and 1396053776 LMissing descriptors for photos 1396053776 and 1396054394 LMissing descriptors for photos 1396054394 and 1396054398 LMissing descriptors for photos 1396054398 and 1396054401 LMissing descriptors for photos 1396054401 and 1396054404 LMissing descriptors for photos 1396054404 and 1396054407 LMissing descriptors for photos 1396054407 and 1396054414 LMissing descriptors for photos 1396054414 and 1396055019 LMissing descriptors for photos 1396055019 and 1396055025 LMissing descriptors for photos 1396055025 and 1396055029 LMissing descriptors for photos 1396055029 and 1396055031 LMissing descriptors for photos 1396055031 and 1396055035 LMissing descriptors for photos 1396055035 and 1396055039 LMissing descriptors for photos 1396055039 and 1396056246 LMissing descriptors for photos 1396056246 and 1396056249 LMissing descriptors for photos 1396056249 and 1396056254 LMissing descriptors for photos 1396056254 and 1396056255 LMissing descriptors for photos 1396056255 and 1396056258 LMissing descriptors for photos 1396056258 and 1396056261 LMissing descriptors for photos 1396056261 and 1396057123 LMissing descriptors for photos 1396057123 and 1396057126 LMissing descriptors for photos 1396057126 and 1396057135 LMissing descriptors for photos 1396057135 and 1396057152 LMissing descriptors for photos 1396057152 and 1396057160 LMissing descriptors for photos 1396057160 and 1396057166 LMissing descriptors for photos 1396057166 and 1396057242 LMissing descriptors for photos 1396057242 and 1396058439 LMissing descriptors for photos 1396058439 and 1396058442 LMissing descriptors for photos 1396058442 and 1396058447 LMissing descriptors for photos 1396058447 and 1396058460 LMissing descriptors for photos 1396058460 and 1396058462 LMissing descriptors for photos 1396058462 and 1396058464 LMissing descriptors for photos 1396058464 and 1396059495 LMissing descriptors for photos 1396059495 and 1396059519 LMissing descriptors for photos 1396059519 and 1396059521 LMissing descriptors for photos 1396059521 and 1396059523 LMissing descriptors for photos 1396059523 and 1396059528 LMissing descriptors for photos 1396059528 and 1396059541 LMissing descriptors for photos 1396059541 and 1396061313 LMissing descriptors for photos 1396061313 and 1396061315 LMissing descriptors for photos 1396061315 and 1396061318 LMissing descriptors for photos 1396061318 and 1396061324 LMissing descriptors for photos 1396061324 and 1396061332 LMissing descriptors for photos 1396061332 and 1396061339 LMissing descriptors for photos 1396061339 and 1396062702 LMissing descriptors for photos 1396062702 and 1396062706 LMissing descriptors for photos 1396062706 and 1396062711 LMissing descriptors for photos 1396062711 and 1396062714 LMissing descriptors for photos 1396062714 and 1396062716 LMissing descriptors for photos 1396062716 and 1396062718 LMissing descriptors for photos 1396062718 and 1396063326 LMissing descriptors for photos 1396063326 and 1396063351 LMissing descriptors for photos 1396063351 and 1396063356 LMissing descriptors for photos 1396063356 and 1396063373 LMissing descriptors for photos 1396063373 and 1396063451 LMissing descriptors for photos 1396063451 and 1396063514 LMissing descriptors for photos 1396063514 and 1396065329 LMissing descriptors for photos 1396065329 and 1396065375 LMissing descriptors for photos 1396065375 and 1396065397 LMissing descriptors for photos 1396065397 and 1396065412 LMissing descriptors for photos 1396065412 and 1396065418 LMissing descriptors for photos 1396065418 and 1396065426 LLLMissing descriptors for photos 1396066047 and 1396066051 LMissing descriptors for photos 1396066051 and 1396066054 LMissing descriptors for photos 1396066054 and 1396066057 LMissing descriptors for photos 1396066057 and 1396066059 LMissing descriptors for photos 1396066059 and 1396068033 LMissing descriptors for photos 1396068033 and 1396070376 LMissing descriptors for photos 1396070376 and 1396070380 LMissing descriptors for photos 1396070380 and 1396070401 LMissing descriptors for photos 1396070401 and 1396070410 LMissing descriptors for photos 1396070410 and 1396070416 LMissing descriptors for photos 1396070416 and 1396070422 LMissing descriptors for photos 1396070422 and 1396070955 LMissing descriptors for photos 1396070955 and 1396070956 LMissing descriptors for photos 1396070956 and 1396070958 LMissing descriptors for photos 1396070958 and 1396070961 LMissing descriptors for photos 1396070961 and 1396070963 LMissing descriptors for photos 1396070963 and 1396070965 LMissing descriptors for photos 1396070965 and 1396071568 LMissing descriptors for photos 1396071568 and 1396071572 LMissing descriptors for photos 1396071572 and 1396071575 LMissing descriptors for photos 1396071575 and 1396071579 LMissing descriptors for photos 1396071579 and 1396071581 LMissing descriptors for photos 1396071581 and 1396071584 LMissing descriptors for photos 1396071584 and 1396071935 LMissing descriptors for photos 1396071935 and 1396071938 LMissing descriptors for photos 1396071938 and 1396071951 LMissing descriptors for photos 1396071951 and 1396071967 LMissing descriptors for photos 1396071967 and 1396071970 LMissing descriptors for photos 1396071970 and 1396071975 LMissing descriptors for photos 1396071975 and 1396072384 LMissing descriptors for photos 1396072384 and 1396072389 LMissing descriptors for photos 1396072389 and 1396072391 LMissing descriptors for photos 1396072391 and 1396072393 LMissing descriptors for photos 1396072393 and 1396072396 LMissing descriptors for photos 1396072396 and 1396072403 LMissing descriptors for photos 1396072403 and 1396073919 LMissing descriptors for photos 1396073919 and 1396073924 LMissing descriptors for photos 1396073924 and 1396073926 LMissing descriptors for photos 1396073926 and 1396073928 LMissing descriptors for photos 1396073928 and 1396073931 LMissing descriptors for photos 1396073931 and 1396073935 LMissing descriptors for photos 1396073935 and 1396074239 LMissing descriptors for photos 1396074239 and 1396074286 LMissing descriptors for photos 1396074286 and 1396077638 LMissing descriptors for photos 1396077638 and 1396077641 LMissing descriptors for photos 1396077641 and 1396077643 LMissing descriptors for photos 1396077643 and 1396077648 LMissing descriptors for photos 1396077648 and 1396077684 LMissing descriptors for photos 1396077684 and 1396077687 LMissing descriptors for photos 1396077687 and 1396079043 LMissing descriptors for photos 1396079043 and 1396079094 LMissing descriptors for photos 1396079094 and 1396079148 LMissing descriptors for photos 1396079148 and 1396079199 LMissing descriptors for photos 1396079199 and 1396079239 LMissing descriptors for photos 1396079239 and 1396079284 LMissing descriptors for photos 1396079284 and 1396080737 LMissing descriptors for photos 1396080737 and 1396080740 LLLMissing descriptors for photos 1396080746 and 1396080750 LMissing descriptors for photos 1396080750 and 1396080753 LMissing descriptors for photos 1396080753 and 1396081055 LMissing descriptors for photos 1396081055 and 1396081060 LMissing descriptors for photos 1396081060 and 1396081066 LMissing descriptors for photos 1396081066 and 1396081081 LMissing descriptors for photos 1396081081 and 1396081129 LMissing descriptors for photos 1396081129 and 1396081174 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL0:27:59.526695|OFF:LLL0:01:00.711015|ON:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL 25112025 Removing 2 photos because of the 'same image' condition Total on : 1679.526695 list_time_on Warning in study_and_display_distrib_list : min=max : 1679.526695 1679.526695 Total off : 60.711015 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 299 time used for this insertion : 0.059955596923828125 photos_removed : len 2 elapsed_time : remove_photo_duplicate 0.10058045387268066 To do, maybe not at the correct place ! .L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.014092206954956055 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '25112025', 'map_nb_amount': {0: 6, 1: 35, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 420.17116713523865, 'nb_balles_papier': 0.0004100000000000004, 'begin_time_port': 'image_25112025_10_22_02_955179_0002.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0004100000000000004 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '25112025', 'map_nb_amount': {0: 8, 1: 79, 2: 6, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0151360034943, 'nb_balles_papier': 0.0009500000000000018, 'begin_time_port': 'image_25112025_10_30_02_955191_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009500000000000018 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '25112025', 'map_nb_amount': {0: 3, 1: 9, 2: 1, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 120.42268681526184, 'nb_balles_papier': 0.00014000000000000001, 'begin_time_port': 'image_25112025_10_45_02_693185_0000.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.00014000000000000001 We have rejected 1 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 list_same_port_ids : [] list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28885100 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28885113 AND mptpi.`type`=3726 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28885115 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 7.319140911102295 # DISPLAY ALL COLLECTED DATA : {'25112025': {'nb_upload': 299, 'nb_taggue_class': 299, 'nb_taggue_densite': 299, 'nb_descriptors': 153}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1396100095, 1396100092, 1396099808, 1396099805, 1396099803, 1396099798, 1396099794, 1396099790, 1396099544, 1396099540, 1396099536, 1396099524, 1396099519, 1396099512, 1396098855, 1396098851, 1396098846, 1396098844, 1396098843, 1396098842, 1396096934, 1396096932, 1396096929, 1396096928, 1396096926, 1396096920, 1396095206, 1396095205, 1396095204, 1396095099, 1396095094, 1396095090, 1396095087, 1396095086, 1396095083, 1396094497, 1396094493, 1396094487, 1396094486, 1396094484, 1396094480, 1396094271, 1396094266, 1396094261, 1396094255, 1396094249, 1396094246, 1396094006, 1396094002, 1396093998, 1396093997, 1396093996, 1396093994, 1396093762, 1396093761, 1396093755, 1396093749, 1396093743, 1396093737, 1396093082, 1396093078, 1396093075, 1396093069, 1396093065, 1396093062, 1396092632, 1396092626, 1396092620, 1396092614, 1396092576, 1396092513, 1396091037, 1396091034, 1396091033, 1396091009, 1396090965, 1396090917, 1396089982, 1396089981, 1396089662, 1396089655, 1396089652, 1396089647, 1396089645, 1396089642, 1396089399, 1396089396, 1396089393, 1396089390, 1396089388, 1396089384, 1396089167, 1396089165, 1396089161, 1396089157, 1396089150, 1396089147, 1396088920, 1396088917, 1396088914] Looping around the photos to save general results len do output : 1 /28871034Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396100095', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396100092', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099808', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099805', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099803', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099798', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099794', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099790', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099544', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099540', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099536', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099524', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099519', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396099512', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098855', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098851', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098846', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098844', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098843', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396098842', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096934', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096932', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096929', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096928', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096926', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396096920', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095206', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095205', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095204', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095099', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095094', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095090', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095087', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095086', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396095083', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094497', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094493', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094487', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094486', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094484', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094480', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094271', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094266', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094261', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094255', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094249', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094246', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094006', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396094002', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093998', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093997', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093996', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093994', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093762', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093761', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093755', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093749', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093743', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093737', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093082', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093078', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093075', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093069', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093065', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396093062', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092632', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092626', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092620', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092614', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092576', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396092513', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396091037', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396091034', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396091033', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396091009', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396090965', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396090917', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089982', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089981', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089662', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089655', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089652', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089647', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089645', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089642', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089399', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089396', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089393', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089390', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089388', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089384', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089167', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089165', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089161', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089157', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089150', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396089147', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396088920', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396088917', None, None, None, None, None, '4111578') ('4189', None, None, None, None, None, None, None, '4111578') ('4189', '28871034', '1396088914', None, None, None, None, None, '4111578') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.02934741973876953 save_final save missing photos in datou_result : time spend for datou_step_exec : 16.307130336761475 time spend to save output : 0.03025341033935547 total time spend for step 1 : 16.33738374710083 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.65user 0.56system 0:18.45elapsed 12%CPU (0avgtext+0avgdata 104868maxresident)k 0inputs+1344outputs (18major+49606minor)pagefaults 0swaps