python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2027928 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['4348722'] with mtr_portfolio_ids : ['29220554'] and first list_photo_ids : [] new path : /proc/2027928/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.15680408477783203 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Feb 19 07:15:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 377), ('14', 388)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 765} 05122025 29220554 Nombre de photos uploadées : 765 / 23040 (3%) 05122025 29220554 Nombre de photos taguées (types de déchets): 765 / 765 (100%) 05122025 29220554 Nombre de photos taguées (volume) : 765 / 765 (100%) elapsed_time : load_data_split_time_score 2.86102294921875e-06 elapsed_time : order_list_meta_photo_and_scores 0.0003151893615722656 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.032209157943725586 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.24336552619934082 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.05494284629821777 Creating list_photo_total elapsed_time : select_descriptors 34.385338306427 05122025 29220554 Nombre de photos avec descriptors (type 5680) : 373 / 373 (100%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1398065761 photo_id_prec : 0 0:00:00|ON:LL0:03:59.891024|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL0:10:00.545733|ON:LL0:00:00|OFF:LLLLLL0:00:00|ON:LL0:08:59.893135|OFF:LLLLLL0:00:00|ON:LL0:06:00.731673|OFF:0:00:00|ON:LL0:02:59.415904|OFF:0:00:00|ON:LMissing descriptors for photos 1398092766 and 1398092942 LLMissing descriptors for photos 1398092948 and 1398092951 LLL0:08:00.277121|OFF:0:00:00|ON:LL0:13:59.675380|OFF:0:00:59.837468|ON:LMissing descriptors for photos 1398458406 and 1398458685 LMissing descriptors for photos 1398458685 and 1398458686 LMissing descriptors for photos 1398458686 and 1398461105 LMissing descriptors for photos 1398461105 and 1398461121 LMissing descriptors for photos 1398461121 and 1398461124 LMissing descriptors for photos 1398461124 and 1398461140 LMissing descriptors for photos 1398461140 and 1398461143 LMissing descriptors for photos 1398461143 and 1398461145 LMissing descriptors for photos 1398461145 and 1398462602 LMissing descriptors for photos 1398462602 and 1398462603 LMissing descriptors for photos 1398462603 and 1398462604 LMissing descriptors for photos 1398462604 and 1398462608 LMissing descriptors for photos 1398462608 and 1398462610 LMissing descriptors for photos 1398462610 and 1398462616 LMissing descriptors for photos 1398462616 and 1398463123 LMissing descriptors for photos 1398463123 and 1398463167 LMissing descriptors for photos 1398463167 and 1398463183 LMissing descriptors for photos 1398463183 and 1398463185 LMissing descriptors for photos 1398463185 and 1398463215 LMissing descriptors for photos 1398463215 and 1398463218 LMissing descriptors for photos 1398463218 and 1398463770 LMissing descriptors for photos 1398463770 and 1398463773 LMissing descriptors for photos 1398463773 and 1398463775 LMissing descriptors for photos 1398463775 and 1398463778 LMissing descriptors for photos 1398463778 and 1398463781 LMissing descriptors for photos 1398463781 and 1398463787 LMissing descriptors for photos 1398463787 and 1398464796 LMissing descriptors for photos 1398464796 and 1398464801 LMissing descriptors for photos 1398464801 and 1398464803 LMissing descriptors for photos 1398464803 and 1398464806 LMissing descriptors for photos 1398464806 and 1398464810 LMissing descriptors for photos 1398464810 and 1398464812 LMissing descriptors for photos 1398464812 and 1398465117 LMissing descriptors for photos 1398465117 and 1398465121 LMissing descriptors for photos 1398465121 and 1398465125 LMissing descriptors for photos 1398465125 and 1398465129 LMissing descriptors for photos 1398465129 and 1398465131 LMissing descriptors for photos 1398465131 and 1398465135 LMissing descriptors for photos 1398465135 and 1398465458 LMissing descriptors for photos 1398465458 and 1398465459 LMissing descriptors for photos 1398465459 and 1398465461 LMissing descriptors for photos 1398465461 and 1398465464 LMissing descriptors for photos 1398465464 and 1398465468 LMissing descriptors for photos 1398465468 and 1398465473 LMissing descriptors for photos 1398465473 and 1398465535 LMissing descriptors for photos 1398465535 and 1398465539 LMissing descriptors for photos 1398465539 and 1398466653 LMissing descriptors for photos 1398466653 and 1398466657 LMissing descriptors for photos 1398466657 and 1398466663 LMissing descriptors for photos 1398466663 and 1398466667 LMissing descriptors for photos 1398466667 and 1398466670 LMissing descriptors for photos 1398466670 and 1398466700 LMissing descriptors for photos 1398466700 and 1398828545 LMissing descriptors for photos 1398828545 and 1398828550 LMissing descriptors for photos 1398828550 and 1398828555 LMissing descriptors for photos 1398828555 and 1398828557 LMissing descriptors for photos 1398828557 and 1398828560 LMissing descriptors for photos 1398828560 and 1398828564 LMissing descriptors for photos 1398828564 and 1398828795 LMissing descriptors for photos 1398828795 and 1398828801 LMissing descriptors for photos 1398828801 and 1398828803 LMissing descriptors for photos 1398828803 and 1398828805 LMissing descriptors for photos 1398828805 and 1398828808 LMissing descriptors for photos 1398828808 and 1398828812 LMissing descriptors for photos 1398828812 and 1398829024 LMissing descriptors for photos 1398829024 and 1398829030 LMissing descriptors for photos 1398829030 and 1398829033 LMissing descriptors for photos 1398829033 and 1398829038 LMissing descriptors for photos 1398829038 and 1398829049 LMissing descriptors for photos 1398829049 and 1398829052 LMissing descriptors for photos 1398829052 and 1398829366 LMissing descriptors for photos 1398829366 and 1398829369 LMissing descriptors for photos 1398829369 and 1398829372 LMissing descriptors for photos 1398829372 and 1398829379 LMissing descriptors for photos 1398829379 and 1398829380 LMissing descriptors for photos 1398829380 and 1398829382 LMissing descriptors for photos 1398829382 and 1398829669 LMissing descriptors for photos 1398829669 and 1398829671 LMissing descriptors for photos 1398829671 and 1398829673 LMissing descriptors for photos 1398829673 and 1398829676 LMissing descriptors for photos 1398829676 and 1398829677 LMissing descriptors for photos 1398829677 and 1398829678 LMissing descriptors for photos 1398829678 and 1398829894 LMissing descriptors for photos 1398829894 and 1398829895 LMissing descriptors for photos 1398829895 and 1398829898 LMissing descriptors for photos 1398829898 and 1398829900 LMissing descriptors for photos 1398829900 and 1398829923 LMissing descriptors for photos 1398829923 and 1398830138 LMissing descriptors for photos 1398830138 and 1398830142 LMissing descriptors for photos 1398830142 and 1398830147 LMissing descriptors for photos 1398830147 and 1398830151 LMissing descriptors for photos 1398830151 and 1398830153 LMissing descriptors for photos 1398830153 and 1398830155 LMissing descriptors for photos 1398830155 and 1398830370 LMissing descriptors for photos 1398830370 and 1398830375 LMissing descriptors for photos 1398830375 and 1398830380 LMissing descriptors for photos 1398830380 and 1398830385 LMissing descriptors for photos 1398830385 and 1398830391 LMissing descriptors for photos 1398830391 and 1398830398 LMissing descriptors for photos 1398830398 and 1398830596 LMissing descriptors for photos 1398830596 and 1398830606 LMissing descriptors for photos 1398830606 and 1398830610 LMissing descriptors for photos 1398830610 and 1398830613 LMissing descriptors for photos 1398830613 and 1398830616 LMissing descriptors for photos 1398830616 and 1398830618 LMissing descriptors for photos 1398830618 and 1398830830 LMissing descriptors for photos 1398830830 and 1398830835 LMissing descriptors for photos 1398830835 and 1398830837 LMissing descriptors for photos 1398830837 and 1398830839 LMissing descriptors for photos 1398830839 and 1398830840 LMissing descriptors for photos 1398830840 and 1398830841 LMissing descriptors for photos 1398830841 and 1398831107 LMissing descriptors for photos 1398831107 and 1398831110 LMissing descriptors for photos 1398831110 and 1398831116 LMissing descriptors for photos 1398831116 and 1398831120 LMissing descriptors for photos 1398831120 and 1398831122 LMissing descriptors for photos 1398831122 and 1398831124 LMissing descriptors for photos 1398831124 and 1398831355 LMissing descriptors for photos 1398831355 and 1398831356 LMissing descriptors for photos 1398831356 and 1398831358 LMissing descriptors for photos 1398831358 and 1398831360 LMissing descriptors for photos 1398831360 and 1398831363 LMissing descriptors for photos 1398831363 and 1398831365 LMissing descriptors for photos 1398831365 and 1398832313 LMissing descriptors for photos 1398832313 and 1398832315 LMissing descriptors for photos 1398832315 and 1398832324 LMissing descriptors for photos 1398832324 and 1398832338 LMissing descriptors for photos 1398832338 and 1398832344 LMissing descriptors for photos 1398832344 and 1398832345 LMissing descriptors for photos 1398832345 and 1398833849 LMissing descriptors for photos 1398833849 and 1398833989 LMissing descriptors for photos 1398833989 and 1398834154 LMissing descriptors for photos 1398834154 and 1398837230 LMissing descriptors for photos 1398837230 and 1398837281 LMissing descriptors for photos 1398837281 and 1398837358 LMissing descriptors for photos 1398837358 and 1398837431 LMissing descriptors for photos 1398837431 and 1398837481 LMissing descriptors for photos 1398837481 and 1398837530 LMissing descriptors for photos 1398837530 and 1398840762 LMissing descriptors for photos 1398840762 and 1398840765 LMissing descriptors for photos 1398840765 and 1398840768 LMissing descriptors for photos 1398840768 and 1398840771 LMissing descriptors for photos 1398840771 and 1398840776 LMissing descriptors for photos 1398840776 and 1398840821 LMissing descriptors for photos 1398840821 and 1398843385 LMissing descriptors for photos 1398843385 and 1398843436 LMissing descriptors for photos 1398843436 and 1398843495 LMissing descriptors for photos 1398843495 and 1398843528 LMissing descriptors for photos 1398843528 and 1398843564 LMissing descriptors for photos 1398843564 and 1398843630 LMissing descriptors for photos 1398843630 and 1398847475 LMissing descriptors for photos 1398847475 and 1398847486 LMissing descriptors for photos 1398847486 and 1398847488 LMissing descriptors for photos 1398847488 and 1398847490 LMissing descriptors for photos 1398847490 and 1398847492 LMissing descriptors for photos 1398847492 and 1398847494 LMissing descriptors for photos 1398847494 and 1398849201 LMissing descriptors for photos 1398849201 and 1398849205 LMissing descriptors for photos 1398849205 and 1398849211 LMissing descriptors for photos 1398849211 and 1398849215 LMissing descriptors for photos 1398849215 and 1398849218 LMissing descriptors for photos 1398849218 and 1398849223 LMissing descriptors for photos 1398849223 and 1398850672 LMissing descriptors for photos 1398850672 and 1398850675 LMissing descriptors for photos 1398850675 and 1398850681 LMissing descriptors for photos 1398850681 and 1398850685 LMissing descriptors for photos 1398850685 and 1398850687 LMissing descriptors for photos 1398850687 and 1398850691 LMissing descriptors for photos 1398850691 and 1398852555 LMissing descriptors for photos 1398852555 and 1398852600 LMissing descriptors for photos 1398852600 and 1398852632 LMissing descriptors for photos 1398852632 and 1398852639 LMissing descriptors for photos 1398852639 and 1398852642 LMissing descriptors for photos 1398852642 and 1398852655 LMissing descriptors for photos 1398852655 and 1398853239 LMissing descriptors for photos 1398853239 and 1398853243 LMissing descriptors for photos 1398853243 and 1398853252 LMissing descriptors for photos 1398853252 and 1398855079 LMissing descriptors for photos 1398855079 and 1398855085 LMissing descriptors for photos 1398855085 and 1398855112 LMissing descriptors for photos 1398855112 and 1398855247 LMissing descriptors for photos 1398855247 and 1398855286 LMissing descriptors for photos 1398855286 and 1398855330 LMissing descriptors for photos 1398855330 and 1399005689 LMissing descriptors for photos 1399005689 and 1399005698 LMissing descriptors for photos 1399005698 and 1399005700 LMissing descriptors for photos 1399005700 and 1399005701 LMissing descriptors for photos 1399005701 and 1399005703 LMissing descriptors for photos 1399005703 and 1399005706 LMissing descriptors for photos 1399005706 and 1399006162 LMissing descriptors for photos 1399006162 and 1399006176 LMissing descriptors for photos 1399006176 and 1399006180 LMissing descriptors for photos 1399006180 and 1399006189 LMissing descriptors for photos 1399006189 and 1399006194 LMissing descriptors for photos 1399006194 and 1399006197 LMissing descriptors for photos 1399006197 and 1399006614 LMissing descriptors for photos 1399006614 and 1399006617 LMissing descriptors for photos 1399006617 and 1399006620 LMissing descriptors for photos 1399006620 and 1399006622 LMissing descriptors for photos 1399006622 and 1399006626 LMissing descriptors for photos 1399006626 and 1399006671 LMissing descriptors for photos 1399006671 and 1399007556 LMissing descriptors for photos 1399007556 and 1399007569 LMissing descriptors for photos 1399007569 and 1399007575 LMissing descriptors for photos 1399007575 and 1399007578 LMissing descriptors for photos 1399007578 and 1399007591 LMissing descriptors for photos 1399007591 and 1399007641 LMissing descriptors for photos 1399007641 and 1399008084 LMissing descriptors for photos 1399008084 and 1399008088 LMissing descriptors for photos 1399008088 and 1399008094 LMissing descriptors for photos 1399008094 and 1399008104 LMissing descriptors for photos 1399008104 and 1399008118 LMissing descriptors for photos 1399008118 and 1399008122 LMissing descriptors for photos 1399008122 and 1399008741 LMissing descriptors for photos 1399008741 and 1399008742 LMissing descriptors for photos 1399008742 and 1399008747 LMissing descriptors for photos 1399008747 and 1399008752 LMissing descriptors for photos 1399008752 and 1399008763 LMissing descriptors for photos 1399008763 and 1399008965 LMissing descriptors for photos 1399008965 and 1399008969 LMissing descriptors for photos 1399008969 and 1399008974 LMissing descriptors for photos 1399008974 and 1399008977 LMissing descriptors for photos 1399008977 and 1399008979 LMissing descriptors for photos 1399008979 and 1399008981 LMissing descriptors for photos 1399008981 and 1399009578 LMissing descriptors for photos 1399009578 and 1399009582 LMissing descriptors for photos 1399009582 and 1399009586 LMissing descriptors for photos 1399009586 and 1399009591 LMissing descriptors for photos 1399009591 and 1399009593 LMissing descriptors for photos 1399009593 and 1399009595 LMissing descriptors for photos 1399009595 and 1399012272 LMissing descriptors for photos 1399012272 and 1399012321 LMissing descriptors for photos 1399012321 and 1399012370 LMissing descriptors for photos 1399012370 and 1399012418 LMissing descriptors for photos 1399012418 and 1399012448 LMissing descriptors for photos 1399012448 and 1399012450 LMissing descriptors for photos 1399012450 and 1399015055 LMissing descriptors for photos 1399015055 and 1399015058 LMissing descriptors for photos 1399015058 and 1399015063 LMissing descriptors for photos 1399015063 and 1399015067 LMissing descriptors for photos 1399015067 and 1399015068 LMissing descriptors for photos 1399015068 and 1399015069 LMissing descriptors for photos 1399015069 and 1399015906 LMissing descriptors for photos 1399015906 and 1399015909 LMissing descriptors for photos 1399015909 and 1399015914 LMissing descriptors for photos 1399015914 and 1399015918 LMissing descriptors for photos 1399015918 and 1399015920 LMissing descriptors for photos 1399015920 and 1399015925 LMissing descriptors for photos 1399015925 and 1399017580 LMissing descriptors for photos 1399017580 and 1399017589 LMissing descriptors for photos 1399017589 and 1399017594 LMissing descriptors for photos 1399017594 and 1399017597 LMissing descriptors for photos 1399017597 and 1399017599 LMissing descriptors for photos 1399017599 and 1399017636 LMissing descriptors for photos 1399017636 and 1399018326 LMissing descriptors for photos 1399018326 and 1399018329 LMissing descriptors for photos 1399018329 and 1399018355 LMissing descriptors for photos 1399018355 and 1399018408 LMissing descriptors for photos 1399018408 and 1399018455 LMissing descriptors for photos 1399018455 and 1399018459 LMissing descriptors for photos 1399018459 and 1399019072 LMissing descriptors for photos 1399019072 and 1399019073 LMissing descriptors for photos 1399019073 and 1399019076 LMissing descriptors for photos 1399019076 and 1399023220 LMissing descriptors for photos 1399023220 and 1399023281 LMissing descriptors for photos 1399023281 and 1399023352 LMissing descriptors for photos 1399023352 and 1399023484 LMissing descriptors for photos 1399023484 and 1399023595 LMissing descriptors for photos 1399023595 and 1399023686 LMissing descriptors for photos 1399023686 and 1399026802 LMissing descriptors for photos 1399026802 and 1399026849 LMissing descriptors for photos 1399026849 and 1399026897 LMissing descriptors for photos 1399026897 and 1399026900 LMissing descriptors for photos 1399026900 and 1399026904 LMissing descriptors for photos 1399026904 and 1399026908 LMissing descriptors for photos 1399026908 and 1399029303 LMissing descriptors for photos 1399029303 and 1399029306 LMissing descriptors for photos 1399029306 and 1399029309 LMissing descriptors for photos 1399029309 and 1399029312 LMissing descriptors for photos 1399029312 and 1399029314 LMissing descriptors for photos 1399029314 and 1399029321 LMissing descriptors for photos 1399029321 and 1399032715 LMissing descriptors for photos 1399032715 and 1399032717 LMissing descriptors for photos 1399032717 and 1399032721 LMissing descriptors for photos 1399032721 and 1399032724 LMissing descriptors for photos 1399032724 and 1399032726 LMissing descriptors for photos 1399032726 and 1399032728 LMissing descriptors for photos 1399032728 and 1399036113 LMissing descriptors for photos 1399036113 and 1399036199 LMissing descriptors for photos 1399036199 and 1399036290 LMissing descriptors for photos 1399036290 and 1399036341 LMissing descriptors for photos 1399036341 and 1399036387 LMissing descriptors for photos 1399036387 and 1399036438 LMissing descriptors for photos 1399036438 and 1399036955 LMissing descriptors for photos 1399036955 and 1399037005 LMissing descriptors for photos 1399037005 and 1399037053 LMissing descriptors for photos 1399037053 and 1399037075 LMissing descriptors for photos 1399037075 and 1399037079 LMissing descriptors for photos 1399037079 and 1399037082 LMissing descriptors for photos 1399037082 and 1399038688 LMissing descriptors for photos 1399038688 and 1399038696 LMissing descriptors for photos 1399038696 and 1399038713 LMissing descriptors for photos 1399038713 and 1399038716 LMissing descriptors for photos 1399038716 and 1399038718 LMissing descriptors for photos 1399038718 and 1399038759 LMissing descriptors for photos 1399038759 and 1399039174 LMissing descriptors for photos 1399039174 and 1399039175 LMissing descriptors for photos 1399039175 and 1399039179 LMissing descriptors for photos 1399039179 and 1399039778 LMissing descriptors for photos 1399039778 and 1399039783 LMissing descriptors for photos 1399039783 and 1399039787 LMissing descriptors for photos 1399039787 and 1399039792 LMissing descriptors for photos 1399039792 and 1399039794 LMissing descriptors for photos 1399039794 and 1399039796 LMissing descriptors for photos 1399039796 and 1399440246 LMissing descriptors for photos 1399440246 and 1399440255 LMissing descriptors for photos 1399440255 and 1399440260 LMissing descriptors for photos 1399440260 and 1399440262 LMissing descriptors for photos 1399440262 and 1399440267 LMissing descriptors for photos 1399440267 and 1399440274 LMissing descriptors for photos 1399440274 and 1399440481 LMissing descriptors for photos 1399440481 and 1399440483 LMissing descriptors for photos 1399440483 and 1399440486 LMissing descriptors for photos 1399440486 and 1399440489 LMissing descriptors for photos 1399440489 and 1399440492 LMissing descriptors for photos 1399440492 and 1399440502 LMissing descriptors for photos 1399440502 and 1399440712 LMissing descriptors for photos 1399440712 and 1399440715 LMissing descriptors for photos 1399440715 and 1399440718 LMissing descriptors for photos 1399440718 and 1399440721 LMissing descriptors for photos 1399440721 and 1399440725 LMissing descriptors for photos 1399440725 and 1399440728 LMissing descriptors for photos 1399440728 and 1399440985 LMissing descriptors for photos 1399440985 and 1399440987 LMissing descriptors for photos 1399440987 and 1399440991 LMissing descriptors for photos 1399440991 and 1399440994 LMissing descriptors for photos 1399440994 and 1399440997 LMissing descriptors for photos 1399440997 and 1399441002 LMissing descriptors for photos 1399441002 and 1399441201 LMissing descriptors for photos 1399441201 and 1399441204 LMissing descriptors for photos 1399441204 and 1399441209 LMissing descriptors for photos 1399441209 and 1399441216 LMissing descriptors for photos 1399441216 and 1399441226 LMissing descriptors for photos 1399441226 and 1399441232 LMissing descriptors for photos 1399441232 and 1399441326 LMissing descriptors for photos 1399441326 and 1399441327 LMissing descriptors for photos 1399441327 and 1399441328 LMissing descriptors for photos 1399441328 and 1399443597 LMissing descriptors for photos 1399443597 and 1399443600 LMissing descriptors for photos 1399443600 and 1399443604 LMissing descriptors for photos 1399443604 and 1399443608 LMissing descriptors for photos 1399443608 and 1399443611 LMissing descriptors for photos 1399443611 and 1399443617 LMissing descriptors for photos 1399443617 and 1399443971 LMissing descriptors for photos 1399443971 and 1399443975 LMissing descriptors for photos 1399443975 and 1399443978 LMissing descriptors for photos 1399443978 and 1399443981 LMissing descriptors for photos 1399443981 and 1399443984 LMissing descriptors for photos 1399443984 and 1399443986 LMissing descriptors for photos 1399443986 and 1399444669 LMissing descriptors for photos 1399444669 and 1399444672 LMissing descriptors for photos 1399444672 and 1399444722 LMissing descriptors for photos 1399444722 and 1399444773 LMissing descriptors for photos 1399444773 and 1399444775 LMissing descriptors for photos 1399444775 and 1399444794 LMissing descriptors for photos 1399444794 and 1399445025 LMissing descriptors for photos 1399445025 and 1399445027 LMissing descriptors for photos 1399445027 and 1399445032 LMissing descriptors for photos 1399445032 and 1399445035 LMissing descriptors for photos 1399445035 and 1399445040 LMissing descriptors for photos 1399445040 and 1399445046 LMissing descriptors for photos 1399445046 and 1399445321 LMissing descriptors for photos 1399445321 and 1399445326 LMissing descriptors for photos 1399445326 and 1399445331 LMissing descriptors for photos 1399445331 and 1399445339 LMissing descriptors for photos 1399445339 and 1399445347 LMissing descriptors for photos 1399445347 and 1399445350 LMissing descriptors for photos 1399445350 and 1399446303 LMissing descriptors for photos 1399446303 and 1399446349 LMissing descriptors for photos 1399446349 and 1399446360 LMissing descriptors for photos 1399446360 and 1399446364 LMissing descriptors for photos 1399446364 and 1399446368 LMissing descriptors for photos 1399446368 and 1399446372 LMissing descriptors for photos 1399446372 and 1399446847 LMissing descriptors for photos 1399446847 and 1399446849 LMissing descriptors for photos 1399446849 and 1399446867 LMissing descriptors for photos 1399446867 and 1399446882 L 05122025 Removing 76 photos because of the 'same image' condition Total on : 2639.884237 list_time_on Total off : 660.3832010000001 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 765 time used for this insertion : 0.2517819404602051 photos_removed : len 76 elapsed_time : remove_photo_duplicate 0.31241416931152344 To do, maybe not at the correct place ! ..........................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L...L.L.L.L...................................................L.L.L.L....................................L................L.................L.L..L.L.............................L.................................................................................................L..............................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.025783300399780273 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '05122025', 'map_nb_amount': {0: 3, 1: 23, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.4367568492889, 'nb_balles_papier': 0.0002800000000000001, 'begin_time_port': 'image_05122025_10_00_02_411787m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0002800000000000001 result_one_balle_Type_JRM:{'day': '05122025', 'map_nb_amount': {0: 13, 1: 69, 2: 4, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.984915971756, 'nb_balles_papier': 0.0008600000000000016, 'begin_time_port': 'image_05122025_10_15_02_488436m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008600000000000016 result_one_balle_Type_JRM:{'day': '05122025', 'map_nb_amount': {0: 14, 1: 69, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.7304759025574, 'nb_balles_papier': 0.0008500000000000016, 'begin_time_port': 'image_05122025_10_30_03_248012m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008500000000000016 result_one_balle_Type_JRM:{'day': '05122025', 'map_nb_amount': {0: 14, 1: 82, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0472350120544, 'nb_balles_papier': 0.000980000000000002, 'begin_time_port': 'image_05122025_10_45_02_652463m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.000980000000000002 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 4 list_same_port_ids : [29225244] find same portfolio which already exist 29225244 , we will use it list_same_port_ids : [29225960] find same portfolio which already exist 29225960 , we will use it list_same_port_ids : [29228464] find same portfolio which already exist 29228464 , we will use it list_same_port_ids : [29262639] find same portfolio which already exist 29262639 , we will use it Qualite : 0.12941184624967841 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29225244 AND mptpi.`type`=3726 To do Qualite : 0.10165417644987536 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29225960 AND mptpi.`type`=3726 To do Qualite : 0.0890542220714585 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29228464 AND mptpi.`type`=3726 To do Qualite : 0.09937930843692273 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29262639 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 0.6954622268676758 # DISPLAY ALL COLLECTED DATA : {'05122025': {'nb_upload': 765, 'nb_taggue_class': 765, 'nb_taggue_densite': 765, 'nb_descriptors': 373}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1399446882, 1399446867, 1399446849, 1399446847, 1399446372, 1399446368, 1399446364, 1399446360, 1399446349, 1399446303, 1399445350, 1399445347, 1399445339, 1399445331, 1399445326, 1399445321, 1399445046, 1399445040, 1399445035, 1399445032, 1399445027, 1399445025, 1399444794, 1399444775, 1399444773, 1399444722, 1399444672, 1399444669, 1399443986, 1399443984, 1399443981, 1399443978, 1399443975, 1399443971, 1399443617, 1399443611, 1399443608, 1399443604, 1399443600, 1399443597, 1399441328, 1399441327, 1399441326, 1399441232, 1399441226, 1399441216, 1399441209, 1399441204, 1399441201, 1399441002, 1399440997, 1399440994, 1399440991, 1399440987, 1399440985, 1399440728, 1399440725, 1399440721, 1399440718, 1399440715, 1399440712, 1399440502, 1399440492, 1399440489, 1399440486, 1399440483, 1399440481, 1399440274, 1399440267, 1399440262, 1399440260, 1399440255, 1399440246, 1399039796, 1399039794, 1399039792, 1399039787, 1399039783, 1399039778, 1399039179, 1399039175, 1399039174, 1399038759, 1399038718, 1399038716, 1399038713, 1399038696, 1399038688, 1399037082, 1399037079, 1399037075, 1399037053, 1399037005, 1399036955, 1399036438, 1399036387, 1399036341, 1399036290, 1399036199, 1399036113] Looping around the photos to save general results len do output : 1 /29220554Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446882', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446867', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446849', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446847', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446372', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446368', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446364', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446360', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446349', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399446303', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445350', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445347', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445339', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445331', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445326', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445321', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445046', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445040', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445035', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445032', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445027', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399445025', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444794', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444775', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444773', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444722', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444672', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399444669', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443986', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443984', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443981', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443978', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443975', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443971', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443617', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443611', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443608', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443604', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443600', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399443597', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441328', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441327', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441326', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441232', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441226', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441216', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441209', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441204', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441201', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399441002', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440997', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440994', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440991', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440987', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440985', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440728', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440725', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440721', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440718', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440715', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440712', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440502', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440492', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440489', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440486', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440483', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440481', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440274', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440267', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440262', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440260', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440255', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399440246', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039796', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039794', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039792', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039787', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039783', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039778', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039179', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039175', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399039174', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038759', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038718', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038716', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038713', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038696', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399038688', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399037082', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399037079', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399037075', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399037053', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399037005', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036955', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036438', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036387', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036341', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036290', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036199', None, None, None, None, None, '4348722') ('4189', None, None, None, None, None, None, None, '4348722') ('4189', '29220554', '1399036113', None, None, None, None, None, '4348722') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.06548190116882324 save_final save missing photos in datou_result : time spend for datou_step_exec : 36.07698678970337 time spend to save output : 0.06632351875305176 total time spend for step 1 : 36.14331030845642 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.17user 1.00system 0:40.69elapsed 7%CPU (0avgtext+0avgdata 114720maxresident)k 6216inputs+3144outputs (14major+53904minor)pagefaults 0swaps