python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 2051735 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['4348895'] with mtr_portfolio_ids : ['28524663'] and first list_photo_ids : [] new path : /proc/2051735/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.16159415245056152 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Feb 19 07:55:27 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 371), ('14', 356)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 600} 14112025 28524663 Nombre de photos uploadées : 727 / 23040 (3%) 14112025 28524663 Nombre de photos taguées (types de déchets): 600 / 727 (82%) 14112025 28524663 Nombre de photos taguées (volume) : 600 / 727 (82%) elapsed_time : load_data_split_time_score 4.0531158447265625e-06 elapsed_time : order_list_meta_photo_and_scores 0.00026917457580566406 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.0278778076171875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.26212048530578613 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.05652594566345215 Creating list_photo_total elapsed_time : select_descriptors 31.122040271759033 14112025 28524663 Nombre de photos avec descriptors (type 5680) : 366 / 493 (74%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1394386003 photo_id_prec : 0 0:00:00|ON:LMissing descriptors for photos 1394388865 and 1394388905 LMissing descriptors for photos 1394388905 and 1394388957 LMissing descriptors for photos 1394388957 and 1394389004 LMissing descriptors for photos 1394389004 and 1394389056 LMissing descriptors for photos 1394389056 and 1394390964 LMissing descriptors for photos 1394390964 and 1394391019 LLL0:04:00.059920|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL0:06:00.174386|ON:LL0:05:00.374962|OFF:0:00:59.644834|ON:LL0:07:00.054663|OFF:0:00:00|ON:LL0:00:00|OFF:0:00:00|ON:LL0:08:00.067110|OFF:0:00:59.917747|ON:LL0:00:00|OFF:0:00:00|ON:LL0:03:00.251421|OFF:LL0:00:00|ON:LL0:01:59.384183|OFF:0:00:00|ON:LL0:03:59.969408|OFF:0:00:00|ON:LL0:00:00|OFF:LL0:01:01.184901|ON:LMissing descriptors for photos 1397183833 and 1397183850 LMissing descriptors for photos 1397183850 and 1397183854 LMissing descriptors for photos 1397183854 and 1397183859 LMissing descriptors for photos 1397183859 and 1397183863 LMissing descriptors for photos 1397183863 and 1397183866 LMissing descriptors for photos 1397183866 and 1397183867 LMissing descriptors for photos 1397183867 and 1397183932 LMissing descriptors for photos 1397183932 and 1397183986 LMissing descriptors for photos 1397183986 and 1397184042 LMissing descriptors for photos 1397184042 and 1397184094 LMissing descriptors for photos 1397184094 and 1397184147 LMissing descriptors for photos 1397184147 and 1397184209 LMissing descriptors for photos 1397184209 and 1397190564 LMissing descriptors for photos 1397190564 and 1397190570 LMissing descriptors for photos 1397190570 and 1397190573 LMissing descriptors for photos 1397190573 and 1397190577 LMissing descriptors for photos 1397190577 and 1397190581 LMissing descriptors for photos 1397190581 and 1397190587 LMissing descriptors for photos 1397190587 and 1397190603 LMissing descriptors for photos 1397190603 and 1397190605 LMissing descriptors for photos 1397190605 and 1397190608 LMissing descriptors for photos 1397190608 and 1397190611 LMissing descriptors for photos 1397190611 and 1397190614 LMissing descriptors for photos 1397190614 and 1397190620 LMissing descriptors for photos 1397190620 and 1397190638 LLLMissing descriptors for photos 1397190645 and 1397190649 LMissing descriptors for photos 1397190649 and 1397190657 LMissing descriptors for photos 1397190657 and 1397190662 LMissing descriptors for photos 1397190662 and 1397190714 LMissing descriptors for photos 1397190714 and 1397190717 LMissing descriptors for photos 1397190717 and 1397190720 LMissing descriptors for photos 1397190720 and 1397190725 LMissing descriptors for photos 1397190725 and 1397190729 LMissing descriptors for photos 1397190729 and 1397190734 LMissing descriptors for photos 1397190734 and 1397190769 LMissing descriptors for photos 1397190769 and 1397190771 LMissing descriptors for photos 1397190771 and 1397190777 LMissing descriptors for photos 1397190777 and 1397190782 LMissing descriptors for photos 1397190782 and 1397190787 LMissing descriptors for photos 1397190787 and 1397190790 LMissing descriptors for photos 1397190790 and 1397190834 LMissing descriptors for photos 1397190834 and 1397190838 LMissing descriptors for photos 1397190838 and 1397190843 LMissing descriptors for photos 1397190843 and 1397190847 LMissing descriptors for photos 1397190847 and 1397190875 LMissing descriptors for photos 1397190875 and 1397190877 LMissing descriptors for photos 1397190877 and 1397190930 LMissing descriptors for photos 1397190930 and 1397190944 LMissing descriptors for photos 1397190944 and 1397190948 LMissing descriptors for photos 1397190948 and 1397190951 LMissing descriptors for photos 1397190951 and 1397190977 LMissing descriptors for photos 1397190977 and 1397190979 LMissing descriptors for photos 1397190979 and 1397191130 LMissing descriptors for photos 1397191130 and 1397191133 LMissing descriptors for photos 1397191133 and 1397191134 LMissing descriptors for photos 1397191134 and 1397191140 LMissing descriptors for photos 1397191140 and 1397191151 LMissing descriptors for photos 1397191151 and 1397191154 LMissing descriptors for photos 1397191154 and 1397191180 LMissing descriptors for photos 1397191180 and 1397191182 LMissing descriptors for photos 1397191182 and 1397191185 LMissing descriptors for photos 1397191185 and 1397191225 LMissing descriptors for photos 1397191225 and 1397191254 LMissing descriptors for photos 1397191254 and 1397191257 LMissing descriptors for photos 1397191257 and 1397191348 LMissing descriptors for photos 1397191348 and 1397191349 LMissing descriptors for photos 1397191349 and 1397191351 LMissing descriptors for photos 1397191351 and 1397191355 LMissing descriptors for photos 1397191355 and 1397191359 LMissing descriptors for photos 1397191359 and 1397191369 LMissing descriptors for photos 1397191369 and 1397191381 LMissing descriptors for photos 1397191381 and 1397191386 LMissing descriptors for photos 1397191386 and 1397191395 LMissing descriptors for photos 1397191395 and 1397191400 LMissing descriptors for photos 1397191400 and 1397191405 LMissing descriptors for photos 1397191405 and 1397191411 LMissing descriptors for photos 1397191411 and 1397191438 LMissing descriptors for photos 1397191438 and 1397191440 LMissing descriptors for photos 1397191440 and 1397191443 LMissing descriptors for photos 1397191443 and 1397191484 LMissing descriptors for photos 1397191484 and 1397191498 LMissing descriptors for photos 1397191498 and 1397191503 LMissing descriptors for photos 1397191503 and 1397191519 LMissing descriptors for photos 1397191519 and 1397191521 LMissing descriptors for photos 1397191521 and 1397191532 LMissing descriptors for photos 1397191532 and 1397191537 LMissing descriptors for photos 1397191537 and 1397191542 LMissing descriptors for photos 1397191542 and 1397191547 LMissing descriptors for photos 1397191547 and 1397191566 LMissing descriptors for photos 1397191566 and 1397191569 LMissing descriptors for photos 1397191569 and 1397191572 LMissing descriptors for photos 1397191572 and 1397191576 LMissing descriptors for photos 1397191576 and 1397191583 LMissing descriptors for photos 1397191583 and 1397191588 LMissing descriptors for photos 1397191588 and 1397191613 LMissing descriptors for photos 1397191613 and 1397191616 LMissing descriptors for photos 1397191616 and 1397191618 LMissing descriptors for photos 1397191618 and 1397191621 LMissing descriptors for photos 1397191621 and 1397191628 LMissing descriptors for photos 1397191628 and 1397191632 LMissing descriptors for photos 1397191632 and 1397191647 LMissing descriptors for photos 1397191647 and 1397191651 LMissing descriptors for photos 1397191651 and 1397191656 LMissing descriptors for photos 1397191656 and 1397191663 LMissing descriptors for photos 1397191663 and 1397191669 LMissing descriptors for photos 1397191669 and 1397191673 LMissing descriptors for photos 1397191673 and 1397192004 LMissing descriptors for photos 1397192004 and 1397192052 LMissing descriptors for photos 1397192052 and 1397192057 LMissing descriptors for photos 1397192057 and 1397192061 LMissing descriptors for photos 1397192061 and 1397192071 LMissing descriptors for photos 1397192071 and 1397192111 LMissing descriptors for photos 1397192111 and 1397192156 LMissing descriptors for photos 1397192156 and 1397192169 LMissing descriptors for photos 1397192169 and 1397192175 LMissing descriptors for photos 1397192175 and 1397192179 LMissing descriptors for photos 1397192179 and 1397192184 LMissing descriptors for photos 1397192184 and 1397192189 LMissing descriptors for photos 1397192189 and 1397192213 LMissing descriptors for photos 1397192213 and 1397192222 LMissing descriptors for photos 1397192222 and 1397192226 LMissing descriptors for photos 1397192226 and 1397192229 LMissing descriptors for photos 1397192229 and 1397192232 LMissing descriptors for photos 1397192232 and 1397192235 LMissing descriptors for photos 1397192235 and 1397192288 LMissing descriptors for photos 1397192288 and 1397192297 LMissing descriptors for photos 1397192297 and 1397192302 LMissing descriptors for photos 1397192302 and 1397192308 LMissing descriptors for photos 1397192308 and 1397192311 LMissing descriptors for photos 1397192311 and 1397192312 LMissing descriptors for photos 1397192312 and 1397192509 LMissing descriptors for photos 1397192509 and 1397192558 LMissing descriptors for photos 1397192558 and 1397192610 LMissing descriptors for photos 1397192610 and 1397192632 LMissing descriptors for photos 1397192632 and 1397192638 LMissing descriptors for photos 1397192638 and 1397192640 LMissing descriptors for photos 1397192640 and 1397192672 LMissing descriptors for photos 1397192672 and 1397192676 LMissing descriptors for photos 1397192676 and 1397192681 LMissing descriptors for photos 1397192681 and 1397192686 LMissing descriptors for photos 1397192686 and 1397192703 LMissing descriptors for photos 1397192703 and 1397192705 LMissing descriptors for photos 1397192705 and 1397192806 LMissing descriptors for photos 1397192806 and 1397192823 LMissing descriptors for photos 1397192823 and 1397192840 LMissing descriptors for photos 1397192840 and 1397192860 LMissing descriptors for photos 1397192860 and 1397192861 LMissing descriptors for photos 1397192861 and 1397192863 LMissing descriptors for photos 1397192863 and 1397192887 LMissing descriptors for photos 1397192887 and 1397192890 LMissing descriptors for photos 1397192890 and 1397192940 LMissing descriptors for photos 1397192940 and 1397192984 LMissing descriptors for photos 1397192984 and 1397193030 LMissing descriptors for photos 1397193030 and 1397193075 LMissing descriptors for photos 1397193075 and 1397193345 LMissing descriptors for photos 1397193345 and 1397193401 LMissing descriptors for photos 1397193401 and 1397193452 LMissing descriptors for photos 1397193452 and 1397193521 LMissing descriptors for photos 1397193521 and 1397193590 LLLMissing descriptors for photos 1397193780 and 1397193784 LMissing descriptors for photos 1397193784 and 1397193792 LMissing descriptors for photos 1397193792 and 1397193794 LMissing descriptors for photos 1397193794 and 1397193830 LMissing descriptors for photos 1397193830 and 1397193903 LMissing descriptors for photos 1397193903 and 1397194074 LMissing descriptors for photos 1397194074 and 1397194112 LMissing descriptors for photos 1397194112 and 1397194131 LMissing descriptors for photos 1397194131 and 1397194171 LMissing descriptors for photos 1397194171 and 1397194175 LMissing descriptors for photos 1397194175 and 1397194179 LMissing descriptors for photos 1397194179 and 1397194435 LMissing descriptors for photos 1397194435 and 1397194449 LMissing descriptors for photos 1397194449 and 1397194462 LMissing descriptors for photos 1397194462 and 1397194471 LMissing descriptors for photos 1397194471 and 1397194474 LMissing descriptors for photos 1397194474 and 1397194477 LMissing descriptors for photos 1397194477 and 1397194606 LMissing descriptors for photos 1397194606 and 1397194653 LMissing descriptors for photos 1397194653 and 1397194697 LMissing descriptors for photos 1397194697 and 1397194746 LMissing descriptors for photos 1397194746 and 1397194798 LMissing descriptors for photos 1397194798 and 1397194850 LMissing descriptors for photos 1397194850 and 1397195027 LMissing descriptors for photos 1397195027 and 1397195028 LMissing descriptors for photos 1397195028 and 1397195032 LMissing descriptors for photos 1397195032 and 1397195051 LMissing descriptors for photos 1397195051 and 1397195102 LMissing descriptors for photos 1397195102 and 1397195153 LMissing descriptors for photos 1397195153 and 1397195413 LMissing descriptors for photos 1397195413 and 1397195433 LMissing descriptors for photos 1397195433 and 1397195447 LMissing descriptors for photos 1397195447 and 1397195453 LMissing descriptors for photos 1397195453 and 1397195457 LMissing descriptors for photos 1397195457 and 1397195460 LMissing descriptors for photos 1397195460 and 1397195477 LMissing descriptors for photos 1397195477 and 1397195480 LMissing descriptors for photos 1397195480 and 1397195483 LMissing descriptors for photos 1397195483 and 1397195488 LMissing descriptors for photos 1397195488 and 1397195492 LMissing descriptors for photos 1397195492 and 1397195497 LMissing descriptors for photos 1397195497 and 1397195508 LMissing descriptors for photos 1397195508 and 1397195511 LMissing descriptors for photos 1397195511 and 1397195526 LMissing descriptors for photos 1397195526 and 1397195534 LMissing descriptors for photos 1397195534 and 1397195539 LMissing descriptors for photos 1397195539 and 1397195543 LMissing descriptors for photos 1397195543 and 1397195617 LMissing descriptors for photos 1397195617 and 1397195620 LMissing descriptors for photos 1397195620 and 1397195624 LMissing descriptors for photos 1397195624 and 1397195638 LMissing descriptors for photos 1397195638 and 1397195647 LMissing descriptors for photos 1397195647 and 1397195650 LMissing descriptors for photos 1397195650 and 1397195665 LMissing descriptors for photos 1397195665 and 1397195669 LMissing descriptors for photos 1397195669 and 1397195672 LMissing descriptors for photos 1397195672 and 1397195678 LMissing descriptors for photos 1397195678 and 1397195684 LMissing descriptors for photos 1397195684 and 1397195692 LMissing descriptors for photos 1397195692 and 1397195709 LMissing descriptors for photos 1397195709 and 1397195713 LMissing descriptors for photos 1397195713 and 1397195720 LMissing descriptors for photos 1397195720 and 1397195724 LMissing descriptors for photos 1397195724 and 1397195727 LMissing descriptors for photos 1397195727 and 1397195731 LMissing descriptors for photos 1397195731 and 1397197159 LMissing descriptors for photos 1397197159 and 1397197160 LMissing descriptors for photos 1397197160 and 1397197161 LMissing descriptors for photos 1397197161 and 1397197162 LMissing descriptors for photos 1397197162 and 1397197168 LMissing descriptors for photos 1397197168 and 1397197177 LMissing descriptors for photos 1397197177 and 1397197260 LMissing descriptors for photos 1397197260 and 1397197267 LMissing descriptors for photos 1397197267 and 1397197280 LMissing descriptors for photos 1397197280 and 1397197287 LMissing descriptors for photos 1397197287 and 1397197294 LMissing descriptors for photos 1397197294 and 1397197297 LMissing descriptors for photos 1397197297 and 1397197446 LMissing descriptors for photos 1397197446 and 1397197460 LMissing descriptors for photos 1397197460 and 1397197464 LMissing descriptors for photos 1397197464 and 1397197465 LMissing descriptors for photos 1397197465 and 1397197466 LMissing descriptors for photos 1397197466 and 1397197467 LMissing descriptors for photos 1397197467 and 1397197560 LMissing descriptors for photos 1397197560 and 1397197563 LMissing descriptors for photos 1397197563 and 1397197568 LMissing descriptors for photos 1397197568 and 1397197572 LMissing descriptors for photos 1397197572 and 1397197581 LMissing descriptors for photos 1397197581 and 1397197595 LMissing descriptors for photos 1397197595 and 1397197741 LMissing descriptors for photos 1397197741 and 1397197744 LMissing descriptors for photos 1397197744 and 1397197748 LMissing descriptors for photos 1397197748 and 1397197753 LMissing descriptors for photos 1397197753 and 1397197757 LMissing descriptors for photos 1397197757 and 1397197760 LMissing descriptors for photos 1397197760 and 1397197796 LMissing descriptors for photos 1397197796 and 1397197799 LMissing descriptors for photos 1397197799 and 1397197803 LMissing descriptors for photos 1397197803 and 1397197807 LMissing descriptors for photos 1397197807 and 1397197809 LMissing descriptors for photos 1397197809 and 1397197811 LMissing descriptors for photos 1397197811 and 1397197874 LMissing descriptors for photos 1397197874 and 1397197877 LMissing descriptors for photos 1397197877 and 1397197880 LMissing descriptors for photos 1397197880 and 1397197884 LMissing descriptors for photos 1397197884 and 1397197888 LMissing descriptors for photos 1397197888 and 1397197890 LMissing descriptors for photos 1397197890 and 1397197976 LMissing descriptors for photos 1397197976 and 1397197986 LMissing descriptors for photos 1397197986 and 1397197996 LMissing descriptors for photos 1397197996 and 1397198005 LMissing descriptors for photos 1397198005 and 1397198018 LMissing descriptors for photos 1397198018 and 1397198036 LMissing descriptors for photos 1397198036 and 1397198460 LMissing descriptors for photos 1397198460 and 1397198461 LMissing descriptors for photos 1397198461 and 1397198464 LMissing descriptors for photos 1397198464 and 1397198465 LMissing descriptors for photos 1397198465 and 1397198468 LMissing descriptors for photos 1397198468 and 1397198470 LMissing descriptors for photos 1397198470 and 1397198510 LMissing descriptors for photos 1397198510 and 1397198511 LMissing descriptors for photos 1397198511 and 1397198512 LMissing descriptors for photos 1397198512 and 1397198513 LMissing descriptors for photos 1397198513 and 1397198518 LMissing descriptors for photos 1397198518 and 1397198527 LMissing descriptors for photos 1397198527 and 1397198720 LMissing descriptors for photos 1397198720 and 1397198723 LMissing descriptors for photos 1397198723 and 1397198726 LMissing descriptors for photos 1397198726 and 1397198732 LMissing descriptors for photos 1397198732 and 1397198741 LMissing descriptors for photos 1397198741 and 1397198749 LMissing descriptors for photos 1397198749 and 1397198832 LMissing descriptors for photos 1397198832 and 1397198834 LMissing descriptors for photos 1397198834 and 1397198838 LMissing descriptors for photos 1397198838 and 1397198849 LMissing descriptors for photos 1397198849 and 1397198853 LMissing descriptors for photos 1397198853 and 1397198857 LMissing descriptors for photos 1397198857 and 1397199042 LMissing descriptors for photos 1397199042 and 1397199043 LMissing descriptors for photos 1397199043 and 1397199045 LMissing descriptors for photos 1397199045 and 1397199047 LMissing descriptors for photos 1397199047 and 1397199049 LMissing descriptors for photos 1397199049 and 1397199051 LMissing descriptors for photos 1397199051 and 1397199090 LMissing descriptors for photos 1397199090 and 1397199091 LMissing descriptors for photos 1397199091 and 1397199092 LMissing descriptors for photos 1397199092 and 1397199093 LMissing descriptors for photos 1397199093 and 1397199094 LMissing descriptors for photos 1397199094 and 1397199095 LMissing descriptors for photos 1397199095 and 1397199121 LMissing descriptors for photos 1397199121 and 1397199132 LMissing descriptors for photos 1397199132 and 1397199137 LMissing descriptors for photos 1397199137 and 1397199140 LMissing descriptors for photos 1397199140 and 1397199144 LMissing descriptors for photos 1397199144 and 1397199146 LMissing descriptors for photos 1397199146 and 1397199166 LMissing descriptors for photos 1397199166 and 1397199167 LMissing descriptors for photos 1397199167 and 1397199168 LMissing descriptors for photos 1397199168 and 1397199169 LMissing descriptors for photos 1397199169 and 1397199170 LMissing descriptors for photos 1397199170 and 1397199171 LMissing descriptors for photos 1397199171 and 1397199182 LMissing descriptors for photos 1397199182 and 1397199185 LMissing descriptors for photos 1397199185 and 1397199196 LMissing descriptors for photos 1397199196 and 1397199208 LMissing descriptors for photos 1397199208 and 1397199220 LMissing descriptors for photos 1397199220 and 1397199231 LMissing descriptors for photos 1397199231 and 1397199256 LMissing descriptors for photos 1397199256 and 1397199258 LMissing descriptors for photos 1397199258 and 1397199260 LMissing descriptors for photos 1397199260 and 1397199262 LMissing descriptors for photos 1397199262 and 1397199264 LMissing descriptors for photos 1397199264 and 1397199266 LMissing descriptors for photos 1397199266 and 1397199277 LMissing descriptors for photos 1397199277 and 1397199279 LMissing descriptors for photos 1397199279 and 1397199282 LMissing descriptors for photos 1397199282 and 1397199284 LMissing descriptors for photos 1397199284 and 1397199286 LMissing descriptors for photos 1397199286 and 1397199287 LMissing descriptors for photos 1397199287 and 1397199326 LMissing descriptors for photos 1397199326 and 1397199327 LMissing descriptors for photos 1397199327 and 1397199328 LMissing descriptors for photos 1397199328 and 1397199329 LMissing descriptors for photos 1397199329 and 1397199330 LMissing descriptors for photos 1397199330 and 1397199331 LMissing descriptors for photos 1397199331 and 1397199496 LMissing descriptors for photos 1397199496 and 1397199499 LMissing descriptors for photos 1397199499 and 1397199502 LMissing descriptors for photos 1397199502 and 1397199505 LMissing descriptors for photos 1397199505 and 1397199506 LMissing descriptors for photos 1397199506 and 1397199514 LMissing descriptors for photos 1397199514 and 1397199552 L 14112025 Removing 47 photos because of the 'same image' condition Total on : 1980.1616669999999 list_time_on Total off : 540.921868 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 727 time used for this insertion : 1.4552197456359863 photos_removed : len 47 elapsed_time : remove_photo_duplicate 1.520484447479248 To do, maybe not at the correct place ! ..............L.L.L.L.L.L.L......L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L........................................L............................................L....L.................................................L..L..................L.L..............L......................L....L.L................................................................................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.026058673858642578 NUMBER BATCH : 8 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '14112025', 'map_nb_amount': {0: 7, 1: 45, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.9865398406982, 'nb_balles_papier': 0.0005200000000000007, 'begin_time_port': 'image_14112025_10_00_02_455310m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0005200000000000007 result_one_balle_Type_JRM:{'day': '14112025', 'map_nb_amount': {0: 9, 1: 76, 2: 0, 3: 2, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.2211549282074, 'nb_balles_papier': 0.0008800000000000017, 'begin_time_port': 'image_14112025_10_15_03_064578m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008800000000000017 result_one_balle_Type_JRM:{'day': '14112025', 'map_nb_amount': {0: 15, 1: 61, 2: 5, 3: 2, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.1854450702667, 'nb_balles_papier': 0.0008400000000000016, 'begin_time_port': 'image_14112025_10_30_03_038888m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008400000000000016 result_one_balle_Type_JRM:{'day': '14112025', 'map_nb_amount': {0: 8, 1: 83, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.9798769950867, 'nb_balles_papier': 0.0009300000000000018, 'begin_time_port': 'image_14112025_10_45_02_897241m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009300000000000018 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 2 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 4 list_same_port_ids : [28531431] find same portfolio which already exist 28531431 , we will use it list_same_port_ids : [28531893] find same portfolio which already exist 28531893 , we will use it list_same_port_ids : [28535129] find same portfolio which already exist 28535129 , we will use it list_same_port_ids : [29140166] find same portfolio which already exist 29140166 , we will use it Qualite : 0.11570683935010068 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28531431 AND mptpi.`type`=3726 To do Qualite : 0.16410115321347585 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28531893 AND mptpi.`type`=3726 To do Qualite : 0.13023118275233422 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28535129 AND mptpi.`type`=3726 To do Qualite : 0.13025265054494864 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29140166 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 0.8068103790283203 # DISPLAY ALL COLLECTED DATA : {'14112025': {'nb_upload': 727, 'nb_taggue_class': 600, 'nb_taggue_densite': 600, 'nb_descriptors': 366}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397199552, 1397199514, 1397199506, 1397199505, 1397199502, 1397199499, 1397199496, 1397199331, 1397199330, 1397199329, 1397199328, 1397199327, 1397199326, 1397199287, 1397199286, 1397199284, 1397199282, 1397199279, 1397199277, 1397199266, 1397199264, 1397199262, 1397199260, 1397199258, 1397199256, 1397199231, 1397199220, 1397199208, 1397199196, 1397199185, 1397199182, 1397199171, 1397199170, 1397199169, 1397199168, 1397199167, 1397199166, 1397199146, 1397199144, 1397199140, 1397199137, 1397199132, 1397199121, 1397199095, 1397199094, 1397199093, 1397199092, 1397199091, 1397199090, 1397199051, 1397199049, 1397199047, 1397199045, 1397199043, 1397199042, 1397198857, 1397198853, 1397198849, 1397198838, 1397198834, 1397198832, 1397198749, 1397198741, 1397198732, 1397198726, 1397198723, 1397198720, 1397198527, 1397198518, 1397198513, 1397198512, 1397198511, 1397198510, 1397198470, 1397198468, 1397198465, 1397198464, 1397198461, 1397198460, 1397198036, 1397198018, 1397198005, 1397197996, 1397197986, 1397197976, 1397197890, 1397197888, 1397197884, 1397197880, 1397197877, 1397197874, 1397197811, 1397197809, 1397197807, 1397197803, 1397197799, 1397197796, 1397197760, 1397197757, 1397197753] Looping around the photos to save general results len do output : 1 /28524663Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199552', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199514', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199506', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199505', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199502', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199499', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199496', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199331', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199330', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199329', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199328', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199327', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199326', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199287', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199286', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199284', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199282', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199279', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199277', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199266', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199264', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199262', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199260', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199258', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199256', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199231', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199220', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199208', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199196', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199185', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199182', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199171', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199170', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199169', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199168', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199167', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199166', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199146', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199144', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199140', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199137', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199132', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199121', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199095', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199094', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199093', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199092', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199091', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199090', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199051', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199049', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199047', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199045', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199043', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397199042', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198857', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198853', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198849', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198838', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198834', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198832', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198749', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198741', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198732', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198726', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198723', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198720', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198527', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198518', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198513', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198512', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198511', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198510', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198470', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198468', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198465', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198464', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198461', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198460', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198036', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198018', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397198005', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197996', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197986', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197976', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197890', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197888', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197884', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197880', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197877', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197874', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197811', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197809', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197807', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197803', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197799', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197796', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197760', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197757', None, None, None, None, None, '4348895') ('4189', None, None, None, None, None, None, None, '4348895') ('4189', '28524663', '1397197753', None, None, None, None, None, '4348895') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05532193183898926 save_final save missing photos in datou_result : time spend for datou_step_exec : 34.149468421936035 time spend to save output : 0.05611443519592285 total time spend for step 1 : 34.20558285713196 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.04user 0.67system 0:36.47elapsed 7%CPU (0avgtext+0avgdata 114408maxresident)k 0inputs+3088outputs (16major+53770minor)pagefaults 0swaps