python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1715763 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['4346383'] with mtr_portfolio_ids : ['28990151'] and first list_photo_ids : [] new path : /proc/1715763/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.09444737434387207 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Feb 19 01:10:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 371), ('14', 361)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 732} 28112025 28990151 Nombre de photos uploadées : 732 / 23040 (3%) 28112025 28990151 Nombre de photos taguées (types de déchets): 732 / 732 (100%) 28112025 28990151 Nombre de photos taguées (volume) : 732 / 732 (100%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 0.0003190040588378906 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.03416895866394043 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.2355201244354248 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.04874730110168457 Creating list_photo_total elapsed_time : select_descriptors 28.462419509887695 28112025 28990151 Nombre de photos avec descriptors (type 5680) : 333 / 333 (100%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1396588180 photo_id_prec : 0 0:00:00|ON:LL0:09:00.246065|OFF:0:00:00|ON:LL0:00:00|OFF:LLLL0:00:59.807178|ON:LL0:13:59.827893|OFF:0:00:00|ON:LL0:06:00.649299|OFF:0:00:00|ON:LL0:14:00.087215|OFF:0:00:00|ON:LMissing descriptors for photos 1396666609 and 1396666615 LMissing descriptors for photos 1396666615 and 1396666622 LMissing descriptors for photos 1396666622 and 1396666625 LMissing descriptors for photos 1396666625 and 1396666630 LMissing descriptors for photos 1396666630 and 1396666752 LMissing descriptors for photos 1396666752 and 1396666753 LMissing descriptors for photos 1396666753 and 1396671742 LMissing descriptors for photos 1396671742 and 1396671796 LMissing descriptors for photos 1396671796 and 1396671878 LMissing descriptors for photos 1396671878 and 1396671910 LMissing descriptors for photos 1396671910 and 1396671919 LMissing descriptors for photos 1396671919 and 1396671920 LMissing descriptors for photos 1396671920 and 1396673214 LMissing descriptors for photos 1396673214 and 1396673216 LMissing descriptors for photos 1396673216 and 1396673223 LMissing descriptors for photos 1396673223 and 1396673226 LMissing descriptors for photos 1396673226 and 1396673229 LMissing descriptors for photos 1396673229 and 1396673234 LMissing descriptors for photos 1396673234 and 1397166225 LMissing descriptors for photos 1397166225 and 1397166231 LLLMissing descriptors for photos 1397412813 and 1397412815 LMissing descriptors for photos 1397412815 and 1397412818 LMissing descriptors for photos 1397412818 and 1397412820 LMissing descriptors for photos 1397412820 and 1397412824 LLLMissing descriptors for photos 1397412899 and 1397412901 LLLMissing descriptors for photos 1397412922 and 1397412924 LMissing descriptors for photos 1397412924 and 1397412927 LMissing descriptors for photos 1397412927 and 1397412945 LMissing descriptors for photos 1397412945 and 1397413053 LMissing descriptors for photos 1397413053 and 1397413056 LMissing descriptors for photos 1397413056 and 1397413076 LLMissing descriptors for photos 1397413291 and 1397413301 LMissing descriptors for photos 1397413301 and 1397413304 LMissing descriptors for photos 1397413304 and 1397413309 LMissing descriptors for photos 1397413309 and 1397413314 LMissing descriptors for photos 1397413314 and 1397413316 LMissing descriptors for photos 1397413316 and 1397413319 LMissing descriptors for photos 1397413319 and 1397413385 LMissing descriptors for photos 1397413385 and 1397413387 LMissing descriptors for photos 1397413387 and 1397413390 LMissing descriptors for photos 1397413390 and 1397413391 LMissing descriptors for photos 1397413391 and 1397413392 LMissing descriptors for photos 1397413392 and 1397413393 LMissing descriptors for photos 1397413393 and 1397413427 LMissing descriptors for photos 1397413427 and 1397413455 LMissing descriptors for photos 1397413455 and 1397413522 LMissing descriptors for photos 1397413522 and 1397413523 LMissing descriptors for photos 1397413523 and 1397413545 LMissing descriptors for photos 1397413545 and 1397413579 LMissing descriptors for photos 1397413579 and 1397414132 LMissing descriptors for photos 1397414132 and 1397414134 LMissing descriptors for photos 1397414134 and 1397414138 LMissing descriptors for photos 1397414138 and 1397414139 LMissing descriptors for photos 1397414139 and 1397414141 LMissing descriptors for photos 1397414141 and 1397414142 LMissing descriptors for photos 1397414142 and 1397414193 LMissing descriptors for photos 1397414193 and 1397414214 LMissing descriptors for photos 1397414214 and 1397414263 LMissing descriptors for photos 1397414263 and 1397414312 LMissing descriptors for photos 1397414312 and 1397414362 LMissing descriptors for photos 1397414362 and 1397414410 LMissing descriptors for photos 1397414410 and 1397414985 LMissing descriptors for photos 1397414985 and 1397415089 LMissing descriptors for photos 1397415089 and 1397415206 LMissing descriptors for photos 1397415206 and 1397415263 LMissing descriptors for photos 1397415263 and 1397415269 LMissing descriptors for photos 1397415269 and 1397415273 LMissing descriptors for photos 1397415273 and 1397415322 LMissing descriptors for photos 1397415322 and 1397415350 LMissing descriptors for photos 1397415350 and 1397415447 LMissing descriptors for photos 1397415447 and 1397415534 LMissing descriptors for photos 1397415534 and 1397415623 LMissing descriptors for photos 1397415623 and 1397415711 LMissing descriptors for photos 1397415711 and 1397416041 LMissing descriptors for photos 1397416041 and 1397416111 LMissing descriptors for photos 1397416111 and 1397416194 LMissing descriptors for photos 1397416194 and 1397416265 LMissing descriptors for photos 1397416265 and 1397416332 LMissing descriptors for photos 1397416332 and 1397416395 LMissing descriptors for photos 1397416395 and 1397416722 LMissing descriptors for photos 1397416722 and 1397416782 LMissing descriptors for photos 1397416782 and 1397416835 LMissing descriptors for photos 1397416835 and 1397416888 LMissing descriptors for photos 1397416888 and 1397416929 LMissing descriptors for photos 1397416929 and 1397416939 LMissing descriptors for photos 1397416939 and 1397416952 LMissing descriptors for photos 1397416952 and 1397416968 LMissing descriptors for photos 1397416968 and 1397417015 LMissing descriptors for photos 1397417015 and 1397417064 LMissing descriptors for photos 1397417064 and 1397417178 LMissing descriptors for photos 1397417178 and 1397417374 LMissing descriptors for photos 1397417374 and 1397417693 LMissing descriptors for photos 1397417693 and 1397417711 LMissing descriptors for photos 1397417711 and 1397417744 LMissing descriptors for photos 1397417744 and 1397417812 LMissing descriptors for photos 1397417812 and 1397417828 LMissing descriptors for photos 1397417828 and 1397417831 LMissing descriptors for photos 1397417831 and 1397418033 LMissing descriptors for photos 1397418033 and 1397418078 LMissing descriptors for photos 1397418078 and 1397418126 LMissing descriptors for photos 1397418126 and 1397418177 LMissing descriptors for photos 1397418177 and 1397418223 LMissing descriptors for photos 1397418223 and 1397418268 LMissing descriptors for photos 1397418268 and 1397418544 LMissing descriptors for photos 1397418544 and 1397418594 LMissing descriptors for photos 1397418594 and 1397418664 LMissing descriptors for photos 1397418664 and 1397418710 LMissing descriptors for photos 1397418710 and 1397418757 LMissing descriptors for photos 1397418757 and 1397418832 LMissing descriptors for photos 1397418832 and 1397419558 LMissing descriptors for photos 1397419558 and 1397419636 LMissing descriptors for photos 1397419636 and 1397419687 LMissing descriptors for photos 1397419687 and 1397419741 LMissing descriptors for photos 1397419741 and 1397419800 LMissing descriptors for photos 1397419800 and 1397419864 LMissing descriptors for photos 1397419864 and 1397420403 LMissing descriptors for photos 1397420403 and 1397420472 LMissing descriptors for photos 1397420472 and 1397420597 LMissing descriptors for photos 1397420597 and 1397420658 LMissing descriptors for photos 1397420658 and 1397420745 LMissing descriptors for photos 1397420745 and 1397420826 LMissing descriptors for photos 1397420826 and 1397421042 LMissing descriptors for photos 1397421042 and 1397421045 LMissing descriptors for photos 1397421045 and 1397421055 LMissing descriptors for photos 1397421055 and 1397421106 LMissing descriptors for photos 1397421106 and 1397421185 LMissing descriptors for photos 1397421185 and 1397421211 LMissing descriptors for photos 1397421211 and 1397421690 LMissing descriptors for photos 1397421690 and 1397421746 LMissing descriptors for photos 1397421746 and 1397421806 LMissing descriptors for photos 1397421806 and 1397421821 LMissing descriptors for photos 1397421821 and 1397421860 LMissing descriptors for photos 1397421860 and 1397421906 LMissing descriptors for photos 1397421906 and 1397422133 LMissing descriptors for photos 1397422133 and 1397422155 LMissing descriptors for photos 1397422155 and 1397422162 LMissing descriptors for photos 1397422162 and 1397422193 LMissing descriptors for photos 1397422193 and 1397422198 LMissing descriptors for photos 1397422198 and 1397422247 LMissing descriptors for photos 1397422247 and 1397422447 LMissing descriptors for photos 1397422447 and 1397422448 LMissing descriptors for photos 1397422448 and 1397422450 LMissing descriptors for photos 1397422450 and 1397422455 LMissing descriptors for photos 1397422455 and 1397422459 LMissing descriptors for photos 1397422459 and 1397422467 LMissing descriptors for photos 1397422467 and 1397422480 LMissing descriptors for photos 1397422480 and 1397422521 LMissing descriptors for photos 1397422521 and 1397422569 LMissing descriptors for photos 1397422569 and 1397422618 LMissing descriptors for photos 1397422618 and 1397422667 LMissing descriptors for photos 1397422667 and 1397422714 LMissing descriptors for photos 1397422714 and 1397422845 LMissing descriptors for photos 1397422845 and 1397422855 LMissing descriptors for photos 1397422855 and 1397422892 LMissing descriptors for photos 1397422892 and 1397422939 LMissing descriptors for photos 1397422939 and 1397422995 LMissing descriptors for photos 1397422995 and 1397423071 LMissing descriptors for photos 1397423071 and 1397423243 LMissing descriptors for photos 1397423243 and 1397423256 LMissing descriptors for photos 1397423256 and 1397423259 LMissing descriptors for photos 1397423259 and 1397423279 LMissing descriptors for photos 1397423279 and 1397423280 LMissing descriptors for photos 1397423280 and 1397423281 LMissing descriptors for photos 1397423281 and 1397423290 LMissing descriptors for photos 1397423290 and 1397423301 LMissing descriptors for photos 1397423301 and 1397423313 LMissing descriptors for photos 1397423313 and 1397423322 LMissing descriptors for photos 1397423322 and 1397423346 LMissing descriptors for photos 1397423346 and 1397423400 LMissing descriptors for photos 1397423400 and 1397423464 LMissing descriptors for photos 1397423464 and 1397423465 LMissing descriptors for photos 1397423465 and 1397423466 LMissing descriptors for photos 1397423466 and 1397423467 LMissing descriptors for photos 1397423467 and 1397423469 LMissing descriptors for photos 1397423469 and 1397423471 LMissing descriptors for photos 1397423471 and 1397423491 LMissing descriptors for photos 1397423491 and 1397423497 LMissing descriptors for photos 1397423497 and 1397423507 LMissing descriptors for photos 1397423507 and 1397423508 LMissing descriptors for photos 1397423508 and 1397423511 LMissing descriptors for photos 1397423511 and 1397423513 LMissing descriptors for photos 1397423513 and 1397423520 LMissing descriptors for photos 1397423520 and 1397423521 LMissing descriptors for photos 1397423521 and 1397423523 LMissing descriptors for photos 1397423523 and 1397423525 LMissing descriptors for photos 1397423525 and 1397423532 LMissing descriptors for photos 1397423532 and 1397423538 LMissing descriptors for photos 1397423538 and 1397423689 LMissing descriptors for photos 1397423689 and 1397423704 LMissing descriptors for photos 1397423704 and 1397423731 LMissing descriptors for photos 1397423731 and 1397423746 LMissing descriptors for photos 1397423746 and 1397423754 LMissing descriptors for photos 1397423754 and 1397423804 LMissing descriptors for photos 1397423804 and 1397423978 LMissing descriptors for photos 1397423978 and 1397424006 LMissing descriptors for photos 1397424006 and 1397424050 LMissing descriptors for photos 1397424050 and 1397424056 LMissing descriptors for photos 1397424056 and 1397424070 LMissing descriptors for photos 1397424070 and 1397424074 LMissing descriptors for photos 1397424074 and 1397424159 LMissing descriptors for photos 1397424159 and 1397595641 LMissing descriptors for photos 1397595641 and 1397424160 LMissing descriptors for photos 1397424160 and 1397424181 LMissing descriptors for photos 1397424181 and 1397424184 LMissing descriptors for photos 1397424184 and 1397424188 LMissing descriptors for photos 1397424188 and 1397424191 LMissing descriptors for photos 1397424191 and 1397595644 LMissing descriptors for photos 1397595644 and 1397595647 LMissing descriptors for photos 1397595647 and 1397595650 LMissing descriptors for photos 1397595650 and 1397595651 LMissing descriptors for photos 1397595651 and 1397595663 LMissing descriptors for photos 1397595663 and 1397595676 LMissing descriptors for photos 1397595676 and 1397595680 LMissing descriptors for photos 1397595680 and 1397595682 LMissing descriptors for photos 1397595682 and 1397595685 LMissing descriptors for photos 1397595685 and 1397595686 LMissing descriptors for photos 1397595686 and 1397595687 LMissing descriptors for photos 1397595687 and 1397595726 LMissing descriptors for photos 1397595726 and 1397595738 LMissing descriptors for photos 1397595738 and 1397595739 LMissing descriptors for photos 1397595739 and 1397595746 LMissing descriptors for photos 1397595746 and 1397595752 LMissing descriptors for photos 1397595752 and 1397595754 LMissing descriptors for photos 1397595754 and 1397595764 LMissing descriptors for photos 1397595764 and 1397595765 LMissing descriptors for photos 1397595765 and 1397595767 LMissing descriptors for photos 1397595767 and 1397595770 LMissing descriptors for photos 1397595770 and 1397595772 LMissing descriptors for photos 1397595772 and 1397595786 LMissing descriptors for photos 1397595786 and 1397595795 LMissing descriptors for photos 1397595795 and 1397595811 LMissing descriptors for photos 1397595811 and 1397595813 LMissing descriptors for photos 1397595813 and 1397595817 LMissing descriptors for photos 1397595817 and 1397595822 LMissing descriptors for photos 1397595822 and 1397595826 LMissing descriptors for photos 1397595826 and 1397595845 LMissing descriptors for photos 1397595845 and 1397595848 LMissing descriptors for photos 1397595848 and 1397595855 LMissing descriptors for photos 1397595855 and 1397595868 LMissing descriptors for photos 1397595868 and 1397595872 LMissing descriptors for photos 1397595872 and 1397595877 LMissing descriptors for photos 1397595877 and 1397595909 LMissing descriptors for photos 1397595909 and 1397595912 LMissing descriptors for photos 1397595912 and 1397595926 LMissing descriptors for photos 1397595926 and 1397595940 LMissing descriptors for photos 1397595940 and 1397595947 LMissing descriptors for photos 1397595947 and 1397596030 LMissing descriptors for photos 1397596030 and 1397596040 LMissing descriptors for photos 1397596040 and 1397596043 LMissing descriptors for photos 1397596043 and 1397596058 LMissing descriptors for photos 1397596058 and 1397596104 LMissing descriptors for photos 1397596104 and 1397596160 LMissing descriptors for photos 1397596160 and 1397596207 LMissing descriptors for photos 1397596207 and 1397596433 LMissing descriptors for photos 1397596433 and 1397596481 LMissing descriptors for photos 1397596481 and 1397596513 LMissing descriptors for photos 1397596513 and 1397596538 LMissing descriptors for photos 1397596538 and 1397596541 LMissing descriptors for photos 1397596541 and 1397596543 LMissing descriptors for photos 1397596543 and 1397596680 LMissing descriptors for photos 1397596680 and 1397596683 LMissing descriptors for photos 1397596683 and 1397596685 LMissing descriptors for photos 1397596685 and 1397596733 LMissing descriptors for photos 1397596733 and 1397596738 LMissing descriptors for photos 1397596738 and 1397596746 LMissing descriptors for photos 1397596746 and 1397596894 LMissing descriptors for photos 1397596894 and 1397596896 LMissing descriptors for photos 1397596896 and 1397596947 LMissing descriptors for photos 1397596947 and 1397596950 LMissing descriptors for photos 1397596950 and 1397596961 LMissing descriptors for photos 1397596961 and 1397597022 LMissing descriptors for photos 1397597022 and 1397597104 LMissing descriptors for photos 1397597104 and 1397597147 LMissing descriptors for photos 1397597147 and 1397597170 LMissing descriptors for photos 1397597170 and 1397597175 LMissing descriptors for photos 1397597175 and 1397597178 LMissing descriptors for photos 1397597178 and 1397597179 LMissing descriptors for photos 1397597179 and 1397597200 LMissing descriptors for photos 1397597200 and 1397597210 LMissing descriptors for photos 1397597210 and 1397597212 LMissing descriptors for photos 1397597212 and 1397597324 LMissing descriptors for photos 1397597324 and 1397597458 LMissing descriptors for photos 1397597458 and 1397597471 LMissing descriptors for photos 1397597471 and 1397597763 LMissing descriptors for photos 1397597763 and 1397597770 LMissing descriptors for photos 1397597770 and 1397597773 LMissing descriptors for photos 1397597773 and 1397597776 LMissing descriptors for photos 1397597776 and 1397597780 LMissing descriptors for photos 1397597780 and 1397597782 LMissing descriptors for photos 1397597782 and 1397597802 LMissing descriptors for photos 1397597802 and 1397597807 LMissing descriptors for photos 1397597807 and 1397597810 LMissing descriptors for photos 1397597810 and 1397597812 LMissing descriptors for photos 1397597812 and 1397597813 LMissing descriptors for photos 1397597813 and 1397597814 LMissing descriptors for photos 1397597814 and 1397597820 LMissing descriptors for photos 1397597820 and 1397597825 LMissing descriptors for photos 1397597825 and 1397597827 LMissing descriptors for photos 1397597827 and 1397597839 LMissing descriptors for photos 1397597839 and 1397597841 LMissing descriptors for photos 1397597841 and 1397597842 LMissing descriptors for photos 1397597842 and 1397597885 LMissing descriptors for photos 1397597885 and 1397597902 LMissing descriptors for photos 1397597902 and 1397597903 LMissing descriptors for photos 1397597903 and 1397597904 LMissing descriptors for photos 1397597904 and 1397597914 LMissing descriptors for photos 1397597914 and 1397597922 LMissing descriptors for photos 1397597922 and 1397598033 LMissing descriptors for photos 1397598033 and 1397598062 LMissing descriptors for photos 1397598062 and 1397598068 LMissing descriptors for photos 1397598068 and 1397598071 LMissing descriptors for photos 1397598071 and 1397598074 LMissing descriptors for photos 1397598074 and 1397598090 LMissing descriptors for photos 1397598090 and 1397598148 LMissing descriptors for photos 1397598148 and 1397598149 LMissing descriptors for photos 1397598149 and 1397598161 LMissing descriptors for photos 1397598161 and 1397598163 LMissing descriptors for photos 1397598163 and 1397598166 LMissing descriptors for photos 1397598166 and 1397598178 LMissing descriptors for photos 1397598178 and 1397598194 LMissing descriptors for photos 1397598194 and 1397598222 LMissing descriptors for photos 1397598222 and 1397598225 LMissing descriptors for photos 1397598225 and 1397598227 LMissing descriptors for photos 1397598227 and 1397598229 LMissing descriptors for photos 1397598229 and 1397598230 LMissing descriptors for photos 1397598230 and 1397598237 LMissing descriptors for photos 1397598237 and 1397598239 LMissing descriptors for photos 1397598239 and 1397598255 LMissing descriptors for photos 1397598255 and 1397598264 LMissing descriptors for photos 1397598264 and 1397598265 LMissing descriptors for photos 1397598265 and 1397598266 LMissing descriptors for photos 1397598266 and 1397598276 LMissing descriptors for photos 1397598276 and 1397598278 LMissing descriptors for photos 1397598278 and 1397598281 LMissing descriptors for photos 1397598281 and 1397598282 LMissing descriptors for photos 1397598282 and 1397598307 LMissing descriptors for photos 1397598307 and 1397598314 LMissing descriptors for photos 1397598314 and 1397598332 LMissing descriptors for photos 1397598332 and 1397598334 LMissing descriptors for photos 1397598334 and 1397598344 LMissing descriptors for photos 1397598344 and 1397598347 LMissing descriptors for photos 1397598347 and 1397598349 LMissing descriptors for photos 1397598349 and 1397598352 LMissing descriptors for photos 1397598352 and 1397598368 LMissing descriptors for photos 1397598368 and 1397598369 LMissing descriptors for photos 1397598369 and 1397598371 LMissing descriptors for photos 1397598371 and 1397598373 LMissing descriptors for photos 1397598373 and 1397598376 LMissing descriptors for photos 1397598376 and 1397598379 LMissing descriptors for photos 1397598379 and 1397598441 LMissing descriptors for photos 1397598441 and 1397598449 LMissing descriptors for photos 1397598449 and 1397598471 LMissing descriptors for photos 1397598471 and 1397598473 LMissing descriptors for photos 1397598473 and 1397598475 LMissing descriptors for photos 1397598475 and 1397598477 LMissing descriptors for photos 1397598477 and 1397598484 LMissing descriptors for photos 1397598484 and 1397598487 LMissing descriptors for photos 1397598487 and 1397598490 LMissing descriptors for photos 1397598490 and 1397598493 LMissing descriptors for photos 1397598493 and 1397598497 LMissing descriptors for photos 1397598497 and 1397598501 LMissing descriptors for photos 1397598501 and 1397598574 LMissing descriptors for photos 1397598574 and 1397598577 LMissing descriptors for photos 1397598577 and 1397598580 LMissing descriptors for photos 1397598580 and 1397598582 LMissing descriptors for photos 1397598582 and 1397598585 LMissing descriptors for photos 1397598585 and 1397598587 LMissing descriptors for photos 1397598587 and 1397598594 LMissing descriptors for photos 1397598594 and 1397598596 LMissing descriptors for photos 1397598596 and 1397598607 LMissing descriptors for photos 1397598607 and 1397598609 LMissing descriptors for photos 1397598609 and 1397598611 LMissing descriptors for photos 1397598611 and 1397598612 LMissing descriptors for photos 1397598612 and 1397598625 LMissing descriptors for photos 1397598625 and 1397598627 LMissing descriptors for photos 1397598627 and 1397598630 LMissing descriptors for photos 1397598630 and 1397598632 LMissing descriptors for photos 1397598632 and 1397598644 LMissing descriptors for photos 1397598644 and 1397598645 LMissing descriptors for photos 1397598645 and 1397598655 LMissing descriptors for photos 1397598655 and 1397598657 LMissing descriptors for photos 1397598657 and 1397598660 LMissing descriptors for photos 1397598660 and 1397598667 LMissing descriptors for photos 1397598667 and 1397598677 LMissing descriptors for photos 1397598677 and 1397598678 LMissing descriptors for photos 1397598678 and 1397598685 LMissing descriptors for photos 1397598685 and 1397598687 LMissing descriptors for photos 1397598687 and 1397598690 LMissing descriptors for photos 1397598690 and 1397598692 LMissing descriptors for photos 1397598692 and 1397598694 LMissing descriptors for photos 1397598694 and 1397598695 L 28112025 Removing 7 photos because of the 'same image' condition Total on : 2580.810472 list_time_on Total off : 59.807178 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 732 time used for this insertion : 0.21686148643493652 photos_removed : len 7 elapsed_time : remove_photo_duplicate 0.276080846786499 To do, maybe not at the correct place ! ...........................................................L..L.L.L......................................................................................L......................................L.........................................................................................L..............................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.........L..L.L.L.L.L....L....L.L..L.....L.L.L.L.L.L.L.........L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.02533578872680664 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] result_one_balle_Type_JRM:{'day': '28112025', 'map_nb_amount': {0: 22, 1: 64, 2: 2, 3: 1, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.9041609764099, 'nb_balles_papier': 0.0008900000000000017, 'begin_time_port': 'image_28112025_10_00_02_551614m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0008900000000000017 result_one_balle_Type_JRM:{'day': '28112025', 'map_nb_amount': {0: 15, 1: 70, 2: 5, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.2898890972137, 'nb_balles_papier': 0.0009000000000000017, 'begin_time_port': 'image_28112025_10_15_03_097714m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009000000000000017 result_one_balle_Type_JRM:{'day': '28112025', 'map_nb_amount': {0: 14, 1: 72, 2: 5, 3: 3, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 840.0872151851654, 'nb_balles_papier': 0.0009400000000000018, 'begin_time_port': 'image_28112025_10_30_03_082049m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0009400000000000018 result_one_balle_Type_JRM:{'day': '28112025', 'map_nb_amount': {0: 7, 1: 46, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.4687080383301, 'nb_balles_papier': 0.0005300000000000007, 'begin_time_port': 'image_28112025_10_45_02_896960m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0005300000000000007 We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 4 list_same_port_ids : [29005253] find same portfolio which already exist 29005253 , we will use it list_same_port_ids : [29005255] find same portfolio which already exist 29005255 , we will use it list_same_port_ids : [29005256] find same portfolio which already exist 29005256 , we will use it list_same_port_ids : [29136826] find same portfolio which already exist 29136826 , we will use it Qualite : 0.122207251818148 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29005253 AND mptpi.`type`=3726 To do Qualite : 0.15074236735019456 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29005255 AND mptpi.`type`=3726 To do Qualite : 0.11191633083992314 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29005256 AND mptpi.`type`=3726 To do Qualite : 0.12982706972471564 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29136826 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 0.6865012645721436 # DISPLAY ALL COLLECTED DATA : {'28112025': {'nb_upload': 732, 'nb_taggue_class': 732, 'nb_taggue_densite': 732, 'nb_descriptors': 333}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1397598695, 1397598694, 1397598692, 1397598690, 1397598687, 1397598685, 1397598678, 1397598677, 1397598667, 1397598660, 1397598657, 1397598655, 1397598645, 1397598644, 1397598632, 1397598630, 1397598627, 1397598625, 1397598612, 1397598611, 1397598609, 1397598607, 1397598596, 1397598594, 1397598587, 1397598585, 1397598582, 1397598580, 1397598577, 1397598574, 1397598501, 1397598497, 1397598493, 1397598490, 1397598487, 1397598484, 1397598477, 1397598475, 1397598473, 1397598471, 1397598449, 1397598441, 1397598379, 1397598376, 1397598373, 1397598371, 1397598369, 1397598368, 1397598352, 1397598349, 1397598347, 1397598344, 1397598334, 1397598332, 1397598314, 1397598307, 1397598282, 1397598281, 1397598278, 1397598276, 1397598266, 1397598265, 1397598264, 1397598255, 1397598239, 1397598237, 1397598230, 1397598229, 1397598227, 1397598225, 1397598222, 1397598194, 1397598178, 1397598166, 1397598163, 1397598161, 1397598149, 1397598148, 1397598090, 1397598074, 1397598071, 1397598068, 1397598062, 1397598033, 1397597922, 1397597914, 1397597904, 1397597903, 1397597902, 1397597885, 1397597842, 1397597841, 1397597839, 1397597827, 1397597825, 1397597820, 1397597814, 1397597813, 1397597812, 1397597810] Looping around the photos to save general results len do output : 1 /28990151Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598695', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598694', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598692', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598690', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598687', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598685', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598678', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598677', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598667', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598660', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598657', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598655', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598645', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598644', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598632', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598630', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598627', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598625', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598612', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598611', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598609', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598607', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598596', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598594', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598587', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598585', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598582', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598580', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598577', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598574', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598501', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598497', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598493', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598490', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598487', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598484', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598477', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598475', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598473', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598471', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598449', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598441', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598379', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598376', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598373', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598371', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598369', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598368', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598352', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598349', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598347', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598344', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598334', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598332', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598314', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598307', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598282', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598281', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598278', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598276', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598266', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598265', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598264', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598255', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598239', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598237', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598230', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598229', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598227', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598225', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598222', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598194', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598178', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598166', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598163', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598161', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598149', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598148', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598090', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598074', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598071', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598068', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598062', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397598033', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597922', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597914', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597904', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597903', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597902', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597885', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597842', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597841', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597839', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597827', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597825', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597820', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597814', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597813', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597812', None, None, None, None, None, '4346383') ('4189', None, None, None, None, None, None, None, '4346383') ('4189', '28990151', '1397597810', None, None, None, None, None, '4346383') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05814099311828613 save_final save missing photos in datou_result : time spend for datou_step_exec : 30.186870336532593 time spend to save output : 0.05907034873962402 total time spend for step 1 : 30.245940685272217 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.11user 0.64system 0:32.53elapsed 8%CPU (0avgtext+0avgdata 115248maxresident)k 0inputs+2816outputs (2major+53808minor)pagefaults 0swaps