python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3908925 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4189, datou_cur_ids : ['3300030'] with mtr_portfolio_ids : ['24998150'] and first list_photo_ids : [] new path : /proc/3908925/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.02958059310913086 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Jul 17 08:30:30 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 313),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 47} 16072025 24998150 Nombre de photos uploadées : 313 / 23040 (1%) 16072025 24998150 Nombre de photos taguées (types de déchets): 47 / 313 (15%) 16072025 24998150 Nombre de photos taguées (volume) : 47 / 313 (15%) elapsed_time : load_data_split_time_score 3.0994415283203125e-06 elapsed_time : order_list_meta_photo_and_scores 3.62396240234375e-05 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????? elapsed_time : fill_and_build_computed_from_old_data 0.021143436431884766 elapsed_time : insert_dashboard_record_day_entry 0.02296590805053711 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None Hashtag is None elapsed_time : list_photo_by_hashtags 0.027948856353759766 Creating list_photo_total elapsed_time : select_descriptors 4.229134798049927 16072025 24998150 Nombre de photos avec descriptors (type 5680) : 47 / 313 (15%) ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1372302641 photo_id_prec : 0 0:00:00|ON:LLLLLLLLLLLLLLLLLLLLLLLLL0:04:01.452511|OFF:LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1372307564 photo_id_prec : 1372305995 L0:02:58.129506|ON:Missing descriptors for photos 1372307564 and 1372307576 LMissing descriptors for photos 1372307576 and 1372307582 LMissing descriptors for photos 1372307582 and 1372307608 LMissing descriptors for photos 1372307608 and 1372307653 LMissing descriptors for photos 1372307653 and 1372307666 LMissing descriptors for photos 1372307666 and 1372308091 LMissing descriptors for photos 1372308091 and 1372308102 LMissing descriptors for photos 1372308102 and 1372308111 LMissing descriptors for photos 1372308111 and 1372308121 LMissing descriptors for photos 1372308121 and 1372308129 LMissing descriptors for photos 1372308129 and 1372308135 LMissing descriptors for photos 1372308135 and 1372308725 LMissing descriptors for photos 1372308725 and 1372308739 LMissing descriptors for photos 1372308739 and 1372308745 LMissing descriptors for photos 1372308745 and 1372308752 LMissing descriptors for photos 1372308752 and 1372308759 LMissing descriptors for photos 1372308759 and 1372308764 LMissing descriptors for photos 1372308764 and 1372309947 LMissing descriptors for photos 1372309947 and 1372309961 LMissing descriptors for photos 1372309961 and 1372309968 LMissing descriptors for photos 1372309968 and 1372309972 LMissing descriptors for photos 1372309972 and 1372309982 LMissing descriptors for photos 1372309982 and 1372309987 LMissing descriptors for photos 1372309987 and 1372310588 LMissing descriptors for photos 1372310588 and 1372310597 LMissing descriptors for photos 1372310597 and 1372310612 LMissing descriptors for photos 1372310612 and 1372310619 LMissing descriptors for photos 1372310619 and 1372310622 LMissing descriptors for photos 1372310622 and 1372310625 LMissing descriptors for photos 1372310625 and 1372310937 LMissing descriptors for photos 1372310937 and 1372310950 LMissing descriptors for photos 1372310950 and 1372310959 LMissing descriptors for photos 1372310959 and 1372310968 LMissing descriptors for photos 1372310968 and 1372310977 LMissing descriptors for photos 1372310977 and 1372310984 LMissing descriptors for photos 1372310984 and 1372311283 LMissing descriptors for photos 1372311283 and 1372311291 LMissing descriptors for photos 1372311291 and 1372311305 LMissing descriptors for photos 1372311305 and 1372311314 LMissing descriptors for photos 1372311314 and 1372311326 LMissing descriptors for photos 1372311326 and 1372311332 LMissing descriptors for photos 1372311332 and 1372311566 LMissing descriptors for photos 1372311566 and 1372311567 LMissing descriptors for photos 1372311567 and 1372311582 LMissing descriptors for photos 1372311582 and 1372311591 LMissing descriptors for photos 1372311591 and 1372311859 LMissing descriptors for photos 1372311859 and 1372311873 LMissing descriptors for photos 1372311873 and 1372311880 LMissing descriptors for photos 1372311880 and 1372311888 LMissing descriptors for photos 1372311888 and 1372311895 LMissing descriptors for photos 1372311895 and 1372311897 LMissing descriptors for photos 1372311897 and 1372312220 LMissing descriptors for photos 1372312220 and 1372312233 LMissing descriptors for photos 1372312233 and 1372312243 LMissing descriptors for photos 1372312243 and 1372312250 LMissing descriptors for photos 1372312250 and 1372312258 LMissing descriptors for photos 1372312258 and 1372312264 LMissing descriptors for photos 1372312264 and 1372312561 LMissing descriptors for photos 1372312561 and 1372312574 LMissing descriptors for photos 1372312574 and 1372312581 LMissing descriptors for photos 1372312581 and 1372312592 LMissing descriptors for photos 1372312592 and 1372312597 LMissing descriptors for photos 1372312597 and 1372312603 LMissing descriptors for photos 1372312603 and 1372312896 LMissing descriptors for photos 1372312896 and 1372312905 LMissing descriptors for photos 1372312905 and 1372312909 LMissing descriptors for photos 1372312909 and 1372312918 LMissing descriptors for photos 1372312918 and 1372312920 LMissing descriptors for photos 1372312920 and 1372312933 LMissing descriptors for photos 1372312933 and 1372313205 LMissing descriptors for photos 1372313205 and 1372313213 LMissing descriptors for photos 1372313213 and 1372313219 LMissing descriptors for photos 1372313219 and 1372313227 LMissing descriptors for photos 1372313227 and 1372313230 LMissing descriptors for photos 1372313230 and 1372313239 LMissing descriptors for photos 1372313239 and 1372313479 LMissing descriptors for photos 1372313479 and 1372313485 LMissing descriptors for photos 1372313485 and 1372313492 LMissing descriptors for photos 1372313492 and 1372313498 LMissing descriptors for photos 1372313498 and 1372313504 LMissing descriptors for photos 1372313504 and 1372313508 LMissing descriptors for photos 1372313508 and 1372313739 LMissing descriptors for photos 1372313739 and 1372313747 LMissing descriptors for photos 1372313747 and 1372313753 LMissing descriptors for photos 1372313753 and 1372313761 LMissing descriptors for photos 1372313761 and 1372313770 LMissing descriptors for photos 1372313770 and 1372313778 LMissing descriptors for photos 1372313778 and 1372314019 LMissing descriptors for photos 1372314019 and 1372314026 LMissing descriptors for photos 1372314026 and 1372314031 LMissing descriptors for photos 1372314031 and 1372314036 LMissing descriptors for photos 1372314036 and 1372314042 LMissing descriptors for photos 1372314042 and 1372314048 LMissing descriptors for photos 1372314048 and 1372314250 LMissing descriptors for photos 1372314250 and 1372314252 LMissing descriptors for photos 1372314252 and 1372314260 LMissing descriptors for photos 1372314260 and 1372314268 LMissing descriptors for photos 1372314268 and 1372314274 LMissing descriptors for photos 1372314274 and 1372314454 LMissing descriptors for photos 1372314454 and 1372314462 LMissing descriptors for photos 1372314462 and 1372314469 LMissing descriptors for photos 1372314469 and 1372314474 LMissing descriptors for photos 1372314474 and 1372314479 LMissing descriptors for photos 1372314479 and 1372314485 LMissing descriptors for photos 1372314485 and 1372314911 LMissing descriptors for photos 1372314911 and 1372314916 LMissing descriptors for photos 1372314916 and 1372314923 LMissing descriptors for photos 1372314923 and 1372314929 LMissing descriptors for photos 1372314929 and 1372314936 LMissing descriptors for photos 1372314936 and 1372314941 LMissing descriptors for photos 1372314941 and 1372315168 LMissing descriptors for photos 1372315168 and 1372315175 LMissing descriptors for photos 1372315175 and 1372315183 LMissing descriptors for photos 1372315183 and 1372315188 LMissing descriptors for photos 1372315188 and 1372315193 LMissing descriptors for photos 1372315193 and 1372315200 LMissing descriptors for photos 1372315200 and 1372315430 LMissing descriptors for photos 1372315430 and 1372315436 LMissing descriptors for photos 1372315436 and 1372315441 LMissing descriptors for photos 1372315441 and 1372315448 LMissing descriptors for photos 1372315448 and 1372315453 LMissing descriptors for photos 1372315453 and 1372315459 LMissing descriptors for photos 1372315459 and 1372315672 LMissing descriptors for photos 1372315672 and 1372315677 LMissing descriptors for photos 1372315677 and 1372315683 LMissing descriptors for photos 1372315683 and 1372315689 LMissing descriptors for photos 1372315689 and 1372315696 LMissing descriptors for photos 1372315696 and 1372315705 LMissing descriptors for photos 1372315705 and 1372315927 LMissing descriptors for photos 1372315927 and 1372315933 LMissing descriptors for photos 1372315933 and 1372315940 LMissing descriptors for photos 1372315940 and 1372315942 LMissing descriptors for photos 1372315942 and 1372315947 LMissing descriptors for photos 1372315947 and 1372315954 LMissing descriptors for photos 1372315954 and 1372316191 LMissing descriptors for photos 1372316191 and 1372316200 LMissing descriptors for photos 1372316200 and 1372316203 LMissing descriptors for photos 1372316203 and 1372316210 LMissing descriptors for photos 1372316210 and 1372316214 LMissing descriptors for photos 1372316214 and 1372316219 LMissing descriptors for photos 1372316219 and 1372316441 LMissing descriptors for photos 1372316441 and 1372316447 LMissing descriptors for photos 1372316447 and 1372316454 LMissing descriptors for photos 1372316454 and 1372316462 LMissing descriptors for photos 1372316462 and 1372316469 LMissing descriptors for photos 1372316469 and 1372316478 LMissing descriptors for photos 1372316478 and 1372316715 LMissing descriptors for photos 1372316715 and 1372316719 LMissing descriptors for photos 1372316719 and 1372316726 LMissing descriptors for photos 1372316726 and 1372316731 LMissing descriptors for photos 1372316731 and 1372316737 LMissing descriptors for photos 1372316737 and 1372316745 LMissing descriptors for photos 1372316745 and 1372316993 LMissing descriptors for photos 1372316993 and 1372317001 LMissing descriptors for photos 1372317001 and 1372317008 LMissing descriptors for photos 1372317008 and 1372317015 LMissing descriptors for photos 1372317015 and 1372317019 LMissing descriptors for photos 1372317019 and 1372317024 LMissing descriptors for photos 1372317024 and 1372317498 LMissing descriptors for photos 1372317498 and 1372317503 LMissing descriptors for photos 1372317503 and 1372317509 LMissing descriptors for photos 1372317509 and 1372317517 LMissing descriptors for photos 1372317517 and 1372317524 LMissing descriptors for photos 1372317524 and 1372317533 LMissing descriptors for photos 1372317533 and 1372317760 LMissing descriptors for photos 1372317760 and 1372317766 LMissing descriptors for photos 1372317766 and 1372317773 LMissing descriptors for photos 1372317773 and 1372317778 LMissing descriptors for photos 1372317778 and 1372317784 LMissing descriptors for photos 1372317784 and 1372317792 LMissing descriptors for photos 1372317792 and 1372318032 LMissing descriptors for photos 1372318032 and 1372318038 LMissing descriptors for photos 1372318038 and 1372318043 LMissing descriptors for photos 1372318043 and 1372318052 LMissing descriptors for photos 1372318052 and 1372318062 LMissing descriptors for photos 1372318062 and 1372318070 LMissing descriptors for photos 1372318070 and 1372318288 LMissing descriptors for photos 1372318288 and 1372318292 LMissing descriptors for photos 1372318292 and 1372318297 LMissing descriptors for photos 1372318297 and 1372318305 LMissing descriptors for photos 1372318305 and 1372318315 LMissing descriptors for photos 1372318315 and 1372318323 LMissing descriptors for photos 1372318323 and 1372318727 LMissing descriptors for photos 1372318727 and 1372318733 LMissing descriptors for photos 1372318733 and 1372318740 LMissing descriptors for photos 1372318740 and 1372318743 LMissing descriptors for photos 1372318743 and 1372318750 LMissing descriptors for photos 1372318750 and 1372318753 LMissing descriptors for photos 1372318753 and 1372318958 LMissing descriptors for photos 1372318958 and 1372318961 LMissing descriptors for photos 1372318961 and 1372318964 LMissing descriptors for photos 1372318964 and 1372318972 LMissing descriptors for photos 1372318972 and 1372318977 LMissing descriptors for photos 1372318977 and 1372318984 LMissing descriptors for photos 1372318984 and 1372319173 LMissing descriptors for photos 1372319173 and 1372319179 LMissing descriptors for photos 1372319179 and 1372319185 LMissing descriptors for photos 1372319185 and 1372319192 LMissing descriptors for photos 1372319192 and 1372319195 LMissing descriptors for photos 1372319195 and 1372319200 LMissing descriptors for photos 1372319200 and 1372319391 LMissing descriptors for photos 1372319391 and 1372319395 LMissing descriptors for photos 1372319395 and 1372319402 LMissing descriptors for photos 1372319402 and 1372319409 LMissing descriptors for photos 1372319409 and 1372319413 LMissing descriptors for photos 1372319413 and 1372319421 LMissing descriptors for photos 1372319421 and 1372319624 LMissing descriptors for photos 1372319624 and 1372319627 LMissing descriptors for photos 1372319627 and 1372319629 LMissing descriptors for photos 1372319629 and 1372319635 LMissing descriptors for photos 1372319635 and 1372319641 LMissing descriptors for photos 1372319641 and 1372319651 LMissing descriptors for photos 1372319651 and 1372319857 LMissing descriptors for photos 1372319857 and 1372319862 LMissing descriptors for photos 1372319862 and 1372319869 LMissing descriptors for photos 1372319869 and 1372319872 LMissing descriptors for photos 1372319872 and 1372319877 LMissing descriptors for photos 1372319877 and 1372319881 LMissing descriptors for photos 1372319881 and 1372320067 LMissing descriptors for photos 1372320067 and 1372320072 LMissing descriptors for photos 1372320072 and 1372320081 LMissing descriptors for photos 1372320081 and 1372320087 LMissing descriptors for photos 1372320087 and 1372320094 LMissing descriptors for photos 1372320094 and 1372320100 LMissing descriptors for photos 1372320100 and 1372320300 LMissing descriptors for photos 1372320300 and 1372320306 LMissing descriptors for photos 1372320306 and 1372320313 LMissing descriptors for photos 1372320313 and 1372320318 LMissing descriptors for photos 1372320318 and 1372320324 LMissing descriptors for photos 1372320324 and 1372320331 LMissing descriptors for photos 1372320331 and 1372320537 LMissing descriptors for photos 1372320537 and 1372320543 LMissing descriptors for photos 1372320543 and 1372320548 LMissing descriptors for photos 1372320548 and 1372320551 LMissing descriptors for photos 1372320551 and 1372320554 LMissing descriptors for photos 1372320554 and 1372320560 LMissing descriptors for photos 1372320560 and 1372320749 LMissing descriptors for photos 1372320749 and 1372320750 LMissing descriptors for photos 1372320750 and 1372320751 LMissing descriptors for photos 1372320751 and 1372320752 LMissing descriptors for photos 1372320752 and 1372320753 LMissing descriptors for photos 1372320753 and 1372320958 LMissing descriptors for photos 1372320958 and 1372320964 LMissing descriptors for photos 1372320964 and 1372320968 LMissing descriptors for photos 1372320968 and 1372320973 LMissing descriptors for photos 1372320973 and 1372320975 LMissing descriptors for photos 1372320975 and 1372320756 LMissing descriptors for photos 1372320756 and 1372320981 LMissing descriptors for photos 1372320981 and 1372321176 LMissing descriptors for photos 1372321176 and 1372321184 LMissing descriptors for photos 1372321184 and 1372321190 LMissing descriptors for photos 1372321190 and 1372321196 LMissing descriptors for photos 1372321196 and 1372321201 LMissing descriptors for photos 1372321201 and 1372321204 LMissing descriptors for photos 1372321204 and 1372321391 LMissing descriptors for photos 1372321391 and 1372321396 LMissing descriptors for photos 1372321396 and 1372321400 LMissing descriptors for photos 1372321400 and 1372321408 LMissing descriptors for photos 1372321408 and 1372321414 LMissing descriptors for photos 1372321414 and 1372321422 LMissing descriptors for photos 1372321422 and 1372321766 LMissing descriptors for photos 1372321766 and 1372321771 LMissing descriptors for photos 1372321771 and 1372321776 LMissing descriptors for photos 1372321776 and 1372321781 LMissing descriptors for photos 1372321781 and 1372321785 L 16072025 Removing 18 photos because of the 'same image' condition Total on : 241.452511 list_time_on Warning in study_and_display_distrib_list : min=max : 241.452511 241.452511 Total off : 178.129506 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 313 time used for this insertion : 0.08952140808105469 photos_removed : len 18 elapsed_time : remove_photo_duplicate 0.1266801357269287 To do, maybe not at the correct place ! .......L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.015439987182617188 NUMBER BATCH : 4 list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm'] LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info ERROR missing amount info Lresult_one_balle_Type_JRM:{'day': '16072025', 'map_nb_amount': {0: 2, 1: 26, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.4500119686127, 'nb_balles_papier': 0.0002900000000000001, 'begin_time_port': 'image_16072025_10_00_02_989325m0.jpg 2e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0002900000000000001 LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLWe filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 1 list_same_port_ids : [] https://marlene.fotonower.com/api/v1/secured/portfolio/new?name=JRM_diff_batch__16072025_10_00_02_989325&access_token=b05576c56a0e42ad0cb9b46155f68f82 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition ! WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 2 of step 12492 doesn't seem to be define in the database( WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7 WARNING : type of output 2 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12494 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 3 of step 12493 doesn't seem to be define in the database( WARNING : type of input 1 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12496 doesn't seem to be define in the database( WARNING : type of input 3 of step 12495 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12500 doesn't seem to be define in the database( WARNING : type of output 2 of step 12489 doesn't seem to be define in the database( WARNING : type of input 1 of step 12499 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6 WARNING : type of input 5 of step 12498 doesn't seem to be define in the database( WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18 WARNING : type of input 2 of step 12502 doesn't seem to be define in the database( WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None WARNING : type of output 3 of step 12502 doesn't seem to be define in the database( WARNING : type of input 2 of step 12496 doesn't seem to be define in the database( WARNING : type of output 1 of step 12499 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : type of output 1 of step 12500 doesn't seem to be define in the database( WARNING : type of input 3 of step 12492 doesn't seem to be define in the database( WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=25002322 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 2.468787670135498 # DISPLAY ALL COLLECTED DATA : {'16072025': {'nb_upload': 313, 'nb_taggue_class': 47, 'nb_taggue_densite': 47, 'nb_descriptors': 47}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1372321785, 1372321781, 1372321776, 1372321771, 1372321766, 1372321422, 1372321414, 1372321408, 1372321400, 1372321396, 1372321391, 1372321204, 1372321201, 1372321196, 1372321190, 1372321184, 1372321176, 1372320981, 1372320975, 1372320973, 1372320968, 1372320964, 1372320958, 1372320756, 1372320753, 1372320752, 1372320751, 1372320750, 1372320749, 1372320560, 1372320554, 1372320551, 1372320548, 1372320543, 1372320537, 1372320331, 1372320324, 1372320318, 1372320313, 1372320306, 1372320300, 1372320100, 1372320094, 1372320087, 1372320081, 1372320072, 1372320067, 1372319881, 1372319877, 1372319872, 1372319869, 1372319862, 1372319857, 1372319651, 1372319641, 1372319635, 1372319629, 1372319627, 1372319624, 1372319421, 1372319413, 1372319409, 1372319402, 1372319395, 1372319391, 1372319200, 1372319195, 1372319192, 1372319185, 1372319179, 1372319173, 1372318984, 1372318977, 1372318972, 1372318964, 1372318961, 1372318958, 1372318753, 1372318750, 1372318743, 1372318740, 1372318733, 1372318727, 1372318323, 1372318315, 1372318305, 1372318297, 1372318292, 1372318288, 1372318070, 1372318062, 1372318052, 1372318043, 1372318038, 1372318032, 1372317792, 1372317784, 1372317778, 1372317773, 1372317766] Looping around the photos to save general results len do output : 1 /24998150Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321785', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321781', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321776', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321771', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321766', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321422', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321414', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321408', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321400', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321396', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321391', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321204', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321201', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321196', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321190', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321184', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372321176', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320981', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320975', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320973', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320968', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320964', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320958', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320756', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320753', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320752', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320751', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320750', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320749', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320560', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320554', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320551', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320548', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320543', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320537', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320331', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320324', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320318', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320313', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320306', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320300', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320100', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320094', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320087', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320081', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320072', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372320067', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319881', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319877', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319872', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319869', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319862', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319857', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319651', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319641', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319635', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319629', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319627', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319624', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319421', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319413', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319409', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319402', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319395', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319391', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319200', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319195', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319192', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319185', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319179', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372319173', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318984', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318977', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318972', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318964', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318961', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318958', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318753', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318750', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318743', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318740', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318733', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318727', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318323', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318315', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318305', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318297', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318292', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318288', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318070', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318062', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318052', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318043', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318038', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372318032', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372317792', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372317784', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372317778', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372317773', None, None, None, None, None, '3300030') ('4189', None, None, None, None, None, None, None, '3300030') ('4189', '24998150', '1372317766', None, None, None, None, None, '3300030') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.05465960502624512 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.053905487060547 time spend to save output : 0.0554506778717041 total time spend for step 1 : 7.109356164932251 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.74user 0.64system 0:11.13elapsed 21%CPU (0avgtext+0avgdata 103672maxresident)k 0inputs+496outputs (0major+49473minor)pagefaults 0swaps