python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4323' -s datou_current_4323 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 896185 load datou : 4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4323, datou_cur_ids : ['4316861'] with mtr_portfolio_ids : ['29979604'] and first list_photo_ids : [] new path : /proc/896185/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.02966141700744629 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Tue Jan 6 12:10:28 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3847, 'mtr_user_id': 31, 'name': 'learn_MM_generique_050224', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '13096157,13096155,13096163,13096159,13301956,13095886,13096162,13096160,13358264,13096158,5515868,13276803', 'photo_hashtag_type': 4932, 'photo_desc_type': 6032, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 16), ('01', 65), ('02', 53), ('03', 39), ('04', 49), ('05', 55), ('06', 16), ('07', 59), ('08', 2), ('09', 4), ('10', 14), ('11', 45)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 417} 06012026 29979604 Nombre de photos uploadées : 417 / 23040 (1%) 06012026 29979604 Nombre de photos taguées (types de déchets): 417 / 417 (100%) 06012026 29979604 Nombre de photos taguées (volume) : 417 / 417 (100%) elapsed_time : load_data_split_time_score 6.198883056640625e-06 elapsed_time : order_list_meta_photo_and_scores 0.00023102760314941406 elapsed_time : fill_and_build_computed_from_old_data 0.03719973564147949 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25871944427490234 Creating list_photo_total elapsed_time : select_descriptors 0.014045000076293945 06012026 29979604 Nombre de photos avec descriptors (type 6032) : 0 / 0 (0%) Missing descriptors for photos 0 and 1402613507 0:00:00|ON:Missing descriptors for photos 1402613507 and 1402613503 Missing descriptors for photos 1402613503 and 1402613526 Missing descriptors for photos 1402613526 and 1402613523 Missing descriptors for photos 1402613523 and 1402613537 Missing descriptors for photos 1402613537 and 1402613551 Missing descriptors for photos 1402613551 and 1402613582 Missing descriptors for photos 1402613582 and 1402613592 Missing descriptors for photos 1402613592 and 1402613618 Missing descriptors for photos 1402613618 and 1402613632 Missing descriptors for photos 1402613632 and 1402613666 Missing descriptors for photos 1402613666 and 1402613683 Missing descriptors for photos 1402613683 and 1402613680 Missing descriptors for photos 1402613680 and 1402613737 Missing descriptors for photos 1402613737 and 1402613735 Missing descriptors for photos 1402613735 and 1402614122 Missing descriptors for photos 1402614122 and 1402614135 Missing descriptors for photos 1402614135 and 1402614491 Missing descriptors for photos 1402614491 and 1402614746 Missing descriptors for photos 1402614746 and 1402614711 Missing descriptors for photos 1402614711 and 1402615080 Missing descriptors for photos 1402615080 and 1402615204 Missing descriptors for photos 1402615204 and 1402615239 Missing descriptors for photos 1402615239 and 1402615253 Missing descriptors for photos 1402615253 and 1402615269 Missing descriptors for photos 1402615269 and 1402615266 Missing descriptors for photos 1402615266 and 1402615293 Missing descriptors for photos 1402615293 and 1402615301 Missing descriptors for photos 1402615301 and 1402615320 Missing descriptors for photos 1402615320 and 1402615365 Missing descriptors for photos 1402615365 and 1402615318 Missing descriptors for photos 1402615318 and 1402615364 Missing descriptors for photos 1402615364 and 1402615363 Missing descriptors for photos 1402615363 and 1402615362 Missing descriptors for photos 1402615362 and 1402615360 Missing descriptors for photos 1402615360 and 1402615402 Missing descriptors for photos 1402615402 and 1402615413 Missing descriptors for photos 1402615413 and 1402615436 Missing descriptors for photos 1402615436 and 1402615450 Missing descriptors for photos 1402615450 and 1402615515 Missing descriptors for photos 1402615515 and 1402615462 Missing descriptors for photos 1402615462 and 1402615513 Missing descriptors for photos 1402615513 and 1402615581 Missing descriptors for photos 1402615581 and 1402615636 Missing descriptors for photos 1402615636 and 1402615578 Missing descriptors for photos 1402615578 and 1402615635 Missing descriptors for photos 1402615635 and 1402615623 Missing descriptors for photos 1402615623 and 1402615633 Missing descriptors for photos 1402615633 and 1402615621 Missing descriptors for photos 1402615621 and 1402615630 Missing descriptors for photos 1402615630 and 1402615620 Missing descriptors for photos 1402615620 and 1402615627 Missing descriptors for photos 1402615627 and 1402615644 Missing descriptors for photos 1402615644 and 1402615690 Missing descriptors for photos 1402615690 and 1402615642 Missing descriptors for photos 1402615642 and 1402615688 Missing descriptors for photos 1402615688 and 1402615686 Missing descriptors for photos 1402615686 and 1402615684 Missing descriptors for photos 1402615684 and 1402615682 Missing descriptors for photos 1402615682 and 1402615680 Missing descriptors for photos 1402615680 and 1402615677 Missing descriptors for photos 1402615677 and 1402615698 Missing descriptors for photos 1402615698 and 1402615710 Missing descriptors for photos 1402615710 and 1402615708 Missing descriptors for photos 1402615708 and 1402615735 Missing descriptors for photos 1402615735 and 1402615736 Missing descriptors for photos 1402615736 and 1402615742 Missing descriptors for photos 1402615742 and 1402615781 Missing descriptors for photos 1402615781 and 1402615740 Missing descriptors for photos 1402615740 and 1402615782 Missing descriptors for photos 1402615782 and 1402615806 Missing descriptors for photos 1402615806 and 1402615849 Missing descriptors for photos 1402615849 and 1402615801 Missing descriptors for photos 1402615801 and 1402615848 Missing descriptors for photos 1402615848 and 1402615846 Missing descriptors for photos 1402615846 and 1402615844 Missing descriptors for photos 1402615844 and 1402615870 Missing descriptors for photos 1402615870 and 1402615886 Missing descriptors for photos 1402615886 and 1402615884 Missing descriptors for photos 1402615884 and 1402615894 Missing descriptors for photos 1402615894 and 1402617526 Missing descriptors for photos 1402617526 and 1402617524 Missing descriptors for photos 1402617524 and 1402617570 Missing descriptors for photos 1402617570 and 1402617568 Missing descriptors for photos 1402617568 and 1402617588 Missing descriptors for photos 1402617588 and 1402617603 Missing descriptors for photos 1402617603 and 1402617652 Missing descriptors for photos 1402617652 and 1402617601 Missing descriptors for photos 1402617601 and 1402617650 Missing descriptors for photos 1402617650 and 1402617647 Missing descriptors for photos 1402617647 and 1402617645 Missing descriptors for photos 1402617645 and 1402617643 Missing descriptors for photos 1402617643 and 1402617641 Missing descriptors for photos 1402617641 and 1402617663 Missing descriptors for photos 1402617663 and 1402617665 Missing descriptors for photos 1402617665 and 1402617675 Missing descriptors for photos 1402617675 and 1402617722 Missing descriptors for photos 1402617722 and 1402617672 Missing descriptors for photos 1402617672 and 1402617720 Missing descriptors for photos 1402617720 and 1402617719 Missing descriptors for photos 1402617719 and 1402617718 Missing descriptors for photos 1402617718 and 1402617717 Missing descriptors for photos 1402617717 and 1402617715 Missing descriptors for photos 1402617715 and 1402617730 Missing descriptors for photos 1402617730 and 1402617746 Missing descriptors for photos 1402617746 and 1402617758 Missing descriptors for photos 1402617758 and 1402617772 Missing descriptors for photos 1402617772 and 1402617959 Missing descriptors for photos 1402617959 and 1402617930 Missing descriptors for photos 1402617930 and 1402617956 Missing descriptors for photos 1402617956 and 1402617953 Missing descriptors for photos 1402617953 and 1402617950 Missing descriptors for photos 1402617950 and 1402617978 Missing descriptors for photos 1402617978 and 1402617976 Missing descriptors for photos 1402617976 and 1402617997 Missing descriptors for photos 1402617997 and 1402617998 Missing descriptors for photos 1402617998 and 1402618002 Missing descriptors for photos 1402618002 and 1402618080 Missing descriptors for photos 1402618080 and 1402618116 Missing descriptors for photos 1402618116 and 1402618078 Missing descriptors for photos 1402618078 and 1402618114 Missing descriptors for photos 1402618114 and 1402618235 Missing descriptors for photos 1402618235 and 1402618269 Missing descriptors for photos 1402618269 and 1402618271 Missing descriptors for photos 1402618271 and 1402618272 Missing descriptors for photos 1402618272 and 1402618273 Missing descriptors for photos 1402618273 and 1402618277 Missing descriptors for photos 1402618277 and 1402618310 Missing descriptors for photos 1402618310 and 1402618702 Missing descriptors for photos 1402618702 and 1402618865 Missing descriptors for photos 1402618865 and 1402618861 Missing descriptors for photos 1402618861 and 1402618859 Missing descriptors for photos 1402618859 and 1402619028 Missing descriptors for photos 1402619028 and 1402620801 Missing descriptors for photos 1402620801 and 1402618987 Missing descriptors for photos 1402618987 and 1402620769 Missing descriptors for photos 1402620769 and 1402621270 Missing descriptors for photos 1402621270 and 1402621029 Missing descriptors for photos 1402621029 and 1402621287 Missing descriptors for photos 1402621287 and 1402621284 Missing descriptors for photos 1402621284 and 1402621313 Missing descriptors for photos 1402621313 and 1402621311 Missing descriptors for photos 1402621311 and 1402621321 Missing descriptors for photos 1402621321 and 1402621319 Missing descriptors for photos 1402621319 and 1402621342 Missing descriptors for photos 1402621342 and 1402621340 Missing descriptors for photos 1402621340 and 1402621367 Missing descriptors for photos 1402621367 and 1402621364 Missing descriptors for photos 1402621364 and 1402621377 Missing descriptors for photos 1402621377 and 1402621395 Missing descriptors for photos 1402621395 and 1402621393 Missing descriptors for photos 1402621393 and 1402621427 Missing descriptors for photos 1402621427 and 1402621424 Missing descriptors for photos 1402621424 and 1402621441 Missing descriptors for photos 1402621441 and 1402621581 Missing descriptors for photos 1402621581 and 1402621599 Missing descriptors for photos 1402621599 and 1402621597 Missing descriptors for photos 1402621597 and 1402621620 Missing descriptors for photos 1402621620 and 1402621618 Missing descriptors for photos 1402621618 and 1402621644 Missing descriptors for photos 1402621644 and 1402621667 Missing descriptors for photos 1402621667 and 1402621663 Missing descriptors for photos 1402621663 and 1402621688 Missing descriptors for photos 1402621688 and 1402621685 Missing descriptors for photos 1402621685 and 1402621693 Missing descriptors for photos 1402621693 and 1402621705 Missing descriptors for photos 1402621705 and 1402621730 Missing descriptors for photos 1402621730 and 1402621727 Missing descriptors for photos 1402621727 and 1402621743 Missing descriptors for photos 1402621743 and 1402621786 Missing descriptors for photos 1402621786 and 1402621741 Missing descriptors for photos 1402621741 and 1402621783 Missing descriptors for photos 1402621783 and 1402622617 Missing descriptors for photos 1402622617 and 1402623512 Missing descriptors for photos 1402623512 and 1402623472 Missing descriptors for photos 1402623472 and 1402623678 Missing descriptors for photos 1402623678 and 1402623812 Missing descriptors for photos 1402623812 and 1402623833 Missing descriptors for photos 1402623833 and 1402623852 Missing descriptors for photos 1402623852 and 1402623878 Missing descriptors for photos 1402623878 and 1402623876 Missing descriptors for photos 1402623876 and 1402623919 Missing descriptors for photos 1402623919 and 1402623941 Missing descriptors for photos 1402623941 and 1402623963 Missing descriptors for photos 1402623963 and 1402624009 Missing descriptors for photos 1402624009 and 1402623961 Missing descriptors for photos 1402623961 and 1402624007 Missing descriptors for photos 1402624007 and 1402624165 Missing descriptors for photos 1402624165 and 1402624223 Missing descriptors for photos 1402624223 and 1402624220 Missing descriptors for photos 1402624220 and 1402624216 Missing descriptors for photos 1402624216 and 1402624213 Missing descriptors for photos 1402624213 and 1402624236 Missing descriptors for photos 1402624236 and 1402624233 Missing descriptors for photos 1402624233 and 1402624264 Missing descriptors for photos 1402624264 and 1402624261 Missing descriptors for photos 1402624261 and 1402624283 Missing descriptors for photos 1402624283 and 1402624304 Missing descriptors for photos 1402624304 and 1402624302 Missing descriptors for photos 1402624302 and 1402624330 Missing descriptors for photos 1402624330 and 1402624327 Missing descriptors for photos 1402624327 and 1402624366 Missing descriptors for photos 1402624366 and 1402624364 Missing descriptors for photos 1402624364 and 1402624391 Missing descriptors for photos 1402624391 and 1402624434 Missing descriptors for photos 1402624434 and 1402624389 Missing descriptors for photos 1402624389 and 1402624432 Missing descriptors for photos 1402624432 and 1402624598 Missing descriptors for photos 1402624598 and 1402624618 Missing descriptors for photos 1402624618 and 1402624645 Missing descriptors for photos 1402624645 and 1402624643 Missing descriptors for photos 1402624643 and 1402624671 Missing descriptors for photos 1402624671 and 1402624688 Missing descriptors for photos 1402624688 and 1402624668 Missing descriptors for photos 1402624668 and 1402624718 Missing descriptors for photos 1402624718 and 1402624736 Missing descriptors for photos 1402624736 and 1402624754 Missing descriptors for photos 1402624754 and 1402624798 Missing descriptors for photos 1402624798 and 1402624796 Missing descriptors for photos 1402624796 and 1402624815 Missing descriptors for photos 1402624815 and 1402624866 Missing descriptors for photos 1402624866 and 1402625617 Missing descriptors for photos 1402625617 and 1402626194 Missing descriptors for photos 1402626194 and 1402626154 Missing descriptors for photos 1402626154 and 1402626591 Missing descriptors for photos 1402626591 and 1402626978 Missing descriptors for photos 1402626978 and 1402626976 Missing descriptors for photos 1402626976 and 1402626996 Missing descriptors for photos 1402626996 and 1402626993 Missing descriptors for photos 1402626993 and 1402627030 Missing descriptors for photos 1402627030 and 1402627028 Missing descriptors for photos 1402627028 and 1402627050 Missing descriptors for photos 1402627050 and 1402627047 Missing descriptors for photos 1402627047 and 1402627080 Missing descriptors for photos 1402627080 and 1402627097 Missing descriptors for photos 1402627097 and 1402627136 Missing descriptors for photos 1402627136 and 1402627095 Missing descriptors for photos 1402627095 and 1402627138 Missing descriptors for photos 1402627138 and 1402627256 Missing descriptors for photos 1402627256 and 1402627280 Missing descriptors for photos 1402627280 and 1402627277 Missing descriptors for photos 1402627277 and 1402627357 Missing descriptors for photos 1402627357 and 1402627355 Missing descriptors for photos 1402627355 and 1402627383 Missing descriptors for photos 1402627383 and 1402627427 Missing descriptors for photos 1402627427 and 1402627382 Missing descriptors for photos 1402627382 and 1402627430 Missing descriptors for photos 1402627430 and 1402627432 Missing descriptors for photos 1402627432 and 1402627434 Missing descriptors for photos 1402627434 and 1402627443 Missing descriptors for photos 1402627443 and 1402627441 Missing descriptors for photos 1402627441 and 1402627468 Missing descriptors for photos 1402627468 and 1402627486 Missing descriptors for photos 1402627486 and 1402627484 Missing descriptors for photos 1402627484 and 1402627529 Missing descriptors for photos 1402627529 and 1402627684 Missing descriptors for photos 1402627684 and 1402627697 Missing descriptors for photos 1402627697 and 1402627720 Missing descriptors for photos 1402627720 and 1402627728 Missing descriptors for photos 1402627728 and 1402627747 Missing descriptors for photos 1402627747 and 1402627770 Missing descriptors for photos 1402627770 and 1402627787 Missing descriptors for photos 1402627787 and 1402627785 Missing descriptors for photos 1402627785 and 1402627829 Missing descriptors for photos 1402627829 and 1402627845 Missing descriptors for photos 1402627845 and 1402627887 Missing descriptors for photos 1402627887 and 1402627843 Missing descriptors for photos 1402627843 and 1402627891 Missing descriptors for photos 1402627891 and 1402627892 Missing descriptors for photos 1402627892 and 1402627901 Missing descriptors for photos 1402627901 and 1402627899 Missing descriptors for photos 1402627899 and 1402627930 Missing descriptors for photos 1402627930 and 1402627945 Missing descriptors for photos 1402627945 and 1402627962 Missing descriptors for photos 1402627962 and 1402627981 Missing descriptors for photos 1402627981 and 1402628009 Missing descriptors for photos 1402628009 and 1402628047 Missing descriptors for photos 1402628047 and 1402628007 Missing descriptors for photos 1402628007 and 1402628048 Missing descriptors for photos 1402628048 and 1402628616 Missing descriptors for photos 1402628616 and 1402628363 Missing descriptors for photos 1402628363 and 1402628637 Missing descriptors for photos 1402628637 and 1402628634 Missing descriptors for photos 1402628634 and 1402628654 Missing descriptors for photos 1402628654 and 1402628667 Missing descriptors for photos 1402628667 and 1402628686 Missing descriptors for photos 1402628686 and 1402628683 Missing descriptors for photos 1402628683 and 1402628709 Missing descriptors for photos 1402628709 and 1402628706 Missing descriptors for photos 1402628706 and 1402628721 Missing descriptors for photos 1402628721 and 1402628778 Missing descriptors for photos 1402628778 and 1402628811 Missing descriptors for photos 1402628811 and 1402632495 Missing descriptors for photos 1402632495 and 1402632521 Missing descriptors for photos 1402632521 and 1402632548 Missing descriptors for photos 1402632548 and 1402632545 Missing descriptors for photos 1402632545 and 1402632570 Missing descriptors for photos 1402632570 and 1402632595 Missing descriptors for photos 1402632595 and 1402632592 Missing descriptors for photos 1402632592 and 1402632639 Missing descriptors for photos 1402632639 and 1402632668 Missing descriptors for photos 1402632668 and 1402632666 Missing descriptors for photos 1402632666 and 1402632698 Missing descriptors for photos 1402632698 and 1402632694 Missing descriptors for photos 1402632694 and 1402632723 Missing descriptors for photos 1402632723 and 1402632720 Missing descriptors for photos 1402632720 and 1402632738 Missing descriptors for photos 1402632738 and 1402632764 Missing descriptors for photos 1402632764 and 1402632784 Missing descriptors for photos 1402632784 and 1402632816 Missing descriptors for photos 1402632816 and 1402632813 Missing descriptors for photos 1402632813 and 1402632838 Missing descriptors for photos 1402632838 and 1402632887 Missing descriptors for photos 1402632887 and 1402632884 Missing descriptors for photos 1402632884 and 1402632907 Missing descriptors for photos 1402632907 and 1402632905 Missing descriptors for photos 1402632905 and 1402632937 Missing descriptors for photos 1402632937 and 1402632949 Missing descriptors for photos 1402632949 and 1402633020 Missing descriptors for photos 1402633020 and 1402632966 Missing descriptors for photos 1402632966 and 1402633017 Missing descriptors for photos 1402633017 and 1402633043 Missing descriptors for photos 1402633043 and 1402633063 Missing descriptors for photos 1402633063 and 1402633089 Missing descriptors for photos 1402633089 and 1402633115 Missing descriptors for photos 1402633115 and 1402633136 Missing descriptors for photos 1402633136 and 1402633134 Missing descriptors for photos 1402633134 and 1402633154 Missing descriptors for photos 1402633154 and 1402633184 Missing descriptors for photos 1402633184 and 1402633202 Missing descriptors for photos 1402633202 and 1402633265 Missing descriptors for photos 1402633265 and 1402633197 Missing descriptors for photos 1402633197 and 1402633264 Missing descriptors for photos 1402633264 and 1402633263 Missing descriptors for photos 1402633263 and 1402633262 Missing descriptors for photos 1402633262 and 1402633259 Missing descriptors for photos 1402633259 and 1402633256 Missing descriptors for photos 1402633256 and 1402633279 Missing descriptors for photos 1402633279 and 1402633294 Missing descriptors for photos 1402633294 and 1402633289 Missing descriptors for photos 1402633289 and 1402633329 Missing descriptors for photos 1402633329 and 1402633326 Missing descriptors for photos 1402633326 and 1402633347 Missing descriptors for photos 1402633347 and 1402633345 Missing descriptors for photos 1402633345 and 1402633390 Missing descriptors for photos 1402633390 and 1402633411 Missing descriptors for photos 1402633411 and 1402633410 Missing descriptors for photos 1402633410 and 1402633436 Missing descriptors for photos 1402633436 and 1402633489 Missing descriptors for photos 1402633489 and 1402633435 Missing descriptors for photos 1402633435 and 1402633485 Missing descriptors for photos 1402633485 and 1402635671 Missing descriptors for photos 1402635671 and 1402634043 Missing descriptors for photos 1402634043 and 1402640745 Missing descriptors for photos 1402640745 and 1402644442 Missing descriptors for photos 1402644442 and 1402644531 Missing descriptors for photos 1402644531 and 1402640837 Missing descriptors for photos 1402640837 and 1402641618 Missing descriptors for photos 1402641618 and 1402644529 Missing descriptors for photos 1402644529 and 1402644594 Missing descriptors for photos 1402644594 and 1402644612 Missing descriptors for photos 1402644612 and 1402644737 Missing descriptors for photos 1402644737 and 1402644758 Missing descriptors for photos 1402644758 and 1402644823 Missing descriptors for photos 1402644823 and 1402644755 Missing descriptors for photos 1402644755 and 1402644826 Missing descriptors for photos 1402644826 and 1402644828 Missing descriptors for photos 1402644828 and 1402644836 Missing descriptors for photos 1402644836 and 1402644879 Missing descriptors for photos 1402644879 and 1402644917 Missing descriptors for photos 1402644917 and 1402645344 Missing descriptors for photos 1402645344 and 1402645835 Missing descriptors for photos 1402645835 and 1402647178 Missing descriptors for photos 1402647178 and 1402646971 Missing descriptors for photos 1402646971 and 1402647253 Missing descriptors for photos 1402647253 and 1402647249 Missing descriptors for photos 1402647249 and 1402647278 Missing descriptors for photos 1402647278 and 1402647306 Missing descriptors for photos 1402647306 and 1402647304 Missing descriptors for photos 1402647304 and 1402647327 Missing descriptors for photos 1402647327 and 1402647356 Missing descriptors for photos 1402647356 and 1402647413 Missing descriptors for photos 1402647413 and 1402647463 Missing descriptors for photos 1402647463 and 1402647485 Missing descriptors for photos 1402647485 and 1402647534 Missing descriptors for photos 1402647534 and 1402647533 Missing descriptors for photos 1402647533 and 1402647582 Missing descriptors for photos 1402647582 and 1402647578 Missing descriptors for photos 1402647578 and 1402647619 Missing descriptors for photos 1402647619 and 1402647640 Missing descriptors for photos 1402647640 and 1402647639 Missing descriptors for photos 1402647639 and 1402647702 Missing descriptors for photos 1402647702 and 1402647699 Missing descriptors for photos 1402647699 and 1402647718 Missing descriptors for photos 1402647718 and 1402647736 Missing descriptors for photos 1402647736 and 1402647733 Missing descriptors for photos 1402647733 and 1402647834 Missing descriptors for photos 1402647834 and 1402647822 Missing descriptors for photos 1402647822 and 1402647863 Missing descriptors for photos 1402647863 and 1402647859 Missing descriptors for photos 1402647859 and 1402647902 Missing descriptors for photos 1402647902 and 1402647880 Missing descriptors for photos 1402647880 and 1402647893 Missing descriptors for photos 1402647893 and 1402647958 Missing descriptors for photos 1402647958 and 1402647955 Missing descriptors for photos 1402647955 and 1402648043 Missing descriptors for photos 1402648043 and 1402648099 Missing descriptors for photos 1402648099 and 1402648100 Missing descriptors for photos 1402648100 and 1402648123 Missing descriptors for photos 1402648123 and 1402648120 Missing descriptors for photos 1402648120 and 1402648155 Missing descriptors for photos 1402648155 and 1402648187 Missing descriptors for photos 1402648187 and 1402648581 Missing descriptors for photos 1402648581 and 1402648553 Missing descriptors for photos 1402648553 and 1402648703 Missing descriptors for photos 1402648703 and 1402648750 Missing descriptors for photos 1402648750 and 1402649011 06012026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc Warning in study_and_display_distrib_list : min=max : -1 -1 begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 417 time used for this insertion : 0.08235001564025879 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.12202906608581543 Creating list_photo_total elapsed_time : count_sum_diff_and_build_graph 0.0038344860076904297 Total photos : 417 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info Total photos : 417 Number of lists : 0 counter photos in port : 0 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 0 photos in 0 portfolios ! hashtag : film_pedb(2107760237) : 0 photos in 0 portfolios ! hashtag : flux_dev(2107760238) : 0 photos in 0 portfolios ! hashtag : jrm(495916461) : 0 photos in 0 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 0 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.017122268676757812 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 4.291534423828125e-06 today str has not a value , we define it as the date of the first image todaystr_first : 06012026 attention , prev_timestamp is 0 , we do nothing ***************o******o*o********o*oo*o*oo*o******o*oo*o********o*o***oo******o*****o*o*o*********oo*********************o*o**********o*oo***********oo**********o**********o*o*****oo**************o*o******oo*********o*****************************o*o******o*o***o******o******o********************o********Count Time bigger than 30s : 256 #Number Photos for regression : {'06012026': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 14912.996039867401, 2107751016: 0, 2107751017: 0}}} 06012026|aluminium, 05102018_papier_non_papier_dense:0 06012026|aluminium, 05102018_papier_non_papier_peu_dense:0 06012026|aluminium, 05102018_papier_non_papier_presque_vide:0 06012026|aluminium, 05102018_papier_non_papier_tres_dense:0 06012026|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 06012026|ela, 05102018_papier_non_papier_dense:0 06012026|ela, 05102018_papier_non_papier_peu_dense:0 06012026|ela, 05102018_papier_non_papier_presque_vide:0 06012026|ela, 05102018_papier_non_papier_tres_dense:0 06012026|ela, 05102018_papier_non_papier_tres_peu_dense:0 06012026|emr, 05102018_papier_non_papier_dense:0 06012026|emr, 05102018_papier_non_papier_peu_dense:0 06012026|emr, 05102018_papier_non_papier_presque_vide:0 06012026|emr, 05102018_papier_non_papier_tres_dense:0 06012026|emr, 05102018_papier_non_papier_tres_peu_dense:0 06012026|film_pedb, 05102018_papier_non_papier_dense:0 06012026|film_pedb, 05102018_papier_non_papier_peu_dense:0 06012026|film_pedb, 05102018_papier_non_papier_presque_vide:0 06012026|film_pedb, 05102018_papier_non_papier_tres_dense:0 06012026|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 06012026|flux_dev, 05102018_papier_non_papier_dense:0 06012026|flux_dev, 05102018_papier_non_papier_peu_dense:0 06012026|flux_dev, 05102018_papier_non_papier_presque_vide:0 06012026|flux_dev, 05102018_papier_non_papier_tres_dense:0 06012026|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 06012026|jrm, 05102018_papier_non_papier_dense:0 06012026|jrm, 05102018_papier_non_papier_peu_dense:0 06012026|jrm, 05102018_papier_non_papier_presque_vide:0 06012026|jrm, 05102018_papier_non_papier_tres_dense:0 06012026|jrm, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pcm, 05102018_papier_non_papier_dense:0 06012026|pcm, 05102018_papier_non_papier_peu_dense:0 06012026|pcm, 05102018_papier_non_papier_presque_vide:0 06012026|pcm, 05102018_papier_non_papier_tres_dense:0 06012026|pcm, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pcnc, 05102018_papier_non_papier_dense:0 06012026|pcnc, 05102018_papier_non_papier_peu_dense:0 06012026|pcnc, 05102018_papier_non_papier_presque_vide:0 06012026|pcnc, 05102018_papier_non_papier_tres_dense:0 06012026|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_peu_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_presque_vide:0 06012026|pehd_pp, 05102018_papier_non_papier_tres_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pet_clair, 05102018_papier_non_papier_dense:0 06012026|pet_clair, 05102018_papier_non_papier_peu_dense:0 06012026|pet_clair, 05102018_papier_non_papier_presque_vide:0 06012026|pet_clair, 05102018_papier_non_papier_tres_dense:0 06012026|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 06012026|refus, 05102018_papier_non_papier_dense:0 06012026|refus, 05102018_papier_non_papier_peu_dense:0 06012026|refus, 05102018_papier_non_papier_presque_vide:0 06012026|refus, 05102018_papier_non_papier_tres_dense:0 06012026|refus, 05102018_papier_non_papier_tres_peu_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_peu_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_presque_vide:14912.996039867401 06012026|tapis_vide, 05102018_papier_non_papier_tres_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 06012026_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 0 Number amount portfolio for this type of dechet : film_pedb 0 Number amount portfolio for this type of dechet : flux_dev 0 Number amount portfolio for this type of dechet : jrm 0 Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 0 Number amount portfolio for this type of dechet : pet_clair 0 Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 380 Created to study and clean : 29982996 with name like 06012026_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 0 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['pcnc', 'gm', 'emr', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev_rigide', 'aluminium', 'tapis_vide', 'refus', 'gros_cartons', 'gm', 'flux_dev_rigide', 'gros_cartons'] We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 0 elapsed_time : count_nb_balles_and_create_portfolio 7.250441789627075 # DISPLAY ALL COLLECTED DATA : {'06012026': {'nb_upload': 417, 'nb_taggue_class': 417, 'nb_taggue_densite': 417, 'nb_descriptors': 0, 'number_port': 0, 'count_photo_in_port': 0, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 0, 'nb_portfolios': 0}, 'film_pedb': {'nb_photos': 0, 'nb_portfolios': 0}, 'flux_dev': {'nb_photos': 0, 'nb_portfolios': 0}, 'jrm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 0}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402649011, 1402648750, 1402648703, 1402648581, 1402648553, 1402648187, 1402648155, 1402648123, 1402648120, 1402648100, 1402648099, 1402648043, 1402647958, 1402647955, 1402647902, 1402647893, 1402647880, 1402647863, 1402647859, 1402647834, 1402647822, 1402647736, 1402647733, 1402647718, 1402647702, 1402647699, 1402647640, 1402647639, 1402647619, 1402647582, 1402647578, 1402647534, 1402647533, 1402647485, 1402647463, 1402647413, 1402647356, 1402647327, 1402647306, 1402647304, 1402647278, 1402647253, 1402647249, 1402647178, 1402646971, 1402645835, 1402645344, 1402644917, 1402644879, 1402644836, 1402644828, 1402644826, 1402644823, 1402644758, 1402644755, 1402644737, 1402644612, 1402644594, 1402644531, 1402644529, 1402644442, 1402641618, 1402640837, 1402640745, 1402635671, 1402634043, 1402633489, 1402633485, 1402633436, 1402633435, 1402633411, 1402633410, 1402633390, 1402633347, 1402633345, 1402633329, 1402633326, 1402633294, 1402633289, 1402633279, 1402633265, 1402633264, 1402633263, 1402633262, 1402633259, 1402633256, 1402633202, 1402633197, 1402633184, 1402633154, 1402633136, 1402633134, 1402633115, 1402633089, 1402633063, 1402633043, 1402633020, 1402633017, 1402632966, 1402632949] Looping around the photos to save general results len do output : 1 /29979604Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402649011', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648750', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648703', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648581', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648553', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648187', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648155', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648123', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648120', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648100', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648099', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402648043', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647958', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647955', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647902', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647893', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647880', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647863', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647859', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647834', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647822', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647736', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647733', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647718', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647702', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647699', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647640', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647639', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647619', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647582', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647578', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647534', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647533', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647485', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647463', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647413', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647356', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647327', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647306', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647304', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647278', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647253', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647249', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402647178', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402646971', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402645835', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402645344', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644917', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644879', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644836', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644828', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644826', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644823', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644758', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644755', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644737', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644612', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644594', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644531', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644529', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402644442', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402641618', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402640837', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402640745', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402635671', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402634043', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633489', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633485', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633436', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633435', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633411', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633410', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633390', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633347', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633345', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633329', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633326', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633294', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633289', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633279', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633265', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633264', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633263', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633262', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633259', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633256', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633202', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633197', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633184', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633154', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633136', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633134', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633115', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633089', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633063', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633043', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633020', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402633017', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402632966', None, None, None, None, None, '4316861') ('4323', None, None, None, None, None, None, None, '4316861') ('4323', '29979604', '1402632949', None, None, None, None, None, '4316861') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.030801057815551758 save_final save missing photos in datou_result : time spend for datou_step_exec : 7.834063768386841 time spend to save output : 0.03157997131347656 total time spend for step 1 : 7.865643739700317 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.28user 0.58system 0:11.23elapsed 16%CPU (0avgtext+0avgdata 110488maxresident)k 0inputs+136outputs (2major+52656minor)pagefaults 0swaps