python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4323' -s datou_current_4323 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 1100588 load datou : 4323 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4323, datou_cur_ids : ['4317307'] with mtr_portfolio_ids : ['29979604'] and first list_photo_ids : [] new path : /proc/1100588/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.03059554100036621 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Tue Jan 6 14:35:29 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3847, 'mtr_user_id': 31, 'name': 'learn_MM_generique_050224', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '13096157,13096155,13096163,13096159,13301956,13095886,13096162,13096160,13358264,13096158,5515868,13276803', 'photo_hashtag_type': 4932, 'photo_desc_type': 6032, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 16), ('01', 65), ('02', 53), ('03', 39), ('04', 49), ('05', 55), ('06', 16), ('07', 59), ('08', 2), ('09', 4), ('10', 14), ('11', 45), ('12', 30), ('13', 15), ('14', 54)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 503} 06012026 29979604 Nombre de photos uploadées : 516 / 23040 (2%) 06012026 29979604 Nombre de photos taguées (types de déchets): 503 / 516 (97%) 06012026 29979604 Nombre de photos taguées (volume) : 503 / 516 (97%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 0.0002048015594482422 ????????????? elapsed_time : fill_and_build_computed_from_old_data 0.02033710479736328 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.25642824172973633 Creating list_photo_total elapsed_time : select_descriptors 0.9027180671691895 06012026 29979604 Nombre de photos avec descriptors (type 6032) : 12 / 25 (48%) Missing descriptors for photos 0 and 1402613507 0:00:00|ON:Missing descriptors for photos 1402613507 and 1402613503 Missing descriptors for photos 1402613503 and 1402613526 Missing descriptors for photos 1402613526 and 1402613523 Missing descriptors for photos 1402613523 and 1402613537 Missing descriptors for photos 1402613537 and 1402613551 Missing descriptors for photos 1402613551 and 1402613582 Missing descriptors for photos 1402613582 and 1402613592 Missing descriptors for photos 1402613592 and 1402613618 Missing descriptors for photos 1402613618 and 1402613632 Missing descriptors for photos 1402613632 and 1402613666 Missing descriptors for photos 1402613666 and 1402613683 Missing descriptors for photos 1402613683 and 1402613680 Missing descriptors for photos 1402613680 and 1402613737 Missing descriptors for photos 1402613737 and 1402613735 Missing descriptors for photos 1402613735 and 1402614122 Missing descriptors for photos 1402614122 and 1402614135 Missing descriptors for photos 1402614135 and 1402614491 Missing descriptors for photos 1402614491 and 1402614746 Missing descriptors for photos 1402614746 and 1402614711 Missing descriptors for photos 1402614711 and 1402615080 Missing descriptors for photos 1402615080 and 1402615204 Missing descriptors for photos 1402615204 and 1402615239 Missing descriptors for photos 1402615239 and 1402615253 Missing descriptors for photos 1402615253 and 1402615269 Missing descriptors for photos 1402615269 and 1402615266 Missing descriptors for photos 1402615266 and 1402615293 Missing descriptors for photos 1402615293 and 1402615301 Missing descriptors for photos 1402615301 and 1402615320 Missing descriptors for photos 1402615320 and 1402615365 Missing descriptors for photos 1402615365 and 1402615318 Missing descriptors for photos 1402615318 and 1402615364 Missing descriptors for photos 1402615364 and 1402615363 Missing descriptors for photos 1402615363 and 1402615362 Missing descriptors for photos 1402615362 and 1402615360 Missing descriptors for photos 1402615360 and 1402615402 Missing descriptors for photos 1402615402 and 1402615413 Missing descriptors for photos 1402615413 and 1402615436 Missing descriptors for photos 1402615436 and 1402615450 Missing descriptors for photos 1402615450 and 1402615515 Missing descriptors for photos 1402615515 and 1402615462 Missing descriptors for photos 1402615462 and 1402615513 Missing descriptors for photos 1402615513 and 1402615581 Missing descriptors for photos 1402615581 and 1402615636 Missing descriptors for photos 1402615636 and 1402615578 Missing descriptors for photos 1402615578 and 1402615635 Missing descriptors for photos 1402615635 and 1402615623 Missing descriptors for photos 1402615623 and 1402615633 Missing descriptors for photos 1402615633 and 1402615621 Missing descriptors for photos 1402615621 and 1402615630 Missing descriptors for photos 1402615630 and 1402615620 Missing descriptors for photos 1402615620 and 1402615627 Missing descriptors for photos 1402615627 and 1402615644 Missing descriptors for photos 1402615644 and 1402615690 Missing descriptors for photos 1402615690 and 1402615642 Missing descriptors for photos 1402615642 and 1402615688 Missing descriptors for photos 1402615688 and 1402615686 Missing descriptors for photos 1402615686 and 1402615684 Missing descriptors for photos 1402615684 and 1402615682 Missing descriptors for photos 1402615682 and 1402615680 Missing descriptors for photos 1402615680 and 1402615677 Missing descriptors for photos 1402615677 and 1402615698 Missing descriptors for photos 1402615698 and 1402615710 Missing descriptors for photos 1402615710 and 1402615708 Missing descriptors for photos 1402615708 and 1402615735 Missing descriptors for photos 1402615735 and 1402615736 Missing descriptors for photos 1402615736 and 1402615742 Missing descriptors for photos 1402615742 and 1402615781 Missing descriptors for photos 1402615781 and 1402615740 Missing descriptors for photos 1402615740 and 1402615782 Missing descriptors for photos 1402615782 and 1402615806 Missing descriptors for photos 1402615806 and 1402615849 Missing descriptors for photos 1402615849 and 1402615801 Missing descriptors for photos 1402615801 and 1402615848 Missing descriptors for photos 1402615848 and 1402615846 Missing descriptors for photos 1402615846 and 1402615844 Missing descriptors for photos 1402615844 and 1402615870 Missing descriptors for photos 1402615870 and 1402615886 Missing descriptors for photos 1402615886 and 1402615884 Missing descriptors for photos 1402615884 and 1402615894 Missing descriptors for photos 1402615894 and 1402617526 Missing descriptors for photos 1402617526 and 1402617524 Missing descriptors for photos 1402617524 and 1402617570 Missing descriptors for photos 1402617570 and 1402617568 Missing descriptors for photos 1402617568 and 1402617588 Missing descriptors for photos 1402617588 and 1402617603 Missing descriptors for photos 1402617603 and 1402617652 Missing descriptors for photos 1402617652 and 1402617601 Missing descriptors for photos 1402617601 and 1402617650 Missing descriptors for photos 1402617650 and 1402617647 Missing descriptors for photos 1402617647 and 1402617645 Missing descriptors for photos 1402617645 and 1402617643 Missing descriptors for photos 1402617643 and 1402617641 Missing descriptors for photos 1402617641 and 1402617663 Missing descriptors for photos 1402617663 and 1402617665 Missing descriptors for photos 1402617665 and 1402617675 Missing descriptors for photos 1402617675 and 1402617722 Missing descriptors for photos 1402617722 and 1402617672 Missing descriptors for photos 1402617672 and 1402617720 Missing descriptors for photos 1402617720 and 1402617719 Missing descriptors for photos 1402617719 and 1402617718 Missing descriptors for photos 1402617718 and 1402617717 Missing descriptors for photos 1402617717 and 1402617715 Missing descriptors for photos 1402617715 and 1402617730 Missing descriptors for photos 1402617730 and 1402617746 Missing descriptors for photos 1402617746 and 1402617758 Missing descriptors for photos 1402617758 and 1402617772 Missing descriptors for photos 1402617772 and 1402617959 Missing descriptors for photos 1402617959 and 1402617930 Missing descriptors for photos 1402617930 and 1402617956 Missing descriptors for photos 1402617956 and 1402617953 Missing descriptors for photos 1402617953 and 1402617950 Missing descriptors for photos 1402617950 and 1402617978 Missing descriptors for photos 1402617978 and 1402617976 Missing descriptors for photos 1402617976 and 1402617997 Missing descriptors for photos 1402617997 and 1402617998 Missing descriptors for photos 1402617998 and 1402618002 Missing descriptors for photos 1402618002 and 1402618080 Missing descriptors for photos 1402618080 and 1402618116 Missing descriptors for photos 1402618116 and 1402618078 Missing descriptors for photos 1402618078 and 1402618114 Missing descriptors for photos 1402618114 and 1402618235 Missing descriptors for photos 1402618235 and 1402618269 Missing descriptors for photos 1402618269 and 1402618271 Missing descriptors for photos 1402618271 and 1402618272 Missing descriptors for photos 1402618272 and 1402618273 Missing descriptors for photos 1402618273 and 1402618277 Missing descriptors for photos 1402618277 and 1402618310 Missing descriptors for photos 1402618310 and 1402618702 Missing descriptors for photos 1402618702 and 1402618865 Missing descriptors for photos 1402618865 and 1402618861 Missing descriptors for photos 1402618861 and 1402618859 Missing descriptors for photos 1402618859 and 1402619028 Missing descriptors for photos 1402619028 and 1402620801 Missing descriptors for photos 1402620801 and 1402618987 Missing descriptors for photos 1402618987 and 1402620769 Missing descriptors for photos 1402620769 and 1402621270 Missing descriptors for photos 1402621270 and 1402621029 Missing descriptors for photos 1402621029 and 1402621287 Missing descriptors for photos 1402621287 and 1402621284 Missing descriptors for photos 1402621284 and 1402621313 Missing descriptors for photos 1402621313 and 1402621311 Missing descriptors for photos 1402621311 and 1402621321 Missing descriptors for photos 1402621321 and 1402621319 Missing descriptors for photos 1402621319 and 1402621342 Missing descriptors for photos 1402621342 and 1402621340 Missing descriptors for photos 1402621340 and 1402621367 Missing descriptors for photos 1402621367 and 1402621364 Missing descriptors for photos 1402621364 and 1402621377 Missing descriptors for photos 1402621377 and 1402621395 Missing descriptors for photos 1402621395 and 1402621393 Missing descriptors for photos 1402621393 and 1402621427 Missing descriptors for photos 1402621427 and 1402621424 Missing descriptors for photos 1402621424 and 1402621441 Missing descriptors for photos 1402621441 and 1402621581 Missing descriptors for photos 1402621581 and 1402621599 Missing descriptors for photos 1402621599 and 1402621597 Missing descriptors for photos 1402621597 and 1402621620 Missing descriptors for photos 1402621620 and 1402621618 Missing descriptors for photos 1402621618 and 1402621644 Missing descriptors for photos 1402621644 and 1402621667 Missing descriptors for photos 1402621667 and 1402621663 Missing descriptors for photos 1402621663 and 1402621688 Missing descriptors for photos 1402621688 and 1402621685 Missing descriptors for photos 1402621685 and 1402621693 Missing descriptors for photos 1402621693 and 1402621705 Missing descriptors for photos 1402621705 and 1402621730 Missing descriptors for photos 1402621730 and 1402621727 Missing descriptors for photos 1402621727 and 1402621743 Missing descriptors for photos 1402621743 and 1402621786 Missing descriptors for photos 1402621786 and 1402621741 Missing descriptors for photos 1402621741 and 1402621783 Missing descriptors for photos 1402621783 and 1402622617 Missing descriptors for photos 1402622617 and 1402623512 Missing descriptors for photos 1402623512 and 1402623472 Missing descriptors for photos 1402623472 and 1402623678 Missing descriptors for photos 1402623678 and 1402623812 Missing descriptors for photos 1402623812 and 1402623833 Missing descriptors for photos 1402623833 and 1402623852 Missing descriptors for photos 1402623852 and 1402623878 Missing descriptors for photos 1402623878 and 1402623876 Missing descriptors for photos 1402623876 and 1402623919 Missing descriptors for photos 1402623919 and 1402623941 Missing descriptors for photos 1402623941 and 1402623963 Missing descriptors for photos 1402623963 and 1402624009 Missing descriptors for photos 1402624009 and 1402623961 Missing descriptors for photos 1402623961 and 1402624007 Missing descriptors for photos 1402624007 and 1402624165 Missing descriptors for photos 1402624165 and 1402624223 Missing descriptors for photos 1402624223 and 1402624220 Missing descriptors for photos 1402624220 and 1402624216 Missing descriptors for photos 1402624216 and 1402624213 Missing descriptors for photos 1402624213 and 1402624236 Missing descriptors for photos 1402624236 and 1402624233 Missing descriptors for photos 1402624233 and 1402624264 Missing descriptors for photos 1402624264 and 1402624261 Missing descriptors for photos 1402624261 and 1402624283 Missing descriptors for photos 1402624283 and 1402624304 Missing descriptors for photos 1402624304 and 1402624302 Missing descriptors for photos 1402624302 and 1402624330 Missing descriptors for photos 1402624330 and 1402624327 Missing descriptors for photos 1402624327 and 1402624366 Missing descriptors for photos 1402624366 and 1402624364 Missing descriptors for photos 1402624364 and 1402624391 Missing descriptors for photos 1402624391 and 1402624434 Missing descriptors for photos 1402624434 and 1402624389 Missing descriptors for photos 1402624389 and 1402624432 Missing descriptors for photos 1402624432 and 1402624598 Missing descriptors for photos 1402624598 and 1402624618 Missing descriptors for photos 1402624618 and 1402624645 Missing descriptors for photos 1402624645 and 1402624643 Missing descriptors for photos 1402624643 and 1402624671 Missing descriptors for photos 1402624671 and 1402624688 Missing descriptors for photos 1402624688 and 1402624668 Missing descriptors for photos 1402624668 and 1402624718 Missing descriptors for photos 1402624718 and 1402624736 Missing descriptors for photos 1402624736 and 1402624754 Missing descriptors for photos 1402624754 and 1402624798 Missing descriptors for photos 1402624798 and 1402624796 Missing descriptors for photos 1402624796 and 1402624815 Missing descriptors for photos 1402624815 and 1402624866 Missing descriptors for photos 1402624866 and 1402625617 Missing descriptors for photos 1402625617 and 1402626194 Missing descriptors for photos 1402626194 and 1402626154 Missing descriptors for photos 1402626154 and 1402626591 Missing descriptors for photos 1402626591 and 1402626978 Missing descriptors for photos 1402626978 and 1402626976 Missing descriptors for photos 1402626976 and 1402626996 Missing descriptors for photos 1402626996 and 1402626993 Missing descriptors for photos 1402626993 and 1402627030 Missing descriptors for photos 1402627030 and 1402627028 Missing descriptors for photos 1402627028 and 1402627050 Missing descriptors for photos 1402627050 and 1402627047 Missing descriptors for photos 1402627047 and 1402627080 Missing descriptors for photos 1402627080 and 1402627097 Missing descriptors for photos 1402627097 and 1402627136 Missing descriptors for photos 1402627136 and 1402627095 Missing descriptors for photos 1402627095 and 1402627138 Missing descriptors for photos 1402627138 and 1402627256 Missing descriptors for photos 1402627256 and 1402627280 Missing descriptors for photos 1402627280 and 1402627277 Missing descriptors for photos 1402627277 and 1402627357 Missing descriptors for photos 1402627357 and 1402627355 Missing descriptors for photos 1402627355 and 1402627383 Missing descriptors for photos 1402627383 and 1402627427 Missing descriptors for photos 1402627427 and 1402627382 Missing descriptors for photos 1402627382 and 1402627430 Missing descriptors for photos 1402627430 and 1402627432 Missing descriptors for photos 1402627432 and 1402627434 Missing descriptors for photos 1402627434 and 1402627443 Missing descriptors for photos 1402627443 and 1402627441 Missing descriptors for photos 1402627441 and 1402627468 Missing descriptors for photos 1402627468 and 1402627486 Missing descriptors for photos 1402627486 and 1402627484 Missing descriptors for photos 1402627484 and 1402627529 Missing descriptors for photos 1402627529 and 1402627684 Missing descriptors for photos 1402627684 and 1402627697 Missing descriptors for photos 1402627697 and 1402627720 Missing descriptors for photos 1402627720 and 1402627728 Missing descriptors for photos 1402627728 and 1402627747 Missing descriptors for photos 1402627747 and 1402627770 Missing descriptors for photos 1402627770 and 1402627787 Missing descriptors for photos 1402627787 and 1402627785 Missing descriptors for photos 1402627785 and 1402627829 Missing descriptors for photos 1402627829 and 1402627845 Missing descriptors for photos 1402627845 and 1402627887 Missing descriptors for photos 1402627887 and 1402627843 Missing descriptors for photos 1402627843 and 1402627891 Missing descriptors for photos 1402627891 and 1402627892 Missing descriptors for photos 1402627892 and 1402627901 Missing descriptors for photos 1402627901 and 1402627899 Missing descriptors for photos 1402627899 and 1402627930 Missing descriptors for photos 1402627930 and 1402627945 Missing descriptors for photos 1402627945 and 1402627962 Missing descriptors for photos 1402627962 and 1402627981 Missing descriptors for photos 1402627981 and 1402628009 Missing descriptors for photos 1402628009 and 1402628047 Missing descriptors for photos 1402628047 and 1402628007 Missing descriptors for photos 1402628007 and 1402628048 Missing descriptors for photos 1402628048 and 1402628616 Missing descriptors for photos 1402628616 and 1402628363 Missing descriptors for photos 1402628363 and 1402628637 Missing descriptors for photos 1402628637 and 1402628634 Missing descriptors for photos 1402628634 and 1402628654 Missing descriptors for photos 1402628654 and 1402628667 Missing descriptors for photos 1402628667 and 1402628686 Missing descriptors for photos 1402628686 and 1402628683 Missing descriptors for photos 1402628683 and 1402628709 Missing descriptors for photos 1402628709 and 1402628706 Missing descriptors for photos 1402628706 and 1402628721 Missing descriptors for photos 1402628721 and 1402628778 Missing descriptors for photos 1402628778 and 1402628811 Missing descriptors for photos 1402628811 and 1402632495 Missing descriptors for photos 1402632495 and 1402632521 Missing descriptors for photos 1402632521 and 1402632548 Missing descriptors for photos 1402632548 and 1402632545 Missing descriptors for photos 1402632545 and 1402632570 Missing descriptors for photos 1402632570 and 1402632595 Missing descriptors for photos 1402632595 and 1402632592 Missing descriptors for photos 1402632592 and 1402632639 Missing descriptors for photos 1402632639 and 1402632668 Missing descriptors for photos 1402632668 and 1402632666 Missing descriptors for photos 1402632666 and 1402632698 Missing descriptors for photos 1402632698 and 1402632694 Missing descriptors for photos 1402632694 and 1402632723 Missing descriptors for photos 1402632723 and 1402632720 Missing descriptors for photos 1402632720 and 1402632738 Missing descriptors for photos 1402632738 and 1402632764 Missing descriptors for photos 1402632764 and 1402632784 Missing descriptors for photos 1402632784 and 1402632816 Missing descriptors for photos 1402632816 and 1402632813 Missing descriptors for photos 1402632813 and 1402632838 Missing descriptors for photos 1402632838 and 1402632887 Missing descriptors for photos 1402632887 and 1402632884 Missing descriptors for photos 1402632884 and 1402632907 Missing descriptors for photos 1402632907 and 1402632905 Missing descriptors for photos 1402632905 and 1402632937 Missing descriptors for photos 1402632937 and 1402632949 Missing descriptors for photos 1402632949 and 1402633020 Missing descriptors for photos 1402633020 and 1402632966 Missing descriptors for photos 1402632966 and 1402633017 Missing descriptors for photos 1402633017 and 1402633043 Missing descriptors for photos 1402633043 and 1402633063 Missing descriptors for photos 1402633063 and 1402633089 Missing descriptors for photos 1402633089 and 1402633115 Missing descriptors for photos 1402633115 and 1402633136 Missing descriptors for photos 1402633136 and 1402633134 Missing descriptors for photos 1402633134 and 1402633154 Missing descriptors for photos 1402633154 and 1402633184 Missing descriptors for photos 1402633184 and 1402633202 Missing descriptors for photos 1402633202 and 1402633265 Missing descriptors for photos 1402633265 and 1402633197 Missing descriptors for photos 1402633197 and 1402633264 Missing descriptors for photos 1402633264 and 1402633263 Missing descriptors for photos 1402633263 and 1402633262 Missing descriptors for photos 1402633262 and 1402633259 Missing descriptors for photos 1402633259 and 1402633256 Missing descriptors for photos 1402633256 and 1402633279 Missing descriptors for photos 1402633279 and 1402633294 Missing descriptors for photos 1402633294 and 1402633289 Missing descriptors for photos 1402633289 and 1402633329 Missing descriptors for photos 1402633329 and 1402633326 Missing descriptors for photos 1402633326 and 1402633347 Missing descriptors for photos 1402633347 and 1402633345 Missing descriptors for photos 1402633345 and 1402633390 Missing descriptors for photos 1402633390 and 1402633411 Missing descriptors for photos 1402633411 and 1402633410 Missing descriptors for photos 1402633410 and 1402633436 Missing descriptors for photos 1402633436 and 1402633489 Missing descriptors for photos 1402633489 and 1402633435 Missing descriptors for photos 1402633435 and 1402633485 Missing descriptors for photos 1402633485 and 1402635671 Missing descriptors for photos 1402635671 and 1402634043 Missing descriptors for photos 1402634043 and 1402640745 Missing descriptors for photos 1402640745 and 1402644442 Missing descriptors for photos 1402644442 and 1402644531 Missing descriptors for photos 1402644531 and 1402640837 Missing descriptors for photos 1402640837 and 1402641618 Missing descriptors for photos 1402641618 and 1402644529 Missing descriptors for photos 1402644529 and 1402644594 Missing descriptors for photos 1402644594 and 1402644612 Missing descriptors for photos 1402644612 and 1402644737 Missing descriptors for photos 1402644737 and 1402644758 Missing descriptors for photos 1402644758 and 1402644823 Missing descriptors for photos 1402644823 and 1402644755 Missing descriptors for photos 1402644755 and 1402644826 Missing descriptors for photos 1402644826 and 1402644828 Missing descriptors for photos 1402644828 and 1402644836 Missing descriptors for photos 1402644836 and 1402644879 Missing descriptors for photos 1402644879 and 1402644917 Missing descriptors for photos 1402644917 and 1402645344 Missing descriptors for photos 1402645344 and 1402645835 Missing descriptors for photos 1402645835 and 1402647178 Missing descriptors for photos 1402647178 and 1402646971 Missing descriptors for photos 1402646971 and 1402647253 Missing descriptors for photos 1402647253 and 1402647249 Missing descriptors for photos 1402647249 and 1402647278 Missing descriptors for photos 1402647278 and 1402647306 Missing descriptors for photos 1402647306 and 1402647304 Missing descriptors for photos 1402647304 and 1402647327 Missing descriptors for photos 1402647327 and 1402647356 Missing descriptors for photos 1402647356 and 1402647413 Missing descriptors for photos 1402647413 and 1402647463 Missing descriptors for photos 1402647463 and 1402647485 Missing descriptors for photos 1402647485 and 1402647534 Missing descriptors for photos 1402647534 and 1402647533 Missing descriptors for photos 1402647533 and 1402647582 Missing descriptors for photos 1402647582 and 1402647578 Missing descriptors for photos 1402647578 and 1402647619 Missing descriptors for photos 1402647619 and 1402647640 Missing descriptors for photos 1402647640 and 1402647639 Missing descriptors for photos 1402647639 and 1402647702 Missing descriptors for photos 1402647702 and 1402647699 Missing descriptors for photos 1402647699 and 1402647718 Missing descriptors for photos 1402647718 and 1402647736 Missing descriptors for photos 1402647736 and 1402647733 Missing descriptors for photos 1402647733 and 1402647834 Missing descriptors for photos 1402647834 and 1402647822 Missing descriptors for photos 1402647822 and 1402647863 Missing descriptors for photos 1402647863 and 1402647859 Missing descriptors for photos 1402647859 and 1402647902 Missing descriptors for photos 1402647902 and 1402647880 Missing descriptors for photos 1402647880 and 1402647893 Missing descriptors for photos 1402647893 and 1402647958 Missing descriptors for photos 1402647958 and 1402647955 Missing descriptors for photos 1402647955 and 1402648043 Missing descriptors for photos 1402648043 and 1402648099 Missing descriptors for photos 1402648099 and 1402648100 Missing descriptors for photos 1402648100 and 1402648123 Missing descriptors for photos 1402648123 and 1402648120 Missing descriptors for photos 1402648120 and 1402648155 Missing descriptors for photos 1402648155 and 1402648187 Missing descriptors for photos 1402648187 and 1402648581 Missing descriptors for photos 1402648581 and 1402648553 Missing descriptors for photos 1402648553 and 1402648703 Missing descriptors for photos 1402648703 and 1402648750 Missing descriptors for photos 1402648750 and 1402649011 Missing descriptors for photos 1402649011 and 1402650796 Missing descriptors for photos 1402650796 and 1402650865 Missing descriptors for photos 1402650865 and 1402650794 Missing descriptors for photos 1402650794 and 1402650864 Missing descriptors for photos 1402650864 and 1402650863 Missing descriptors for photos 1402650863 and 1402650849 Missing descriptors for photos 1402650849 and 1402650845 Missing descriptors for photos 1402650845 and 1402650869 Missing descriptors for photos 1402650869 and 1402651130 Missing descriptors for photos 1402651130 and 1402651127 Missing descriptors for photos 1402651127 and 1402651124 Missing descriptors for photos 1402651124 and 1402651122 Missing descriptors for photos 1402651122 and 1402651145 Missing descriptors for photos 1402651145 and 1402651142 Missing descriptors for photos 1402651142 and 1402651163 Missing descriptors for photos 1402651163 and 1402651218 Missing descriptors for photos 1402651218 and 1402651241 Missing descriptors for photos 1402651241 and 1402651238 Missing descriptors for photos 1402651238 and 1402651351 Missing descriptors for photos 1402651351 and 1402651437 Missing descriptors for photos 1402651437 and 1402651436 Missing descriptors for photos 1402651436 and 1402651434 Missing descriptors for photos 1402651434 and 1402651432 Missing descriptors for photos 1402651432 and 1402651427 Missing descriptors for photos 1402651427 and 1402651444 Missing descriptors for photos 1402651444 and 1402651476 Missing descriptors for photos 1402651476 and 1402651500 Missing descriptors for photos 1402651500 and 1402651519 Missing descriptors for photos 1402651519 and 1402651570 Missing descriptors for photos 1402651570 and 1402651924 Missing descriptors for photos 1402651924 and 1402651736 Missing descriptors for photos 1402651736 and 1402651953 Missing descriptors for photos 1402651953 and 1402651948 Missing descriptors for photos 1402651948 and 1402652220 Missing descriptors for photos 1402652220 and 1402652323 Missing descriptors for photos 1402652323 and 1402652319 Missing descriptors for photos 1402652319 and 1402652342 Missing descriptors for photos 1402652342 and 1402652497 Missing descriptors for photos 1402652497 and 1402652520 Missing descriptors for photos 1402652520 and 1402652578 Missing descriptors for photos 1402652578 and 1402652575 Missing descriptors for photos 1402652575 and 1402652621 Missing descriptors for photos 1402652621 and 1402653067 Missing descriptors for photos 1402653067 and 1402653780 Missing descriptors for photos 1402653780 and 1402655687 Missing descriptors for photos 1402655687 and 1402656135 Missing descriptors for photos 1402656135 and 1402656129 Missing descriptors for photos 1402656129 and 1402656381 Missing descriptors for photos 1402656381 and 1402656380 Missing descriptors for photos 1402657703 and 1402658622 Missing descriptors for photos 1402658622 and 1402658663 Missing descriptors for photos 1402658663 and 1402658621 Missing descriptors for photos 1402658621 and 1402658661 Missing descriptors for photos 1402658661 and 1402658678 Missing descriptors for photos 1402658678 and 1402658675 Missing descriptors for photos 1402658675 and 1402658714 Missing descriptors for photos 1402658714 and 1402658729 Missing descriptors for photos 1402658729 and 1402658749 Missing descriptors for photos 1402658749 and 1402658747 Missing descriptors for photos 1402658747 and 1402658770 Missing descriptors for photos 1402658770 and 1402658792 Missing descriptors for photos 1402658792 and 1402658812 Missing descriptors for photos 1402658812 and 1402658882 Missing descriptors for photos 1402658882 and 1402658811 Missing descriptors for photos 1402658811 and 1402658881 Missing descriptors for photos 1402658881 and 1402658879 Missing descriptors for photos 1402658879 and 1402658877 Missing descriptors for photos 1402658877 and 1402658874 Missing descriptors for photos 1402658955 and 1402658952 Missing descriptors for photos 1402658952 and 1402658983 Missing descriptors for photos 1402658983 and 1402658980 Missing descriptors for photos 1402658980 and 1402659010 ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1402659080 photo_id_prec : 1402659053 Missing descriptors for photos 1402659080 and 1402659077 Missing descriptors for photos 1402659077 and 1402659096 Missing descriptors for photos 1402659096 and 1402659184 Missing descriptors for photos 1402659184 and 1402659093 Missing descriptors for photos 1402659093 and 1402659175 Missing descriptors for photos 1402659175 and 1402659158 Missing descriptors for photos 1402659158 and 1402659156 Missing descriptors for photos 1402659156 and 1402659153 Missing descriptors for photos 1402659153 and 1402659207 Missing descriptors for photos 1402659207 and 1402659205 Missing descriptors for photos 1402659205 and 1402659223 Missing descriptors for photos 1402659223 and 1402659221 06012026 Removing 0 photos because of the 'same image' condition Total on : 0 Total off : 0.0 list_time_off Warning in study_and_display_distrib_list : min=max : 0.0 0.0 dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 516 time used for this insertion : 0.10925459861755371 photos_removed : len 0 elapsed_time : remove_photo_duplicate 0.1919701099395752 Creating list_photo_total Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null Warning list_scores null time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! ERROR ! elapsed_time : count_sum_diff_and_build_graph 0.010413885116577148 Total photos : 516 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 0 hashtag : 495916461 photo_id =1402657293 : jrm ....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 4 hashtag : 616987804 photo_id =1402658868 : emr .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 5 hashtag : 2107760238 photo_id =1402659007 : flux_dev .. Total photos : 516 Number of lists : 4 counter photos in port : 12 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 5 photos in 1 portfolios ! hashtag : film_pedb(2107760237) : 0 photos in 0 portfolios ! hashtag : flux_dev(2107760238) : 3 photos in 1 portfolios ! hashtag : jrm(495916461) : 4 photos in 1 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 0 photos in 0 portfolios ! hashtag : pet_clair(2107755846) : 0 photos in 0 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.016885995864868164 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 3.814697265625e-06 today str has not a value , we define it as the date of the first image todaystr_first : 06012026 attention , prev_timestamp is 0 , we do nothing ***************o******o*o********o*oo*o*oo*o******o*oo*o********o*o***oo******o*****o*o*o*********oo*********************o*o**********o*oo***********oo**********o**********o*o*****oo**************o*o******oo*********o*****************************o*o******o*o***o******o******o********************o*********o*o**********o**************************o* BIG TIME 300.0003218650818 (91.00042510032654, 5, 0, 0, 0, 0, 0, 0.8880672, 0, 0, 0, 0, 0, 0, 4.881000004482269, 0.047, 0.0, 1.9, 0.12100071787834167, -0.15166608810424806) on 4 1402658621 2026-01-06 14:10:04.029763 id_data : 473 o********o*o*********Unexpected type of data : ({'photo_id': 1402659080, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/71513ff90a5cd5c04034087b1b42ad56.jpg', 'username': None, 'uploaded_at': 1767706232, 'text': 'image_06012026_14_28_34_29692.jpg', 'time': 1767709714.029692}, 'different') Unexpected type of data : ({'photo_id': 1402659077, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/097ace746d00a2756a53de46950ed4fb.jpg', 'username': None, 'uploaded_at': 1767706232, 'text': 'image_06012026_14_29_05_30466.jpg', 'time': 1767709745.030466}, 'different') Unexpected type of data : ({'photo_id': 1402659096, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/2a7bccf75fab875f77209e0aef419c7d.jpg', 'username': None, 'uploaded_at': 1767706276, 'text': 'image_06012026_14_29_34_29614.jpg', 'time': 1767709774.029614}, 'different') Unexpected type of data : ({'photo_id': 1402659184, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/ed9623e638152e8587cda5e993754f4f.jpg', 'username': None, 'uploaded_at': 1767706412, 'text': 'image_06012026_14_29_34_29614.jpg', 'time': 1767709774.029614}, 'different') Unexpected type of data : ({'photo_id': 1402659093, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/8caaaadd9560aa2f882dd1038a01c0ef.jpg', 'username': None, 'uploaded_at': 1767706276, 'text': 'image_06012026_14_30_05_30962.jpg', 'time': 1767709805.030962}, 'different') Unexpected type of data : ({'photo_id': 1402659175, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/7ffb623231b4ba4a7f34da5e5f90c5f6.jpg', 'username': None, 'uploaded_at': 1767706412, 'text': 'image_06012026_14_30_05_30962.jpg', 'time': 1767709805.030962}, 'different') Unexpected type of data : ({'photo_id': 1402659158, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/773909effd6b2d4be428973abf5ef728.jpg', 'username': None, 'uploaded_at': 1767706412, 'text': 'image_06012026_14_30_34_29375.jpg', 'time': 1767709834.029375}, 'different') Unexpected type of data : ({'photo_id': 1402659156, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/7ebccc81151b045d597fc8639d93599f.jpg', 'username': None, 'uploaded_at': 1767706412, 'text': 'image_06012026_14_31_05_30629.jpg', 'time': 1767709865.030629}, 'different') Unexpected type of data : ({'photo_id': 1402659153, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/019ce24707365b82b9e49eb2a9eb84ca.jpg', 'username': None, 'uploaded_at': 1767706412, 'text': 'image_06012026_14_31_34_29284.jpg', 'time': 1767709894.029284}, 'different') Unexpected type of data : ({'photo_id': 1402659207, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/c29b40dcac82da3d70d205fd5ba46495.jpg', 'username': None, 'uploaded_at': 1767706456, 'text': 'image_06012026_14_32_35_29445.jpg', 'time': 1767709955.029445}, 'different') Unexpected type of data : ({'photo_id': 1402659205, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/c803250366142eb2adae01873f1fced0.jpg', 'username': None, 'uploaded_at': 1767706456, 'text': 'image_06012026_14_33_05_30531.jpg', 'time': 1767709985.030531}, 'different') Unexpected type of data : ({'photo_id': 1402659223, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/06c67023ec5c6553d6ed51e21d1c79b3.jpg', 'username': None, 'uploaded_at': 1767706515, 'text': 'image_06012026_14_33_34_29029.jpg', 'time': 1767710014.029029}, 'different') Unexpected type of data : ({'photo_id': 1402659221, 'url': 'https://storage.sbg.cloud.ovh.net/v1/AUTH_3b171620e76e4af496c5fd050759c9f0/media.fotonower.com/2026/1/6/c8e3d11bfad17f94ad12174c83135a0f.jpg', 'username': None, 'uploaded_at': 1767706515, 'text': 'image_06012026_14_34_05_30884.jpg', 'time': 1767710045.030884}, 'different') Count Time bigger than 30s : 313 #Number Photos for regression : {'06012026': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 0, 2107751014: 90.0006639957428, 2107751015: 30.000247955322266, 2107751016: 0, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 0, 2107751015: 28.999040842056274, 2107751016: 0, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 0, 2107751015: 61.002115964889526, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 0, 2107751015: 60.00135779380798, 2107751016: 60.99936008453369, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 29.998780965805054, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 17520.99454522133, 2107751016: 0, 2107751017: 0}}} 06012026|aluminium, 05102018_papier_non_papier_dense:0 06012026|aluminium, 05102018_papier_non_papier_peu_dense:0 06012026|aluminium, 05102018_papier_non_papier_presque_vide:0 06012026|aluminium, 05102018_papier_non_papier_tres_dense:0 06012026|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 06012026|ela, 05102018_papier_non_papier_dense:0 06012026|ela, 05102018_papier_non_papier_peu_dense:0 06012026|ela, 05102018_papier_non_papier_presque_vide:0 06012026|ela, 05102018_papier_non_papier_tres_dense:0 06012026|ela, 05102018_papier_non_papier_tres_peu_dense:0 06012026|emr, 05102018_papier_non_papier_dense:0 06012026|emr, 05102018_papier_non_papier_peu_dense:90.0006639957428 06012026|emr, 05102018_papier_non_papier_presque_vide:30.000247955322266 06012026|emr, 05102018_papier_non_papier_tres_dense:0 06012026|emr, 05102018_papier_non_papier_tres_peu_dense:0 06012026|film_pedb, 05102018_papier_non_papier_dense:0 06012026|film_pedb, 05102018_papier_non_papier_peu_dense:0 06012026|film_pedb, 05102018_papier_non_papier_presque_vide:28.999040842056274 06012026|film_pedb, 05102018_papier_non_papier_tres_dense:0 06012026|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 06012026|flux_dev, 05102018_papier_non_papier_dense:0 06012026|flux_dev, 05102018_papier_non_papier_peu_dense:0 06012026|flux_dev, 05102018_papier_non_papier_presque_vide:61.002115964889526 06012026|flux_dev, 05102018_papier_non_papier_tres_dense:0 06012026|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 06012026|jrm, 05102018_papier_non_papier_dense:0 06012026|jrm, 05102018_papier_non_papier_peu_dense:0 06012026|jrm, 05102018_papier_non_papier_presque_vide:60.00135779380798 06012026|jrm, 05102018_papier_non_papier_tres_dense:60.99936008453369 06012026|jrm, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pcm, 05102018_papier_non_papier_dense:0 06012026|pcm, 05102018_papier_non_papier_peu_dense:0 06012026|pcm, 05102018_papier_non_papier_presque_vide:0 06012026|pcm, 05102018_papier_non_papier_tres_dense:0 06012026|pcm, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pcnc, 05102018_papier_non_papier_dense:0 06012026|pcnc, 05102018_papier_non_papier_peu_dense:0 06012026|pcnc, 05102018_papier_non_papier_presque_vide:0 06012026|pcnc, 05102018_papier_non_papier_tres_dense:0 06012026|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_peu_dense:29.998780965805054 06012026|pehd_pp, 05102018_papier_non_papier_presque_vide:0 06012026|pehd_pp, 05102018_papier_non_papier_tres_dense:0 06012026|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 06012026|pet_clair, 05102018_papier_non_papier_dense:0 06012026|pet_clair, 05102018_papier_non_papier_peu_dense:0 06012026|pet_clair, 05102018_papier_non_papier_presque_vide:0 06012026|pet_clair, 05102018_papier_non_papier_tres_dense:0 06012026|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 06012026|refus, 05102018_papier_non_papier_dense:0 06012026|refus, 05102018_papier_non_papier_peu_dense:0 06012026|refus, 05102018_papier_non_papier_presque_vide:0 06012026|refus, 05102018_papier_non_papier_tres_dense:0 06012026|refus, 05102018_papier_non_papier_tres_peu_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_peu_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_presque_vide:17520.99454522133 06012026|tapis_vide, 05102018_papier_non_papier_tres_dense:0 06012026|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 06012026_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 0 Number amount portfolio for this type of dechet : emr 4 Created to study and clean : 29984695 with name like 06012026_emr_05102018_papier_non_papier_peu_dense Created to study and clean : 29984718 with name like 06012026_emr_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : film_pedb 1 Created to study and clean : 29984721 with name like 06012026_film_pedb_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : flux_dev 2 Number amount portfolio for this type of dechet : jrm 4 Number amount portfolio for this type of dechet : pcm 0 Number amount portfolio for this type of dechet : pcnc 0 Number amount portfolio for this type of dechet : pehd_pp 1 Created to study and clean : 29984722 with name like 06012026_pehd_pp_05102018_papier_non_papier_peu_dense Number amount portfolio for this type of dechet : pet_clair 0 Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 445 Created to study and clean : 29984723 with name like 06012026_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 4 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['pcnc', 'gm', 'emr', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev_rigide', 'aluminium', 'tapis_vide', 'refus', 'gros_cartons', 'gm', 'flux_dev_rigide', 'gros_cartons'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! result_one_balle_Type_jrm:{'day': '06012026', 'map_nb_amount': {0: 0, 1: 2, 2: 2, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 60.00135779380798, 2: 60.99936008453369, 3: 0, 4: 0}, 'duration': 90.99965286254883, 'nb_balles_papier': 0.12100071787834167, 'begin_time_port': 'image_06012026_14_02_34_030184m0.jpg 0.030001065015792847 for time 30.001065015792847, id_amount 2 this amount prod time diff : 0.030001065015792847'} Production hashtag (incorrect ponderation at 20-10-18) : 0.12100071787834167 hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_emr:{'day': '06012026', 'map_nb_amount': {0: 4, 1: 1, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 119.99944496154785, 1: 30.000247955322266, 2: 0, 3: 0, 4: 0}, 'duration': 119.99949383735657, 'nb_balles_papier': 0.14999969291687013, 'begin_time_port': 'image_06012026_14_22_05_30337.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.14999969291687013 We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_flux_dev_rigide:{'day': '06012026', 'map_nb_amount': {0: 0, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 90.0011568069458, 2: 0, 3: 0, 4: 0}, 'duration': 58.999581813812256, 'nb_balles_papier': 0.0900011568069458, 'begin_time_port': 'image_06012026_14_27_05_30543.jpg'} Production hashtag (incorrect ponderation at 20-10-18) : 0.0900011568069458 We filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 3 type_dechet jrm not in list to create port, so we just list it with its name (VR TODO 3-6-19 : we need to change this) list_same_port_ids : [] list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11500 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 11508 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11509 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11504 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 11504 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 11507 merge_mask_thcl_custom have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11507 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11501 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 11576 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 11576 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 11503 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11502 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 11502 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11511 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11503 doesn't seem to be define in the database( WARNING : type of input 3 of step 11502 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 11500 doesn't seem to be define in the database( WARNING : type of input 2 of step 11504 doesn't seem to be define in the database( WARNING : output 1 of step 11500 have datatype=2 whereas input 1 of step 11507 have datatype=7 WARNING : type of output 2 of step 11507 doesn't seem to be define in the database( WARNING : type of input 1 of step 11501 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11503 have datatype=10 whereas input 3 of step 11510 have datatype=6 WARNING : type of input 2 of step 11576 doesn't seem to be define in the database( WARNING : output 1 of step 11501 have datatype=7 whereas input 2 of step 11576 have datatype=None WARNING : type of output 3 of step 11576 doesn't seem to be define in the database( WARNING : type of input 1 of step 11503 doesn't seem to be define in the database( WARNING : output 0 of step 11503 have datatype=10 whereas input 0 of step 11582 have datatype=18 WARNING : type of input 5 of step 11510 doesn't seem to be define in the database( WARNING : output 0 of step 11582 have datatype=11 whereas input 5 of step 11510 have datatype=None WARNING : type of output 1 of step 11508 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : type of output 1 of step 11509 doesn't seem to be define in the database( WARNING : type of input 3 of step 11504 doesn't seem to be define in the database( WARNING : output 0 of step 11507 have datatype=1 whereas input 0 of step 11501 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29984736 AND mptpi.`type`=4207 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 13185 mask_detect is not consistent : 3 used against 2 in the step definition ! WARNING : number of outputs for step 13193 brightness is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13194 blur_detection is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 13189 crop_condition is not consistent : 3 used against 2 in the step definition ! Step 13189 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used ! Step 13191 argmax have less outputs used (1) than in the step definition (2) : some outputs may be not used ! WARNING : number of outputs for step 13192 merge_mask_thcl_custom is not consistent : 3 used against 2 in the step definition ! WARNING : number of inputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 13186 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! Step 13197 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! WARNING : number of outputs for step 13197 crop_condition is not consistent : 4 used against 3 in the step definition ! WARNING : number of outputs for step 13188 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 13187 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs ! Step 13187 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 13196 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 13188 doesn't seem to be define in the database( WARNING : type of input 3 of step 13187 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 2 of step 13185 doesn't seem to be define in the database( WARNING : type of input 2 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13185 have datatype=16 whereas input 0 of step 13192 have datatype=1 WARNING : output 1 of step 13185 have datatype=2 whereas input 1 of step 13192 have datatype=7 WARNING : output 0 of step 13191 have datatype=6 whereas input 2 of step 13192 have datatype=5 WARNING : type of output 2 of step 13192 doesn't seem to be define in the database( WARNING : type of input 1 of step 13186 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 13188 have datatype=10 whereas input 3 of step 13195 have datatype=6 WARNING : type of input 2 of step 13197 doesn't seem to be define in the database( WARNING : output 1 of step 13186 have datatype=7 whereas input 2 of step 13197 have datatype=None WARNING : type of output 3 of step 13197 doesn't seem to be define in the database( WARNING : type of input 1 of step 13188 doesn't seem to be define in the database( WARNING : output 0 of step 13188 have datatype=10 whereas input 0 of step 13198 have datatype=18 WARNING : type of input 5 of step 13195 doesn't seem to be define in the database( WARNING : output 0 of step 13198 have datatype=11 whereas input 5 of step 13195 have datatype=None WARNING : type of output 1 of step 13193 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : type of output 1 of step 13194 doesn't seem to be define in the database( WARNING : type of input 3 of step 13189 doesn't seem to be define in the database( WARNING : output 0 of step 13192 have datatype=1 whereas input 0 of step 13186 have datatype=2 DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=29984749 AND mptpi.`type`=4200 To do elapsed_time : count_nb_balles_and_create_portfolio 49.73900246620178 # DISPLAY ALL COLLECTED DATA : {'06012026': {'nb_upload': 516, 'nb_taggue_class': 503, 'nb_taggue_densite': 503, 'nb_descriptors': 12, 'number_port': 4, 'count_photo_in_port': 12, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 5, 'nb_portfolios': 1}, 'film_pedb': {'nb_photos': 0, 'nb_portfolios': 0}, 'flux_dev': {'nb_photos': 3, 'nb_portfolios': 1}, 'jrm': {'nb_photos': 4, 'nb_portfolios': 1}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 0, 'nb_portfolios': 0}, 'pet_clair': {'nb_photos': 0, 'nb_portfolios': 0}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 1}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1402659223, 1402659221, 1402659207, 1402659205, 1402659184, 1402659175, 1402659158, 1402659156, 1402659153, 1402659096, 1402659093, 1402659080, 1402659077, 1402659066, 1402659053, 1402659010, 1402659007, 1402658983, 1402658980, 1402658955, 1402658952, 1402658914, 1402658911, 1402658888, 1402658886, 1402658882, 1402658881, 1402658879, 1402658877, 1402658874, 1402658868, 1402658812, 1402658811, 1402658792, 1402658770, 1402658749, 1402658747, 1402658729, 1402658714, 1402658678, 1402658675, 1402658663, 1402658661, 1402658622, 1402658621, 1402657703, 1402657583, 1402657559, 1402657293, 1402657236, 1402656381, 1402656380, 1402656135, 1402656129, 1402655687, 1402653780, 1402653067, 1402652621, 1402652578, 1402652575, 1402652520, 1402652497, 1402652342, 1402652323, 1402652319, 1402652220, 1402651953, 1402651948, 1402651924, 1402651736, 1402651570, 1402651519, 1402651500, 1402651476, 1402651444, 1402651437, 1402651436, 1402651434, 1402651432, 1402651427, 1402651351, 1402651241, 1402651238, 1402651218, 1402651163, 1402651145, 1402651142, 1402651130, 1402651127, 1402651124, 1402651122, 1402650869, 1402650865, 1402650864, 1402650863, 1402650849, 1402650845, 1402650796, 1402650794, 1402649011] Looping around the photos to save general results len do output : 1 /29979604Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659223', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659221', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659207', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659205', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659184', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659175', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659158', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659156', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659153', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659096', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659093', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659080', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659077', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659066', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659053', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659010', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402659007', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658983', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658980', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658955', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658952', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658914', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658911', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658888', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658886', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658882', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658881', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658879', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658877', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658874', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658868', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658812', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658811', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658792', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658770', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658749', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658747', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658729', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658714', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658678', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658675', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658663', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658661', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658622', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402658621', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402657703', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402657583', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402657559', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402657293', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402657236', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402656381', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402656380', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402656135', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402656129', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402655687', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402653780', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402653067', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652621', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652578', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652575', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652520', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652497', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652342', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652323', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652319', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402652220', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651953', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651948', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651924', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651736', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651570', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651519', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651500', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651476', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651444', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651437', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651436', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651434', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651432', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651427', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651351', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651241', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651238', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651218', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651163', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651145', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651142', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651130', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651127', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651124', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402651122', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650869', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650865', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650864', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650863', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650849', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650845', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650796', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402650794', None, None, None, None, None, '4317307') ('4323', None, None, None, None, None, None, None, '4317307') ('4323', '29979604', '1402649011', None, None, None, None, None, '4317307') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.030892610549926758 save_final save missing photos in datou_result : time spend for datou_step_exec : 51.2959725856781 time spend to save output : 0.03171682357788086 total time spend for step 1 : 51.32768940925598 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.41user 0.56system 0:54.91elapsed 3%CPU (0avgtext+0avgdata 111832maxresident)k 0inputs+304outputs (0major+52881minor)pagefaults 0swaps