python /home/admin/mtr/script_for_cron.py -j default -m 20 -a 'python3 ~/workarea/git/Velours/python/prod/datou.py -j batch_current -a 4960' -s traitement_sts -M 0 -S 0 -U 100,80,95 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/home/admin/workarea/git/apy', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3121 load datou : 4960 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Current got : datou_id : 4960, datou_cur_ids : ['4017107'] with mtr_portfolio_ids : ['24409098'] and first list_photo_ids : [] new path : /proc/3121/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.08834075927734375 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Fri Nov 7 15:55:11 2025 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3847, 'mtr_user_id': 31, 'name': 'learn_MM_generique_050224', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,emr,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '13096157,13096155,13096163,13096159,13301956,13095886,13096162,13096160,13358264,13096158,5515868,13276803', 'photo_hashtag_type': 4932, 'photo_desc_type': 6032, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,616987804,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('00', 29), ('01', 19), ('02', 30), ('03', 9), ('04', 12), ('05', 365), ('06', 66)) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 530} 30062025 24409098 Nombre de photos uploadées : 530 / 23040 (2%) 30062025 24409098 Nombre de photos taguées (types de déchets): 530 / 530 (100%) 30062025 24409098 Nombre de photos taguées (volume) : 530 / 530 (100%) elapsed_time : load_data_split_time_score 1.9073486328125e-06 elapsed_time : order_list_meta_photo_and_scores 0.00021195411682128906 elapsed_time : fill_and_build_computed_from_old_data 0.04650115966796875 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.22261714935302734 Creating list_photo_total elapsed_time : select_descriptors 34.08392333984375 30062025 24409098 Nombre de photos avec descriptors (type 6032) : 309 / 309 (100%) Missing descriptors for photos 0 and 1368846059 0:00:00|ON:Missing descriptors for photos 1368846059 and 1368846055 Missing descriptors for photos 1368846055 and 1368846082 Missing descriptors for photos 1368846082 and 1368846076 Missing descriptors for photos 1368846076 and 1368847075 Missing descriptors for photos 1368847075 and 1368848319 Missing descriptors for photos 1368848319 and 1368848507 Missing descriptors for photos 1368848507 and 1368849587 Missing descriptors for photos 1368849587 and 1368848631 Missing descriptors for photos 1368848631 and 1368850271 Missing descriptors for photos 1368850271 and 1368850220 Missing descriptors for photos 1368850220 and 1368850365 Missing descriptors for photos 1368850365 and 1368850361 Missing descriptors for photos 1368850361 and 1368850458 Missing descriptors for photos 1368850458 and 1368850520 Missing descriptors for photos 1368850520 and 1368850565 Missing descriptors for photos 1368850565 and 1368850516 Missing descriptors for photos 1368850516 and 1368851531 Missing descriptors for photos 1368851531 and 1368851505 Missing descriptors for photos 1368851505 and 1368851570 Missing descriptors for photos 1368851570 and 1368851630 Missing descriptors for photos 1368851630 and 1368851775 Missing descriptors for photos 1368851775 and 1368851851 Missing descriptors for photos 1368851851 and 1368851768 Missing descriptors for photos 1368851768 and 1368851852 Missing descriptors for photos 1368851852 and 1368851858 Missing descriptors for photos 1368851858 and 1368851880 Missing descriptors for photos 1368851880 and 1368851879 Missing descriptors for photos 1368851879 and 1368853811 Missing descriptors for photos 1368853811 and 1368854044 Missing descriptors for photos 1368854044 and 1368854041 Missing descriptors for photos 1368854041 and 1368854035 Missing descriptors for photos 1368854035 and 1368854623 Missing descriptors for photos 1368854623 and 1368854619 Missing descriptors for photos 1368854619 and 1368854690 Missing descriptors for photos 1368854690 and 1368854684 Missing descriptors for photos 1368854684 and 1368854695 Missing descriptors for photos 1368854695 and 1368854716 Missing descriptors for photos 1368854716 and 1368854713 Missing descriptors for photos 1368854713 and 1368854733 Missing descriptors for photos 1368854733 and 1368854888 Missing descriptors for photos 1368854888 and 1368855371 Missing descriptors for photos 1368855371 and 1368855167 Missing descriptors for photos 1368855167 and 1368855375 Missing descriptors for photos 1368855375 and 1368857766 Missing descriptors for photos 1368857766 and 1368857821 Missing descriptors for photos 1368857821 and 1368857882 Missing descriptors for photos 1368857882 and 1368855564 Missing descriptors for photos 1368855564 and 1368857825 Missing descriptors for photos 1368857825 and 1368857877 Missing descriptors for photos 1368857877 and 1368857873 Missing descriptors for photos 1368857873 and 1368857782 Missing descriptors for photos 1368857782 and 1368857806 Missing descriptors for photos 1368857806 and 1368857871 Missing descriptors for photos 1368857871 and 1368858146 Missing descriptors for photos 1368858146 and 1368858031 Missing descriptors for photos 1368858031 and 1368858254 Missing descriptors for photos 1368858254 and 1368858276 Missing descriptors for photos 1368858276 and 1368858299 Missing descriptors for photos 1368858299 and 1368858270 Missing descriptors for photos 1368858270 and 1368858468 Missing descriptors for photos 1368858468 and 1368858423 Missing descriptors for photos 1368858423 and 1368858472 Missing descriptors for photos 1368858472 and 1368858453 Missing descriptors for photos 1368858453 and 1368858476 Missing descriptors for photos 1368858476 and 1368858451 Missing descriptors for photos 1368858451 and 1368858481 Missing descriptors for photos 1368858481 and 1368858566 Missing descriptors for photos 1368858566 and 1368858563 Missing descriptors for photos 1368858563 and 1368858568 Missing descriptors for photos 1368858568 and 1368858602 Missing descriptors for photos 1368858602 and 1368858746 Missing descriptors for photos 1368858746 and 1368858774 Missing descriptors for photos 1368858774 and 1368858857 Missing descriptors for photos 1368858857 and 1368858897 Missing descriptors for photos 1368858897 and 1368858901 Missing descriptors for photos 1368858901 and 1368858942 Missing descriptors for photos 1368858942 and 1368860723 Missing descriptors for photos 1368860723 and 1368861267 Missing descriptors for photos 1368861267 and 1368861411 Missing descriptors for photos 1368861411 and 1368861682 Missing descriptors for photos 1368861682 and 1368861428 Missing descriptors for photos 1368861428 and 1368861678 Missing descriptors for photos 1368861678 and 1368864251 Missing descriptors for photos 1368864251 and 1368861952 Missing descriptors for photos 1368861952 and 1368862102 Missing descriptors for photos 1368862102 and 1368862611 Missing descriptors for photos 1368862611 and 1368864398 Missing descriptors for photos 1368864398 and 1368864395 Missing descriptors for photos 1368864395 and 1368864533 Missing descriptors for photos 1368864533 and 1368864435 Missing descriptors for photos 1368864435 and 1368864802 Missing descriptors for photos 1368864802 and 1368864852 Missing descriptors for photos 1368864852 and 1368864849 Missing descriptors for photos 1368864849 and 1368864879 Missing descriptors for photos 1368864879 and 1368865404 Missing descriptors for photos 1368865404 and 1368865520 Missing descriptors for photos 1368865520 and 1368866843 Missing descriptors for photos 1368866843 and 1368867216 Missing descriptors for photos 1368867216 and 1368867584 Missing descriptors for photos 1368867584 and 1368867413 Missing descriptors for photos 1368867413 and 1368867707 Missing descriptors for photos 1368867707 and 1368867697 Missing descriptors for photos 1368867697 and 1368867755 Missing descriptors for photos 1368867755 and 1368867753 Missing descriptors for photos 1368867753 and 1368867749 Missing descriptors for photos 1368867749 and 1368867746 Missing descriptors for photos 1368867746 and 1368867743 Missing descriptors for photos 1368867743 and 1368867739 Missing descriptors for photos 1368867739 and 1368867779 Missing descriptors for photos 1368867779 and 1368867777 Missing descriptors for photos 1368867777 and 1368867775 Missing descriptors for photos 1368867775 and 1368867773 Missing descriptors for photos 1368867773 and 1368867770 Missing descriptors for photos 1368867770 and 1368867768 5:14:38.998984|OFF:0:00:10.000162|ON:0:00:00|OFF:0:00:10.999974|ON:0:00:00|OFF:0:00:08.998762|ON:0:00:00|OFF:0:00:10.001174|ON:0:00:00|OFF:0:00:10.000096|ON:Missing descriptors for photos 1368867863 and 1368867862 Missing descriptors for photos 1368867862 and 1368868029 Missing descriptors for photos 1368868029 and 1368868035 Missing descriptors for photos 1368868035 and 1368868038 Missing descriptors for photos 1368868038 and 1368868044 Missing descriptors for photos 1368868044 and 1368868052 Missing descriptors for photos 1368868052 and 1368868055 Missing descriptors for photos 1368868055 and 1368867925 Missing descriptors for photos 1368867925 and 1368867922 Missing descriptors for photos 1368867922 and 1368867917 Missing descriptors for photos 1368867917 and 1368867914 0:03:09.999837|OFF:0:00:10.000140|ON:0:00:00|OFF:0:00:09.999879|ON:0:00:00|OFF:0:00:10.000024|ON:0:00:00|OFF:0:00:10.999981|ON:0:00:00|OFF:0:00:08.998871|ON:0:00:10.001249|OFF:0:00:09.999717|ON:0:00:00|OFF:0:00:10.000444|ON:0:00:00|OFF:0:00:09.998930|ON:0:00:00|OFF:0:00:10.000889|ON:0:00:00|OFF:0:00:10.000020|ON:0:00:00|OFF:0:00:10.999937|ON:0:00:00|OFF:0:00:08.998726|ON:0:00:00|OFF:0:00:10.001032|ON:0:00:00|OFF:0:00:10.000332|ON:0:00:00|OFF:0:00:09.999945|ON:0:00:00|OFF:0:00:09.999890|ON:0:00:00|OFF:0:00:11.000054|ON:Missing descriptors for photos 1368871842 and 1368871844 Missing descriptors for photos 1368871844 and 1368871872 Missing descriptors for photos 1368871872 and 1368871880 Missing descriptors for photos 1368871880 and 1368868521 Missing descriptors for photos 1368868521 and 1368871884 Missing descriptors for photos 1368871884 and 1368868519 Missing descriptors for photos 1368868519 and 1368871887 Missing descriptors for photos 1368871887 and 1368868503 Missing descriptors for photos 1368868503 and 1368868501 Missing descriptors for photos 1368868501 and 1368868462 Missing descriptors for photos 1368868462 and 1368868460 Missing descriptors for photos 1368868460 and 1368868459 Missing descriptors for photos 1368868459 and 1368868454 Missing descriptors for photos 1368868454 and 1368868449 Missing descriptors for photos 1368868449 and 1368868445 Missing descriptors for photos 1368868445 and 1368868158 Missing descriptors for photos 1368868158 and 1368868154 Missing descriptors for photos 1368868154 and 1368868151 Missing descriptors for photos 1368868151 and 1368868149 0:05:10.000019|OFF:0:00:08.998826|ON:0:00:00|OFF:0:00:10.001121|ON:0:00:00|OFF:0:00:09.999989|ON:0:00:00|OFF:0:00:10.000011|ON:0:00:00|OFF:0:00:10.000064|ON:Missing descriptors for photos 1368868287 and 1368868286 Missing descriptors for photos 1368868286 and 1368868283 Missing descriptors for photos 1368868283 and 1368868280 Missing descriptors for photos 1368868280 and 1368868279 Missing descriptors for photos 1368868279 and 1368868277 Missing descriptors for photos 1368868277 and 1368868499 Missing descriptors for photos 1368868499 and 1368868495 Missing descriptors for photos 1368868495 and 1368868492 Missing descriptors for photos 1368868492 and 1368868487 Missing descriptors for photos 1368868487 and 1368871892 Missing descriptors for photos 1368871892 and 1368871897 Missing descriptors for photos 1368871897 and 1368868714 Missing descriptors for photos 1368868714 and 1368868712 Missing descriptors for photos 1368868712 and 1368868709 Missing descriptors for photos 1368868709 and 1368868706 Missing descriptors for photos 1368868706 and 1368868570 Missing descriptors for photos 1368868570 and 1368868567 Missing descriptors for photos 1368868567 and 1368868563 Missing descriptors for photos 1368868563 and 1368868556 Missing descriptors for photos 1368868556 and 1368868551 0:13:49.999982|OFF:0:00:10.999929|ON:Missing descriptors for photos 1368868648 and 1368868646 Missing descriptors for photos 1368868646 and 1368868643 Missing descriptors for photos 1368868643 and 1368868694 Missing descriptors for photos 1368868694 and 1368868693 Missing descriptors for photos 1368868693 and 1368868744 Missing descriptors for photos 1368868744 and 1368868743 Missing descriptors for photos 1368868743 and 1368868739 Missing descriptors for photos 1368868739 and 1368868735 0:05:29.000117|OFF:0:00:09.999882|ON:0:00:19.999483|OFF:0:00:11.000827|ON:0:00:00|OFF:0:00:09.999661|ON:0:00:00|OFF:0:00:09.999957|ON:0:00:00|OFF:0:00:19.000109|ON:0:01:00.999813|OFF:0:00:08.998952|ON:0:00:00|OFF:0:00:10.001345|ON:0:00:00|OFF:0:00:19.999831|ON:0:00:00|OFF:0:00:10.000051|ON:0:00:00|OFF:0:00:10.999969|ON:0:00:00|OFF:0:00:09.999980|ON:0:00:08.998924|OFF:0:00:10.001119|ON:0:00:00|OFF:0:00:10.000079|ON:0:00:00|OFF:0:00:10.000002|ON:0:00:00|OFF:0:00:11.000051|ON:0:00:00|OFF:0:00:08.998693|ON:Missing descriptors for photos 1368868959 and 1368868950 Missing descriptors for photos 1368868950 and 1368868948 Missing descriptors for photos 1368868948 and 1368868945 Missing descriptors for photos 1368868945 and 1368868943 Missing descriptors for photos 1368868943 and 1368869010 Missing descriptors for photos 1368869010 and 1368869006 Missing descriptors for photos 1368869006 and 1368868998 Missing descriptors for photos 1368868998 and 1368868996 Missing descriptors for photos 1368868996 and 1368868994 Missing descriptors for photos 1368868994 and 1368868990 Missing descriptors for photos 1368868990 and 1368872310 Missing descriptors for photos 1368872310 and 1368872309 Missing descriptors for photos 1368872309 and 1368872308 Missing descriptors for photos 1368872308 and 1368872305 Missing descriptors for photos 1368872305 and 1368872301 0:05:09.999966|OFF:0:00:10.001156|ON:0:00:00|OFF:0:00:10.000053|ON:0:00:00|OFF:0:00:09.999978|ON:0:00:00|OFF:0:00:09.999997|ON:Missing descriptors for photos 1368870207 and 1368870204 Missing descriptors for photos 1368870204 and 1368870200 Missing descriptors for photos 1368870200 and 1368870195 Missing descriptors for photos 1368870195 and 1368870180 Missing descriptors for photos 1368870180 and 1368870158 Missing descriptors for photos 1368870158 and 1368870266 Missing descriptors for photos 1368870266 and 1368870235 Missing descriptors for photos 1368870235 and 1368870231 Missing descriptors for photos 1368870231 and 1368870228 Missing descriptors for photos 1368870228 and 1368870224 Missing descriptors for photos 1368870224 and 1368870822 0:03:09.999817|OFF:0:00:10.000052|ON:0:00:21.000130|OFF:0:00:08.998787|ON:0:00:00|OFF:0:00:10.001193|ON:0:00:00|OFF:0:00:10.000074|ON:0:00:00|OFF:0:00:11.000383|ON:0:00:09.999632|OFF:0:00:09.999789|ON:0:00:00|OFF:0:00:08.999009|ON:0:00:00|OFF:0:00:20.001172|ON:0:00:00|OFF:0:00:11.000133|ON:0:00:00|OFF:0:00:08.998657|ON:0:00:10.001249|OFF:0:00:09.999760|ON:0:00:00|OFF:0:00:10.000113|ON:Missing descriptors for photos 1368871610 and 1368871626 Missing descriptors for photos 1368871626 and 1368871604 Missing descriptors for photos 1368871604 and 1368871623 Missing descriptors for photos 1368871623 and 1368871602 Missing descriptors for photos 1368871602 and 1368871620 Missing descriptors for photos 1368871620 and 1368871470 Missing descriptors for photos 1368871470 and 1368871466 Missing descriptors for photos 1368871466 and 1368871338 Missing descriptors for photos 1368871338 and 1368871337 Missing descriptors for photos 1368871337 and 1368871334 Missing descriptors for photos 1368871334 and 1368871330 Missing descriptors for photos 1368871330 and 1368871319 Missing descriptors for photos 1368871319 and 1368871314 Missing descriptors for photos 1368871314 and 1368871390 Missing descriptors for photos 1368871390 and 1368871384 0:03:40.000053|OFF:0:00:11.000013|ON: 30062025 Removing 165 photos because of the 'same image' condition Total on : 21398.999255 list_time_on Total off : 640.9997460000002 list_time_off dist_desc begin to insert list_values into photo_hahstag_ids : length of list_valuse in save_photo_hashtag_id_type : 530 time used for this insertion : 0.15671777725219727 photos_removed : len 165 elapsed_time : remove_photo_duplicate 0.28592658042907715 Creating list_photo_total XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXtime_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average time_diff is bigger than the limit of interval, we ignore the result of this image in moving average elapsed_time : count_sum_diff_and_build_graph 0.04126429557800293 Total photos : 530 .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 0 hashtag : 616987804 photo_id =1368867838 : emr .......can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info ......can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 16 hashtag : 2107755846 photo_id =1368867912 : pet_clair ...can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ...can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 24 hashtag : 2107760238 photo_id =1368868148 : flux_dev ..........can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .......can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 20 hashtag : 495916461 photo_id =1368868547 : jrm ......can't find max_score_info ....can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 9 hashtag : 2107760237 photo_id =1368868730 : film_pedb .....can't find max_score_info ....can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .......can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info ........can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 34 hashtag : 616987804 photo_id =1368872298 : emr .........can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 13 hashtag : 2107755846 photo_id =1368870786 : pet_clair ......can't find max_score_info .can't find max_score_info .can't find max_score_info ....can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info ...can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info .can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info ..can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .can't find max_score_info .Change port : 20 hashtag : 2107760239 photo_id =1368871382 : pehd_pp .......can't find max_score_info . Total photos : 530 Number of lists : 9 counter photos in port : 144 hashtag : aluminium(493546845) : 0 photos in 0 portfolios ! hashtag : ela(492741797) : 0 photos in 0 portfolios ! hashtag : emr(616987804) : 29 photos in 2 portfolios ! hashtag : film_pedb(2107760237) : 34 photos in 1 portfolios ! hashtag : flux_dev(2107760238) : 20 photos in 1 portfolios ! hashtag : jrm(495916461) : 9 photos in 1 portfolios ! hashtag : pcm(560181804) : 0 photos in 0 portfolios ! hashtag : pcnc(1284539308) : 0 photos in 0 portfolios ! hashtag : pehd_pp(2107760239) : 8 photos in 1 portfolios ! hashtag : pet_clair(2107755846) : 44 photos in 2 portfolios ! hashtag : refus(538914404) : 0 photos in 0 portfolios ! hashtag : tapis_vide(2107748999) : 0 photos in 1 portfolios ! elapsed_time : group_photo_by_moyenne_exp 0.015473365783691406 elapsed_time : compute_and_correct_tag_with_moyenne_mobile 1.9073486328125e-06 today str has not a value , we define it as the date of the first image todaystr_first : 30062025 attention , prev_timestamp is 0 , we do nothing ********************o*****oo**o*oo*******o*o*o*o*****************************ooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo** BIG TIME 450.9999780654907 (589.0006530284882, 4, 0, 0, 0, 0, 0.82948536, 0, 0, 0, 0, 0, 0, 0, 1.9708998965978621, 0.0296, 0.0, 1.9, 0.009999882936477661, -0.0) on 60 1368868495 2025-06-30 05:37:45.010052 id_data : 303 ** BIG TIME 171.0000069141388 (680.000433921814, 5, 0, 0, 0, 0, 0, 0.85808545, 0, 0, 0, 0, 0, 0, 2.0519998908042907, 0.0327, 0.0010000096082687377, 1.9, 0.09099994683265684, -0.1516668164730072) on 69 1368868693 2025-06-30 05:45:45.010083 id_data : 331 oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooCount Time bigger than 30s : 71 #Number Photos for regression : {'30062025': {493546845: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 492741797: {2107751013: 0, 2107751014: 0, 2107751015: 10.000366926193237, 2107751016: 0, 2107751017: 0}, 616987804: {2107751013: 9.999943017959595, 2107751014: 181.00200200080872, 2107751015: 31.00039005279541, 2107751016: 8.998762130737305, 2107751017: 0}, 2107760237: {2107751013: 0, 2107751014: 76.99775767326355, 2107751015: 160.00350999832153, 2107751016: 112.00083899497986, 2107751017: 0}, 2107760238: {2107751013: 0, 2107751014: 20.00119709968567, 2107751015: 109.99771094322205, 2107751016: 0, 2107751017: 0}, 495916461: {2107751013: 0, 2107751014: 10.000034093856812, 2107751015: 20.000030040740967, 2107751016: 70.99986386299133, 2107751017: 0}, 560181804: {2107751013: 0, 2107751014: 18.99912691116333, 2107751015: 9.999764919281006, 2107751016: 0, 2107751017: 0}, 1284539308: {2107751013: 0, 2107751014: 0, 2107751015: 20.000044107437134, 2107751016: 0, 2107751017: 0}, 2107760239: {2107751013: 0, 2107751014: 40.00125813484192, 2107751015: 91.00017070770264, 2107751016: 0, 2107751017: 0}, 2107755846: {2107751013: 0, 2107751014: 0, 2107751015: 448.9989037513733, 2107751016: 0, 2107751017: 0}, 538914404: {2107751013: 0, 2107751014: 0, 2107751015: 0, 2107751016: 0, 2107751017: 0}, 2107748999: {2107751013: 0, 2107751014: 0, 2107751015: 4073.991695165634, 2107751016: 0, 2107751017: 0}}} 30062025|aluminium, 05102018_papier_non_papier_dense:0 30062025|aluminium, 05102018_papier_non_papier_peu_dense:0 30062025|aluminium, 05102018_papier_non_papier_presque_vide:0 30062025|aluminium, 05102018_papier_non_papier_tres_dense:0 30062025|aluminium, 05102018_papier_non_papier_tres_peu_dense:0 30062025|ela, 05102018_papier_non_papier_dense:0 30062025|ela, 05102018_papier_non_papier_peu_dense:0 30062025|ela, 05102018_papier_non_papier_presque_vide:10.000366926193237 30062025|ela, 05102018_papier_non_papier_tres_dense:0 30062025|ela, 05102018_papier_non_papier_tres_peu_dense:0 30062025|emr, 05102018_papier_non_papier_dense:9.999943017959595 30062025|emr, 05102018_papier_non_papier_peu_dense:181.00200200080872 30062025|emr, 05102018_papier_non_papier_presque_vide:31.00039005279541 30062025|emr, 05102018_papier_non_papier_tres_dense:8.998762130737305 30062025|emr, 05102018_papier_non_papier_tres_peu_dense:0 30062025|film_pedb, 05102018_papier_non_papier_dense:0 30062025|film_pedb, 05102018_papier_non_papier_peu_dense:76.99775767326355 30062025|film_pedb, 05102018_papier_non_papier_presque_vide:160.00350999832153 30062025|film_pedb, 05102018_papier_non_papier_tres_dense:112.00083899497986 30062025|film_pedb, 05102018_papier_non_papier_tres_peu_dense:0 30062025|flux_dev, 05102018_papier_non_papier_dense:0 30062025|flux_dev, 05102018_papier_non_papier_peu_dense:20.00119709968567 30062025|flux_dev, 05102018_papier_non_papier_presque_vide:109.99771094322205 30062025|flux_dev, 05102018_papier_non_papier_tres_dense:0 30062025|flux_dev, 05102018_papier_non_papier_tres_peu_dense:0 30062025|jrm, 05102018_papier_non_papier_dense:0 30062025|jrm, 05102018_papier_non_papier_peu_dense:10.000034093856812 30062025|jrm, 05102018_papier_non_papier_presque_vide:20.000030040740967 30062025|jrm, 05102018_papier_non_papier_tres_dense:70.99986386299133 30062025|jrm, 05102018_papier_non_papier_tres_peu_dense:0 30062025|pcm, 05102018_papier_non_papier_dense:0 30062025|pcm, 05102018_papier_non_papier_peu_dense:18.99912691116333 30062025|pcm, 05102018_papier_non_papier_presque_vide:9.999764919281006 30062025|pcm, 05102018_papier_non_papier_tres_dense:0 30062025|pcm, 05102018_papier_non_papier_tres_peu_dense:0 30062025|pcnc, 05102018_papier_non_papier_dense:0 30062025|pcnc, 05102018_papier_non_papier_peu_dense:0 30062025|pcnc, 05102018_papier_non_papier_presque_vide:20.000044107437134 30062025|pcnc, 05102018_papier_non_papier_tres_dense:0 30062025|pcnc, 05102018_papier_non_papier_tres_peu_dense:0 30062025|pehd_pp, 05102018_papier_non_papier_dense:0 30062025|pehd_pp, 05102018_papier_non_papier_peu_dense:40.00125813484192 30062025|pehd_pp, 05102018_papier_non_papier_presque_vide:91.00017070770264 30062025|pehd_pp, 05102018_papier_non_papier_tres_dense:0 30062025|pehd_pp, 05102018_papier_non_papier_tres_peu_dense:0 30062025|pet_clair, 05102018_papier_non_papier_dense:0 30062025|pet_clair, 05102018_papier_non_papier_peu_dense:0 30062025|pet_clair, 05102018_papier_non_papier_presque_vide:448.9989037513733 30062025|pet_clair, 05102018_papier_non_papier_tres_dense:0 30062025|pet_clair, 05102018_papier_non_papier_tres_peu_dense:0 30062025|refus, 05102018_papier_non_papier_dense:0 30062025|refus, 05102018_papier_non_papier_peu_dense:0 30062025|refus, 05102018_papier_non_papier_presque_vide:0 30062025|refus, 05102018_papier_non_papier_tres_dense:0 30062025|refus, 05102018_papier_non_papier_tres_peu_dense:0 30062025|tapis_vide, 05102018_papier_non_papier_dense:0 30062025|tapis_vide, 05102018_papier_non_papier_peu_dense:0 30062025|tapis_vide, 05102018_papier_non_papier_presque_vide:4073.991695165634 30062025|tapis_vide, 05102018_papier_non_papier_tres_dense:0 30062025|tapis_vide, 05102018_papier_non_papier_tres_peu_dense:0 #Number Photos for regression amount gros magasin papier (time_diff then nb_photo) : We have not displayed the number of photos removed for one material since Rungis_Papier wasn't in the thcl used ! 30062025_time_diff_distrib Number amount portfolio for this type of dechet : aluminium 0 Number amount portfolio for this type of dechet : ela 1 Created to study and clean : 28310454 with name like 30062025_ela_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : emr 23 Created to study and clean : 28310467 with name like 30062025_emr_05102018_papier_non_papier_dense Created to study and clean : 28310468 with name like 30062025_emr_05102018_papier_non_papier_peu_dense Created to study and clean : 28310469 with name like 30062025_emr_05102018_papier_non_papier_presque_vide Created to study and clean : 28310471 with name like 30062025_emr_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : film_pedb 35 Created to study and clean : 28310472 with name like 30062025_film_pedb_05102018_papier_non_papier_peu_dense Created to study and clean : 28310485 with name like 30062025_film_pedb_05102018_papier_non_papier_presque_vide Created to study and clean : 28310514 with name like 30062025_film_pedb_05102018_papier_non_papier_tres_dense Number amount portfolio for this type of dechet : flux_dev 13 Number amount portfolio for this type of dechet : jrm 10 Number amount portfolio for this type of dechet : pcm 3 Number amount portfolio for this type of dechet : pcnc 2 Created to study and clean : 28310515 with name like 30062025_pcnc_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : pehd_pp 13 Created to study and clean : 28310533 with name like 30062025_pehd_pp_05102018_papier_non_papier_peu_dense Created to study and clean : 28310535 with name like 30062025_pehd_pp_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : pet_clair 44 Created to study and clean : 28310537 with name like 30062025_pet_clair_05102018_papier_non_papier_presque_vide Number amount portfolio for this type of dechet : refus 0 Number amount portfolio for this type of dechet : tapis_vide 182 Created to study and clean : 28310539 with name like 30062025_tapis_vide_05102018_papier_non_papier_presque_vide NUMBER BATCH : 9 list_ponderation used : [0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001, 0.001] , list_hashtag_class_create_as_list : ['pcnc', 'gm', 'emr', 'ela', 'pet_clair', 'film_pedb', 'pehd_pp', 'flux_dev_rigide', 'aluminium', 'tapis_vide', 'refus', 'gros_cartons', 'gm', 'flux_dev_rigide', 'gros_cartons'] We filter photos on hashtag condition ! We filter photos on hashtag condition ! id_amount : 0 result_one_balle_Type_emr:{'day': '30062025', 'map_nb_amount': {0: 10, 1: 4, 2: 1, 3: 0, 4: 0}, 'map_time_amount': {0: 100.0011088848114, 1: 41.000473976135254, 2: 8.998762130737305, 3: 0, 4: 0}, 'duration': 150.0002589225769, 'nb_balles_papier': 0.16000028800964355, 'begin_time_port': 'image_30062025_05_13_54_009968m0.jpg 0.010000029087066651 for time 10.00002908706665, id_amount 2 this amount prod time diff : 0.010000029087066651'} Production hashtag (incorrect ponderation at 20-10-18) : 0.16000028800964355 We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! result_one_balle_Type_pet_clair:{'day': '30062025', 'map_nb_amount': {0: 0, 1: 24, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 239.00013899803162, 2: 0, 3: 0, 4: 0}, 'duration': 229.00015091896057, 'nb_balles_papier': 0.2390001389980316, 'begin_time_port': 'image_30062025_05_18_35_010051m0.jpg 0.009999988079071044 for time 9.999988079071045, id_amount 2 this amount prod time diff : 0.009999988079071044'} Production hashtag (incorrect ponderation at 20-10-18) : 0.2390001389980316 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_flux_dev_rigide:{'day': '30062025', 'map_nb_amount': {0: 3, 1: 17, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 29.000001907348633, 1: 171.00010704994202, 2: 0, 3: 0, 4: 0}, 'duration': 190.00010299682617, 'nb_balles_papier': 0.20000010895729062, 'begin_time_port': 'image_30062025_05_25_34_010027m0.jpg 0.010000005960464478 for time 10.000005960464478, id_amount 2 this amount prod time diff : 0.010000005960464478'} Production hashtag (incorrect ponderation at 20-10-18) : 0.20000010895729062 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! result_one_balle_Type_jrm:{'day': '30062025', 'map_nb_amount': {0: 1, 1: 1, 2: 7, 3: 0, 4: 0}, 'map_time_amount': {0: 10.000034093856812, 1: 10.000048875808716, 2: 70.99986386299133, 3: 0, 4: 0}, 'duration': 91.00008988380432, 'nb_balles_papier': 0.09099994683265684, 'begin_time_port': 'image_30062025_05_40_44_009982m0.jpg 0.009999953031539917 for time 9.999953031539917, id_amount 3 this amount prod time diff : 0.009999953031539917'} Production hashtag (incorrect ponderation at 20-10-18) : 0.09099994683265684 hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_film_pedb:{'day': '30062025', 'map_nb_amount': {0: 7, 1: 16, 2: 11, 3: 0, 4: 0}, 'map_time_amount': {0: 67.99895286560059, 1: 160.0024950504303, 2: 112.00083899497986, 3: 0, 4: 0}, 'duration': 379.0001368522644, 'nb_balles_papier': 0.34000228691101075, 'begin_time_port': 'image_30062025_05_46_35_010003m0.jpg 0.009999981164932252 for time 9.999981164932251, id_amount 2 this amount prod time diff : 0.009999981164932252'} Production hashtag (incorrect ponderation at 20-10-18) : 0.34000228691101075 hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! result_one_balle_Type_emr:{'day': '30062025', 'map_nb_amount': {0: 10, 1: 3, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 100.00002002716064, 1: 30.000092029571533, 2: 0, 3: 0, 4: 0}, 'duration': 120.0000970363617, 'nb_balles_papier': 0.13000011205673218, 'begin_time_port': 'image_30062025_05_55_44_010052m0.jpg 0.010000015020370484 for time 10.000015020370483, id_amount 2 this amount prod time diff : 0.010000015020370484'} Production hashtag (incorrect ponderation at 20-10-18) : 0.13000011205673218 We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! We filter photos on hashtag condition ! result_one_balle_Type_pet_clair:{'day': '30062025', 'map_nb_amount': {0: 0, 1: 20, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 209.99876475334167, 2: 0, 3: 0, 4: 0}, 'duration': 209.99955582618713, 'nb_balles_papier': 0.2099987647533417, 'begin_time_port': 'image_30062025_06_00_04_010430m0.jpg 0.010000458002090455 for time 10.000458002090454, id_amount 2 this amount prod time diff : 0.010000458002090455'} Production hashtag (incorrect ponderation at 20-10-18) : 0.2099987647533417 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! hashtag non trouvé ! We filter photos on hashtag condition ! hashtag non trouvé ! hashtag non trouvé ! result_one_balle_Type_pehd_pp:{'day': '30062025', 'map_nb_amount': {0: 4, 1: 4, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 40.00125813484192, 1: 39.99877071380615, 2: 0, 3: 0, 4: 0}, 'duration': 80.00014996528625, 'nb_balles_papier': 0.08000002884864807, 'begin_time_port': 'image_30062025_06_06_15_010015m0.jpg 0.009999921083450318 for time 9.999921083450317, id_amount 2 this amount prod time diff : 0.009999921083450318'} Production hashtag (incorrect ponderation at 20-10-18) : 0.08000002884864807 We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We filter photos on hashtag condition ! We have rejected 0 photos because of the batch_size condition ! NUMBER BATCH list_of_portfolios_to_create : 8 list_same_port_ids : [24413862] find same portfolio which already exist 24413862 , we will use it list_same_port_ids : [24413863] find same portfolio which already exist 24413863 , we will use it list_same_port_ids : [24413864] find same portfolio which already exist 24413864 , we will use it type_dechet jrm not in list to create port, so we just list it with its name (VR TODO 3-6-19 : we need to change this) list_same_port_ids : [24413865] find same portfolio which already exist 24413865 , we will use it list_same_port_ids : [24413866] find same portfolio which already exist 24413866 , we will use it list_same_port_ids : [24413867] find same portfolio which already exist 24413867 , we will use it list_same_port_ids : [] # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413862 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11644 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11645 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11642 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11642 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11649 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11643 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11646 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11647 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11648 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11650 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11644 have datatype=11 whereas input 0 of step 11642 have datatype=2 WARNING : type of output 1 of step 11645 doesn't seem to be define in the database( WARNING : type of input 3 of step 11643 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11645 doesn't seem to be define in the database( WARNING : type of input 1 of step 11642 doesn't seem to be define in the database( WARNING : output 0 of step 11649 have datatype=10 whereas input 3 of step 11648 have datatype=6 WARNING : type of input 1 of step 11649 doesn't seem to be define in the database( WARNING : output 1 of step 11642 have datatype=7 whereas input 1 of step 11649 have datatype=None WARNING : type of output 1 of step 11649 doesn't seem to be define in the database( WARNING : type of input 4 of step 11643 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11644 doesn't seem to be define in the database( WARNING : type of input 1 of step 11645 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413863 AND mptpi.`type`=3327 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413864 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413865 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413866 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! All sons are already in current list ! DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : number of outputs for step 11644 copy_chis is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11645 consolidate_hashtags_from_manual_portfolio is not consistent : 2 used against 1 in the step definition ! WARNING : number of inputs for step 11642 rle_unique_nms_with_priority is not consistent : 3 used against 1 in the step definition ! WARNING : number of outputs for step 11642 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition ! WARNING : number of outputs for step 11649 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition ! Step 11643 final have less outputs used (1) than in the step definition (2) : some outputs may be not used ! Step 11646 blur_detection have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11647 brightness have less inputs used (0) than in the step definition (1) : maybe we manage optionnal inputs ! Step 11648 send_mail_cod have less inputs used (4) than in the step definition (5) : maybe we manage optionnal inputs ! Step 11650 split_time_score have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : output 0 of step 11644 have datatype=11 whereas input 0 of step 11642 have datatype=2 WARNING : type of output 1 of step 11645 doesn't seem to be define in the database( WARNING : type of input 3 of step 11643 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11645 doesn't seem to be define in the database( WARNING : type of input 1 of step 11642 doesn't seem to be define in the database( WARNING : output 0 of step 11649 have datatype=10 whereas input 3 of step 11648 have datatype=6 WARNING : type of input 1 of step 11649 doesn't seem to be define in the database( WARNING : output 1 of step 11642 have datatype=7 whereas input 1 of step 11649 have datatype=None WARNING : type of output 1 of step 11649 doesn't seem to be define in the database( WARNING : type of input 4 of step 11643 doesn't seem to be define in the database( We ignore checkConsistencyTypeOutputInput for datou_step final ! WARNING : type of output 1 of step 11644 doesn't seem to be define in the database( WARNING : type of input 1 of step 11645 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=24413867 AND mptpi.`type`=3327 To do # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! Here we check the consistency of inputs/outputs number between the given ones and the db ! eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering ! WARNING : step 0 init_dummy_multi_datou is not linked in the step_by_step architecture ! WARNING : step 1294 init_dummy_multi_datou is not linked in the step_by_step architecture ! Number of inputs / outputs for each step checked ! Here we check the consistency of outputs/inputs types during steps connections eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput ! DataTypes for each output/input checked ! TODO SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=28310540 To do elapsed_time : count_nb_balles_and_create_portfolio 85.96587324142456 # DISPLAY ALL COLLECTED DATA : {'30062025': {'nb_upload': 530, 'nb_taggue_class': 530, 'nb_taggue_densite': 530, 'nb_descriptors': 309, 'number_port': 9, 'count_photo_in_port': 144, 'nb_port_per_class': {'aluminium': {'nb_photos': 0, 'nb_portfolios': 0}, 'ela': {'nb_photos': 0, 'nb_portfolios': 0}, 'emr': {'nb_photos': 29, 'nb_portfolios': 2}, 'film_pedb': {'nb_photos': 34, 'nb_portfolios': 1}, 'flux_dev': {'nb_photos': 20, 'nb_portfolios': 1}, 'jrm': {'nb_photos': 9, 'nb_portfolios': 1}, 'pcm': {'nb_photos': 0, 'nb_portfolios': 0}, 'pcnc': {'nb_photos': 0, 'nb_portfolios': 0}, 'pehd_pp': {'nb_photos': 8, 'nb_portfolios': 1}, 'pet_clair': {'nb_photos': 44, 'nb_portfolios': 2}, 'refus': {'nb_photos': 0, 'nb_portfolios': 0}, 'tapis_vide': {'nb_photos': 0, 'nb_portfolios': 1}}}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1372573190, 1368872602, 1368872599, 1368872594, 1368872591, 1368872588, 1368872585, 1368872551, 1368872550, 1368872549, 1368872546, 1368872544, 1368872540, 1368872534, 1368872532, 1368872530, 1368872527, 1368872519, 1368872516, 1368872511, 1368872506, 1368872503, 1368872497, 1368872492, 1368872456, 1368872454, 1368872451, 1368872447, 1368872416, 1368872412, 1368872409, 1368872358, 1368872354, 1368872353, 1368872352, 1368872350, 1368872347, 1368872310, 1368872309, 1368872308, 1368872305, 1368872301, 1368872298, 1368872274, 1368872271, 1368872268, 1368872266, 1368872261, 1368872255, 1368872250, 1368872246, 1368872240, 1368872236, 1368872234, 1368872232, 1368872229, 1368872218, 1368872215, 1368872212, 1368872199, 1368872196, 1368872190, 1368872186, 1368872185, 1368872138, 1368872133, 1368872129, 1368872126, 1368872123, 1368872119, 1368872118, 1368872115, 1368872113, 1368872109, 1368872105, 1368872063, 1368872060, 1368872056, 1368872053, 1368872051, 1368872046, 1368872029, 1368872023, 1368872022, 1368872013, 1368872008, 1368872002, 1368871987, 1368871985, 1368871982, 1368871977, 1368871966, 1368871962, 1368871959, 1368871954, 1368871936, 1368871934, 1368871897, 1368871892, 1368871887] Looping around the photos to save general results len do output : 1 /24409098Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1372573190', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872602', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872599', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872594', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872591', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872588', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872585', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872551', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872550', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872549', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872546', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872544', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872540', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872534', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872532', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872530', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872527', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872519', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872516', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872511', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872506', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872503', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872497', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872492', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872456', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872454', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872451', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872447', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872416', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872412', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872409', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872358', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872354', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872353', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872352', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872350', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872347', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872310', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872309', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872308', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872305', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872301', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872298', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872274', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872271', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872268', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872266', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872261', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872255', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872250', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872246', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872240', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872236', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872234', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872232', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872229', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872218', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872215', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872212', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872199', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872196', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872190', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872186', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872185', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872138', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872133', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872129', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872126', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872123', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872119', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872118', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872115', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872113', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872109', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872105', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872063', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872060', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872056', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872053', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872051', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872046', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872029', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872023', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872022', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872013', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872008', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368872002', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871987', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871985', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871982', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871977', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871966', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871962', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871959', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871954', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871936', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871934', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871897', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871892', None, None, None, None, None, '4017107') ('4960', None, None, None, None, None, None, None, '4017107') ('4960', '24409098', '1368871887', None, None, None, None, None, '4017107') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.0629878044128418 save_final save missing photos in datou_result : time spend for datou_step_exec : 120.87526297569275 time spend to save output : 0.063720703125 total time spend for step 1 : 120.93898367881775 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 2.03user 0.96system 2:03.36elapsed 2%CPU (0avgtext+0avgdata 106000maxresident)k 24inputs+2720outputs (0major+50294minor)pagefaults 0swaps