python /home/admin/mtr/script_for_cron.py -j datou_current3 -m 20 -a ' -a 4189' -s datou_current_4189 -M 0 -S 0 -U 95,95,120 import MySQLdb succeeded Import error (python version) ['/Users/moilerat/Documents/Fotonower/install/caffe/distribute/python', '/home/admin/workarea/git/Velours/python/prod', '/home/admin/workarea/install/caffe_cuda8_python3/python', '/home/admin/workarea/install/darknet', '/home/admin/workarea/git/Velours/python', '/home/admin/workarea/install/caffe_frcnn_python3/py-faster-rcnn/caffe-fast-rcnn/python', '/home/admin/mtr/.credentials', '/home/admin/workarea/install/caffe/python', '/home/admin/workarea/install/caffe_frcnn/py-faster-rcnn/tools', '/home/admin/workarea/git/fotonowerpip', '/home/admin/workarea/install/segment-anything', '/home/admin/workarea/git/pyfvs', '/usr/lib/python38.zip', '/usr/lib/python3.8', '/usr/lib/python3.8/lib-dynload', '/home/admin/.local/lib/python3.8/site-packages', '/usr/local/lib/python3.8/dist-packages', '/usr/lib/python3/dist-packages'] process id : 3036556 load datou : 4189 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! Unexpected type for variable list_input_json ERROR or WARNING : can't parse json string Expecting value: line 1 column 1 (char 0) Tried to parse : None was removed should we ? donnée sous forme de texte was removed should we ? [ptf_id0,ptf_id1...] was removed should we ? load thcls load pdts Running datou job : batch_current TODO datou_current to load to do maybe to take outside batchDatouExec no input labels no input values updating current state to 1 list_input_json: {} Date 2026-03-12 13:00:27.522260 Current got : datou_id : 4189, datou_cur_ids : ['4360836'] with mtr_portfolio_ids : ['30721368'] and first list_photo_ids : [] new path : /proc/3036556/ Inside batchDatouExec : verbose : 0 # VR 17-11-17 : to create in DB ! Here we check the datou graph and we reorder steps ! Tree builded and cycle checked, now we need to re-order the steps ! We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id) DONE and to test : checkNoCycle ! We are managing only one step so we do not consider checkConsistencyNbInputNbOutput ! We are managing only one step so we do not consider checkConsistencyTypeOutputInput ! List Step Type Loaded in datou : split_time_score over limit max, limiting to limit_max 100 list_input_json : {} origin We have 1 , WARNING: data may be incomplete, need to offset and complete ! we have missing 0 photos in the step downloads : photo missing : [] try to delete the photos missing in DB time to download the photos : 0.021922826766967773 About to test input to load Calling datou_exec Inside datou_exec : verbose : 0 number of steps : 1 step1:split_time_score Thu Mar 12 13:00:27 2026 VR 17-11-17 : now, only for linear exec dependencies tree, some output goes to fill the input of the next VR 22-3-18 : now we test the dependencies tree, but keep two separate code for datou_prepare_output_input until the code is correctly tested, clean and works in both case VR 22-3-18 : but we use the first code for the first step id = -1, build in the code of datou_exec VR 22-3-18 : we should manage here the case when we are at the first step instead of building this step before datou_exec begin split time score 2022-04-13 10:29:59 0 TODO : Insert select and so on Begin split_port_in_batch_balle thcls : [{'id': 3379, 'mtr_user_id': 31, 'name': 'learn_classif_flux_maj_generique_effnet_v2_s_02062022', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': 'aluminium,ela,film_pedb,flux_dev,jrm,pcm,pcnc,pehd_pp,pet_clair,refus,tapis_vide', 'svm_portfolios_learning': '5515864,5515840,5515844,5515850,6244400,6237996,6237998,5515847,5515841,5515868,5515866', 'photo_hashtag_type': 4374, 'photo_desc_type': 5680, 'type_classification': 'tf_classification2', 'hashtag_id_list': '493546845,492741797,2107760237,2107760238,495916461,560181804,1284539308,2107760239,2107755846,538914404,2107748999'}] thcls : [{'id': 3513, 'mtr_user_id': 31, 'name': 'Rungis_amount_dechets_fall_2018_v2_tf', 'pb_hashtag_id': 0, 'live': b'\x00', 'list_hashtags': '05102018_Papier_non_papier_dense,05102018_Papier_non_papier_peu_dense,05102018_Papier_non_papier_presque_vide,05102018_Papier_non_papier_tres_dense,05102018_Papier_non_papier_tres_peu_dense', 'svm_portfolios_learning': '1108385,1108386,1108388,1108384,1108387', 'photo_hashtag_type': 4557, 'photo_desc_type': 5767, 'type_classification': 'tf_classification2', 'hashtag_id_list': '2107751013,2107751014,2107751015,2107751016,2107751017'}] (('10', 123),) ERROR counted https://github.com/fotonower/Velours/issues/663#issuecomment-421136223 {1: 123} 12032026 30721368 Nombre de photos uploadées : 123 / 23040 (0%) 12032026 30721368 Nombre de photos taguées (types de déchets): 123 / 123 (100%) 12032026 30721368 Nombre de photos taguées (volume) : 123 / 123 (100%) elapsed_time : load_data_split_time_score 1.6689300537109375e-06 elapsed_time : order_list_meta_photo_and_scores 5.459785461425781e-05 LLLLLLLLLLLLLLLLLL elapsed_time : fill_and_build_computed_from_old_data 0.008310794830322266 Catched exception ! Connect or reconnect ! Catched exception ! Connect or reconnect ! elapsed_time : insert_dashboard_record_day_entry 0.21993565559387207 LLLLLLLLLLLLLLLLLL Creating list_photo_by_hashtags elapsed_time : list_photo_by_hashtags 0.025053977966308594 Creating list_photo_total Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411866986.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867077.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867081.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867112.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867113.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867520.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867521.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867522.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867523.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867524.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867525.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867563.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867564.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867566.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867567.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867568.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867569.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867603.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867604.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867605.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867619.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867626.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867629.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867793.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867794.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867795.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867796.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867797.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411867798.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868727.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868730.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868732.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868734.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868736.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411868737.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869637.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869638.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869639.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869640.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869641.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411869690.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873248.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873249.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873300.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873351.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873402.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873440.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873953.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873954.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873955.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873956.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873957.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411873958.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875399.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875400.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875401.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875402.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875403.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411875404.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876326.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876352.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876357.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876359.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876372.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876381.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876460.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876462.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876465.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876467.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876469.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876470.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876719.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876721.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876724.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876726.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876727.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411876728.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877433.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877434.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877435.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877456.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877457.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411877458.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881088.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881120.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881123.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881125.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881158.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881200.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881226.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881228.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881231.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881233.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881235.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881237.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881274.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881275.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881276.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881277.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881278.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881279.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881334.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881335.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881336.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881344.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881349.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881364.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881535.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881540.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881555.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881567.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881577.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411881592.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884297.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884299.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884302.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884303.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884304.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<' Object GET failed: https://storage.sbg.cloud.ovh.net/v1/AUTH_b878d1ec389e4877b1a6590d8f2dcede/desc.fotonower.com/5680.1411884305.desc 404 Not Found [first 60 chars of response] b'
The resource could not be found.<'
Unable to find some descriptors in ovh, trying to find them in s3
Number missing : 119
Warning this was a bad idea s3 !
elapsed_time : select_descriptors 20.339825868606567
Missing descriptors : 119
12032026 30721368 Nombre de photos avec descriptors (type 5680) : 4 / 123 (3%)
Missing descriptors for photos 0 and 1411866986
0:00:00|ON:Missing descriptors for photos 1411866986 and 1411867077
Missing descriptors for photos 1411867077 and 1411867081
Missing descriptors for photos 1411867081 and 1411867112
Missing descriptors for photos 1411867112 and 1411867113
Missing descriptors for photos 1411867113 and 1411867520
Missing descriptors for photos 1411867520 and 1411867521
Missing descriptors for photos 1411867521 and 1411867522
Missing descriptors for photos 1411867522 and 1411867523
Missing descriptors for photos 1411867523 and 1411867524
Missing descriptors for photos 1411867524 and 1411867525
Missing descriptors for photos 1411867525 and 1411867563
Missing descriptors for photos 1411867563 and 1411867564
Missing descriptors for photos 1411867564 and 1411867566
Missing descriptors for photos 1411867566 and 1411867567
Missing descriptors for photos 1411867567 and 1411867568
Missing descriptors for photos 1411867568 and 1411867569
Missing descriptors for photos 1411867569 and 1411867603
Missing descriptors for photos 1411867603 and 1411867604
Missing descriptors for photos 1411867604 and 1411867605
Missing descriptors for photos 1411867605 and 1411867619
Missing descriptors for photos 1411867619 and 1411867626
Missing descriptors for photos 1411867626 and 1411867629
Missing descriptors for photos 1411867629 and 1411867793
Missing descriptors for photos 1411867793 and 1411867794
Missing descriptors for photos 1411867794 and 1411867795
Missing descriptors for photos 1411867795 and 1411867796
Missing descriptors for photos 1411867796 and 1411867797
Missing descriptors for photos 1411867797 and 1411867798
Missing descriptors for photos 1411867798 and 1411868727
Missing descriptors for photos 1411868727 and 1411868730
Missing descriptors for photos 1411868730 and 1411868732
Missing descriptors for photos 1411868732 and 1411868734
Missing descriptors for photos 1411868734 and 1411868736
Missing descriptors for photos 1411868736 and 1411868737
Missing descriptors for photos 1411868737 and 1411869637
Missing descriptors for photos 1411869637 and 1411869638
Missing descriptors for photos 1411869638 and 1411869639
Missing descriptors for photos 1411869639 and 1411869640
Missing descriptors for photos 1411869640 and 1411869641
Missing descriptors for photos 1411869641 and 1411869690
Missing descriptors for photos 1411869690 and 1411873248
Missing descriptors for photos 1411873248 and 1411873249
Missing descriptors for photos 1411873249 and 1411873300
Missing descriptors for photos 1411873300 and 1411873351
Missing descriptors for photos 1411873351 and 1411873402
Missing descriptors for photos 1411873402 and 1411873440
Missing descriptors for photos 1411873440 and 1411873953
Missing descriptors for photos 1411873953 and 1411873954
Missing descriptors for photos 1411873954 and 1411873955
Missing descriptors for photos 1411873955 and 1411873956
Missing descriptors for photos 1411873956 and 1411873957
Missing descriptors for photos 1411873957 and 1411873958
Missing descriptors for photos 1411873958 and 1411875399
Missing descriptors for photos 1411875399 and 1411875400
Missing descriptors for photos 1411875400 and 1411875401
Missing descriptors for photos 1411875401 and 1411875402
Missing descriptors for photos 1411875402 and 1411875403
Missing descriptors for photos 1411875403 and 1411875404
Missing descriptors for photos 1411875404 and 1411876326
Missing descriptors for photos 1411876326 and 1411876352
Missing descriptors for photos 1411876352 and 1411876357
Missing descriptors for photos 1411876357 and 1411876359
Missing descriptors for photos 1411876359 and 1411876372
Missing descriptors for photos 1411876372 and 1411876381
Missing descriptors for photos 1411876381 and 1411876460
Missing descriptors for photos 1411876460 and 1411876462
Missing descriptors for photos 1411876462 and 1411876465
Missing descriptors for photos 1411876465 and 1411876467
Missing descriptors for photos 1411876467 and 1411876469
Missing descriptors for photos 1411876469 and 1411876470
Missing descriptors for photos 1411876470 and 1411876719
Missing descriptors for photos 1411876719 and 1411876721
Missing descriptors for photos 1411876721 and 1411876724
Missing descriptors for photos 1411876724 and 1411876726
Missing descriptors for photos 1411876726 and 1411876727
Missing descriptors for photos 1411876727 and 1411876728
Missing descriptors for photos 1411876728 and 1411877433
Missing descriptors for photos 1411877433 and 1411877434
Missing descriptors for photos 1411877434 and 1411877435
Missing descriptors for photos 1411877435 and 1411877456
Missing descriptors for photos 1411877456 and 1411877457
Missing descriptors for photos 1411877457 and 1411877458
ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1411878244 photo_id_prec : 1411877458
WARNING condition_same_param while we were looking loading descriptors
ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 0 vs 1280 photo_id : 1411878245 photo_id_prec : 1411881088
ERROR : Hum hum, what can we do for different size of descriptors (ignore the difference ) : 1280 vs 0 photo_id : 1411881120 photo_id_prec : 1411878248
Missing descriptors for photos 1411881120 and 1411881123
Missing descriptors for photos 1411881123 and 1411881125
Missing descriptors for photos 1411881125 and 1411881158
Missing descriptors for photos 1411881158 and 1411881200
Missing descriptors for photos 1411881200 and 1411881226
Missing descriptors for photos 1411881226 and 1411881228
Missing descriptors for photos 1411881228 and 1411881231
Missing descriptors for photos 1411881231 and 1411881233
Missing descriptors for photos 1411881233 and 1411881235
Missing descriptors for photos 1411881235 and 1411881237
Missing descriptors for photos 1411881237 and 1411881274
Missing descriptors for photos 1411881274 and 1411881275
Missing descriptors for photos 1411881275 and 1411881276
Missing descriptors for photos 1411881276 and 1411881277
Missing descriptors for photos 1411881277 and 1411881278
Missing descriptors for photos 1411881278 and 1411881279
Missing descriptors for photos 1411881279 and 1411881334
LMissing descriptors for photos 1411881334 and 1411881335
LMissing descriptors for photos 1411881335 and 1411881336
LMissing descriptors for photos 1411881336 and 1411881344
LMissing descriptors for photos 1411881344 and 1411881349
LMissing descriptors for photos 1411881349 and 1411881364
LMissing descriptors for photos 1411881364 and 1411881535
LMissing descriptors for photos 1411881535 and 1411881540
LMissing descriptors for photos 1411881540 and 1411881555
LMissing descriptors for photos 1411881555 and 1411881567
LMissing descriptors for photos 1411881567 and 1411881577
LMissing descriptors for photos 1411881577 and 1411881592
LMissing descriptors for photos 1411881592 and 1411884297
LMissing descriptors for photos 1411884297 and 1411884299
LMissing descriptors for photos 1411884299 and 1411884302
LMissing descriptors for photos 1411884302 and 1411884303
LMissing descriptors for photos 1411884303 and 1411884304
LMissing descriptors for photos 1411884304 and 1411884305
L
12032026 Removing 0 photos because of the 'same image' condition
Total on : 0
Total off : 0.0
list_time_off
Warning in study_and_display_distrib_list : min=max : 0.0 0.0
dist_desc
begin to insert list_values into photo_hahstag_ids :
length of list_valuse in save_photo_hashtag_id_type : 123
time used for this insertion : 0.030805349349975586
photos_removed : len 0
elapsed_time : remove_photo_duplicate 0.056151390075683594
To do, maybe not at the correct place !
..........................................................................................................L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.L.Lforce hashtag to JRM
elapsed_time : CREATE_PORT_BATCH_BY_HOUR 0.009009838104248047
NUMBER BATCH : 2
list_ponderation used : [1e-05, 1e-05, 1e-05, 1e-05, 1e-05] , list_hashtag_class_create_as_list : ['jrm']
result_one_balle_Type_JRM:{'day': '12032026', 'map_nb_amount': {0: 22, 1: 62, 2: 2, 3: 5, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 839.9561669826508, 'nb_balles_papier': 0.0009400000000000018, 'begin_time_port': 'image_12032026_10_00_02_275007m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'}
Production hashtag (incorrect ponderation at 20-10-18) : 0.0009400000000000018
LLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLLresult_one_balle_Type_JRM:{'day': '12032026', 'map_nb_amount': {0: 7, 1: 19, 2: 0, 3: 0, 4: 0}, 'map_time_amount': {0: 0, 1: 0, 2: 0, 3: 0, 4: 0}, 'duration': 239.58665704727173, 'nb_balles_papier': 0.0002900000000000001, 'begin_time_port': 'image_12032026_10_15_03_031015m0.jpg 1e-05 for time 1, id_amount 2 this amount prod time diff : 1e-05'}
Production hashtag (incorrect ponderation at 20-10-18) : 0.0002900000000000001
We have rejected 0 photos because of the batch_size condition !
NUMBER BATCH list_of_portfolios_to_create : 2
list_same_port_ids : [30722513]
find same portfolio which already exist 30722513 , we will use it
list_same_port_ids : []
Qualite : 0.11794306650450273
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
Tree builded and cycle checked, now we need to re-order the steps !
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition !
WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition !
WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition !
Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used !
WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition !
WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition !
Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs !
WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition !
WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs !
Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 2 of step 12492 doesn't seem to be define in the database(
WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7
WARNING : type of output 2 of step 12493 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12494 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : type of output 3 of step 12493 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12496 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12496 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12495 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12500 doesn't seem to be define in the database(
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12499 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6
WARNING : type of input 5 of step 12498 doesn't seem to be define in the database(
WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None
WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18
WARNING : type of input 2 of step 12502 doesn't seem to be define in the database(
WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None
WARNING : type of output 3 of step 12502 doesn't seem to be define in the database(
WARNING : type of input 2 of step 12496 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12499 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12492 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12500 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12492 doesn't seem to be define in the database(
WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2
DataTypes for each output/input checked !
TODO
Duplicate data, are they consistent 3 ?
Duplicate data, are they consistent 4 ?
SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id,
mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc,
h.hashtag
FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30722513 AND mptpi.`type`=3726
To do
# VR 17-11-17 : to create in DB !
Here we check the datou graph and we reorder steps !
Tree builded and cycle checked, now we need to re-order the steps !
We have currenlty an error because there is no dependence between the last step for the case tile - detect - glue
We can either keep the depence of, it is better to keep an order compatible with the id of steps if we do not have sons, so a lexical order : (number_son, step_id)
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
All sons are already in current list !
DONE and to test : checkNoCycle !
Here we check the consistency of inputs/outputs number between the given ones and the db !
eke 1-6-18 : checkConsistencyNbInputNbOutput should be processed after step reordering !
WARNING : number of outputs for step 12489 mask_detect is not consistent : 3 used against 2 in the step definition !
WARNING : number of outputs for step 12499 brightness is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12500 blur_detection is not consistent : 2 used against 1 in the step definition !
WARNING : number of inputs for step 12492 crop_condition is not consistent : 3 used against 2 in the step definition !
Step 12492 crop_condition have less outputs used (2) than in the step definition (3) : some outputs may be not used !
WARNING : number of outputs for step 12493 merge_mask_thcl_custom is not consistent : 4 used against 2 in the step definition !
WARNING : number of inputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12494 rle_unique_nms_with_priority is not consistent : 2 used against 1 in the step definition !
Step 12502 crop_condition have less inputs used (1) than in the step definition (2) : maybe we manage optionnal inputs !
WARNING : number of outputs for step 12502 crop_condition is not consistent : 4 used against 3 in the step definition !
WARNING : number of inputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
WARNING : number of outputs for step 12496 ventilate_hashtags_in_portfolio is not consistent : 2 used against 1 in the step definition !
Step 12495 final have less inputs used (2) than in the step definition (3) : maybe we manage optionnal inputs !
Step 12495 final have less outputs used (1) than in the step definition (2) : some outputs may be not used !
Number of inputs / outputs for each step checked !
Here we check the consistency of outputs/inputs types during steps connections
eke 1-6-18 : checkConsistencyTypeOutputInput should be processed after checkConsistencyNbInputNbOutput !
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 2 of step 12492 doesn't seem to be define in the database(
WARNING : output 1 of step 12489 have datatype=2 whereas input 1 of step 12493 have datatype=7
WARNING : type of output 2 of step 12493 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12494 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : type of output 3 of step 12493 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12496 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12496 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12495 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12500 doesn't seem to be define in the database(
WARNING : type of output 2 of step 12489 doesn't seem to be define in the database(
WARNING : type of input 1 of step 12499 doesn't seem to be define in the database(
We ignore checkConsistencyTypeOutputInput for datou_step final !
WARNING : output 0 of step 12496 have datatype=10 whereas input 3 of step 12498 have datatype=6
WARNING : type of input 5 of step 12498 doesn't seem to be define in the database(
WARNING : output 0 of step 12501 have datatype=11 whereas input 5 of step 12498 have datatype=None
WARNING : output 0 of step 12496 have datatype=10 whereas input 0 of step 12501 have datatype=18
WARNING : type of input 2 of step 12502 doesn't seem to be define in the database(
WARNING : output 1 of step 12494 have datatype=7 whereas input 2 of step 12502 have datatype=None
WARNING : type of output 3 of step 12502 doesn't seem to be define in the database(
WARNING : type of input 2 of step 12496 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12499 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12492 doesn't seem to be define in the database(
WARNING : type of output 1 of step 12500 doesn't seem to be define in the database(
WARNING : type of input 3 of step 12492 doesn't seem to be define in the database(
WARNING : output 0 of step 12493 have datatype=1 whereas input 0 of step 12494 have datatype=2
DataTypes for each output/input checked !
TODO
Duplicate data, are they consistent 3 ?
Duplicate data, are they consistent 4 ?
SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id,
mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc,
h.hashtag
FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=30722815 AND mptpi.`type`=3726
To do
elapsed_time : count_nb_balles_and_create_portfolio 2.4792604446411133
# DISPLAY ALL COLLECTED DATA :
{'12032026': {'nb_upload': 123, 'nb_taggue_class': 123, 'nb_taggue_densite': 123, 'nb_descriptors': 4}}
Inside saveOutput : final : True verbose : 0
saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral
[1411884305, 1411884304, 1411884303, 1411884302, 1411884299, 1411884297, 1411881592, 1411881577, 1411881567, 1411881555, 1411881540, 1411881535, 1411881364, 1411881349, 1411881344, 1411881336, 1411881335, 1411881334, 1411881279, 1411881278, 1411881277, 1411881276, 1411881275, 1411881274, 1411881237, 1411881235, 1411881233, 1411881231, 1411881228, 1411881226, 1411881200, 1411881158, 1411881125, 1411881123, 1411881120, 1411881088, 1411878248, 1411878246, 1411878245, 1411878244, 1411877458, 1411877457, 1411877456, 1411877435, 1411877434, 1411877433, 1411876728, 1411876727, 1411876726, 1411876724, 1411876721, 1411876719, 1411876470, 1411876469, 1411876467, 1411876465, 1411876462, 1411876460, 1411876381, 1411876372, 1411876359, 1411876357, 1411876352, 1411876326, 1411875404, 1411875403, 1411875402, 1411875401, 1411875400, 1411875399, 1411873958, 1411873957, 1411873956, 1411873955, 1411873954, 1411873953, 1411873440, 1411873402, 1411873351, 1411873300, 1411873249, 1411873248, 1411869690, 1411869641, 1411869640, 1411869639, 1411869638, 1411869637, 1411868737, 1411868736, 1411868734, 1411868732, 1411868730, 1411868727, 1411867798, 1411867797, 1411867796, 1411867795, 1411867794, 1411867793]
Looping around the photos to save general results
len do output : 1
/30721368Didn't retrieve data
.
before output type
Here is an output not treated by saveGeneral :