WARNING : output 0 of step 13596 have datatype=10 whereas input 0 of step 13625 have datatype=18 WARNING : type of output 1 of step 13625 doesn't seem to be define in the database( WARNING : type of input 5 of step 11884 doesn't seem to be define in the database( DataTypes for each output/input checked ! TODO Duplicate data, are they consistent 3 ? Duplicate data, are they consistent 4 ? SELECT mptpi.id, mptpi.mtr_portfolio_id_1, mptpi.mtr_portfolio_id_2, mptpi.type, mptpi.hashtag_id, mptpi.min_score, mptpi.mtr_user_id, mptpi.created_at, mptpi.updated_at, mptpi.last_updated_at_desc, mptpi.last_updated_at_asc, h.hashtag FROM MTRPhoto.mtr_port_to_port_ids mptpi, MTRBack.hashtags h WHERE h.hashtag_id=mptpi.hashtag_id AND mptpi.`mtr_portfolio_id_1`=21967515 AND mptpi.`type`=3726 To do elapsed_time : count_nb_balles_and_create_portfolio 1.3930552005767822 # DISPLAY ALL COLLECTED DATA : {'02042025': {'nb_upload': 398, 'nb_taggue_class': 350, 'nb_taggue_densite': 350}} Inside saveOutput : final : True verbose : 0 saveOutput not yet implemented for datou_step.type : split_time_score we use saveGeneral [1349468810, 1349468804, 1349468795, 1349468791, 1349468732, 1349468729, 1349468726, 1349468722, 1349468718, 1349468714, 1349468530, 1349468527, 1349468520, 1349468516, 1349468456, 1349468454, 1349468438, 1349468391, 1349468356, 1349468328, 1349467987, 1349467967, 1349467954, 1349467951, 1349467948, 1349467936, 1349467867, 1349467862, 1349467858, 1349467853, 1349467808, 1349467801, 1349467797, 1349467794, 1349467618, 1349467569, 1349467545, 1349467542, 1349467538, 1349467467, 1349467463, 1349467460, 1349467457, 1349467410, 1349467381, 1349467374, 1349467354, 1349467342, 1349467340, 1349467324, 1349467314, 1349467309, 1349467305, 1349467291, 1349467288, 1349467286, 1349467284, 1349467283, 1349467277, 1349467259, 1349467254, 1349467247, 1349467242, 1349467238, 1349467236, 1349467226, 1349467220, 1349467216, 1349467212, 1349467208, 1349467203, 1349467185, 1349467179, 1349467172, 1349467169, 1349467165, 1349467164, 1349467160, 1349467159, 1349467158, 1349467157, 1349467156, 1349467155, 1349467140, 1349467137, 1349467131, 1349467130, 1349467125, 1349467124, 1349467120, 1349467119, 1349467111, 1349467110, 1349467104, 1349467103, 1349467056, 1349467053, 1349467043, 1349466955, 1349466941] Looping around the photos to save general results len do output : 1 /21962613Didn't retrieve data . before output type Here is an output not treated by saveGeneral : Managing all output in save final without adding information in the mtr_datou_result ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468810', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468804', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468795', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468791', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468732', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468729', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468726', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468722', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468718', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468714', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468530', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468527', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468520', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468516', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468456', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468454', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468438', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468391', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468356', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349468328', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467987', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467967', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467954', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467951', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467948', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467936', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467867', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467862', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467858', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467853', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467808', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467801', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467797', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467794', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467618', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467569', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467545', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467542', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467538', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467467', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467463', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467460', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467457', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467410', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467381', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467374', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467354', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467342', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467340', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467324', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467314', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467309', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467305', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467291', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467288', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467286', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467284', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467283', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467277', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467259', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467254', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467247', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467242', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467238', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467236', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467226', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467220', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467216', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467212', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467208', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467203', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467185', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467179', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467172', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467169', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467165', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467164', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467160', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467159', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467158', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467157', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467156', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467155', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467140', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467137', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467131', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467130', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467125', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467124', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467120', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467119', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467111', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467110', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467104', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467103', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467056', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467053', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349467043', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349466955', None, None, None, None, None, '2715752') ('4876', None, None, None, None, None, None, None, '2715752') ('4876', '21962613', '1349466941', None, None, None, None, None, '2715752') begin to insert list_values into mtr_datou_result : length of list_values in save_final : 101 time used for this insertion : 0.026773691177368164 save_final save missing photos in datou_result : time spend for datou_step_exec : 1.6516516208648682 time spend to save output : 0.02764606475830078 total time spend for step 1 : 1.679297685623169 caffe_path_current : About to save ! 2 After save, about to update current ! ret : 2 len(input) + len(total_photo_id_missing) : 1 set_done_treatment 1.29user 0.35system 0:05.66elapsed 29%CPU (0avgtext+0avgdata 101956maxresident)k 0inputs+112outputs (2major+48975minor)pagefaults 0swaps