2017-06-01 05:48:38,953 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 05:48:26 2017-06-01 05:48:38,953 INFO repeater task os150nb_lastensq starting 3.0 seconds late 2017-06-01 05:48:40,143 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 05:48:40,143 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 05:48:26 2017-06-01 05:52:50,646 INFO repeater task os150bb_10pings starting 4.9 seconds late 2017-06-01 05:52:50,820 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 05:52:50,820 INFO repeater task os150nb_10pings starting 5.0 seconds late 2017-06-01 05:52:50,915 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 05:53:26,055 INFO repeater task os150bb_quick starting 0.3 seconds late 2017-06-01 05:53:29,188 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 05:53:29,188 INFO repeater task os150bb_3dayplots starting 3.4 seconds late 2017-06-01 05:53:35,940 INFO repeater task os150bb_3dayplots ended after 6.8 seconds 2017-06-01 05:53:35,940 INFO repeater task os150bb_tsstats starting 10.2 seconds late 2017-06-01 05:53:36,500 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 05:53:36,500 INFO repeater task os150nb_lastensq starting 0.5 seconds late 2017-06-01 05:53:37,718 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 05:53:37,718 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 05:53:26 2017-06-01 05:53:37,719 INFO repeater task os150nb_quick starting 11.9 seconds late 2017-06-01 05:53:40,806 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 05:53:40,807 INFO repeater task os150nb_3dayplots starting 15.0 seconds late 2017-06-01 05:53:47,513 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 05:53:47,513 INFO repeater task os150nb_3dayplots ended after 6.7 seconds 2017-06-01 05:53:47,513 INFO repeater task os150nb_tsstats starting 21.7 seconds late 2017-06-01 05:53:48,058 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 05:53:48,059 INFO repeater task os150bb_beamplots starting 22.3 seconds late 2017-06-01 05:53:48,963 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 05:53:48,964 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 05:53:48,964 INFO repeater task os150bb_beamplots starting 23.2 seconds late 2017-06-01 05:53:49,900 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 05:53:49,900 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 05:53:49,900 INFO repeater task os150nb_beamplots starting 24.1 seconds late 2017-06-01 05:53:50,857 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 05:53:50,857 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 05:53:50,858 INFO repeater task os150nb_beamplots starting 25.1 seconds late 2017-06-01 05:53:51,876 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 05:53:51,876 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 05:53:51,876 INFO repeater task posmv_hcorrstats starting 26.1 seconds late 2017-06-01 05:53:52,725 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 05:53:52,725 INFO repeater task posmv_plotposmv starting 26.9 seconds late 2017-06-01 05:53:53,388 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 05:53:58,394 INFO repeater task os150bb_lastensq starting 22.4 seconds late 2017-06-01 05:54:00,249 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 05:54:00,250 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 05:53:26 2017-06-01 05:58:10,648 INFO repeater task os150bb_10pings starting 4.9 seconds late 2017-06-01 05:58:10,818 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 05:58:10,819 INFO repeater task os150nb_10pings starting 5.0 seconds late 2017-06-01 05:58:10,920 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 05:58:25,943 INFO repeater task posmv_hcorrstats starting 0.2 seconds late 2017-06-01 05:58:26,779 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 05:58:26,779 INFO repeater task posmv_plotposmv starting 1.0 seconds late 2017-06-01 05:58:27,430 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 05:58:37,444 INFO repeater task os150bb_lastensq starting 1.4 seconds late 2017-06-01 05:58:39,256 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 05:58:39,256 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 05:58:26 2017-06-01 05:58:39,257 INFO repeater task os150nb_lastensq starting 3.3 seconds late 2017-06-01 05:58:40,483 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 05:58:40,483 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 05:58:26 2017-06-01 06:03:26,074 INFO repeater task os150bb_10pings starting 0.3 seconds late 2017-06-01 06:03:26,256 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:03:26,257 INFO repeater task os150nb_10pings starting 0.5 seconds late 2017-06-01 06:03:26,354 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:03:26,355 INFO repeater task posmv_hcorrstats starting 0.6 seconds late 2017-06-01 06:03:27,184 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:03:27,184 INFO repeater task posmv_plotposmv starting 1.4 seconds late 2017-06-01 06:03:27,804 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:03:37,816 INFO repeater task os150bb_lastensq starting 1.8 seconds late 2017-06-01 06:03:39,566 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 06:03:39,567 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:03:26 2017-06-01 06:03:39,567 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2017-06-01 06:03:40,765 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 06:03:40,765 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:03:26 2017-06-01 06:08:26,351 INFO repeater task os150bb_quick starting 0.6 seconds late 2017-06-01 06:08:29,479 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 06:08:29,479 INFO repeater task os150bb_3dayplots starting 3.7 seconds late 2017-06-01 06:08:35,688 INFO repeater task os150bb_3dayplots ended after 6.2 seconds 2017-06-01 06:08:35,689 INFO repeater task os150bb_tsstats starting 9.9 seconds late 2017-06-01 06:08:36,230 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 06:08:36,230 INFO repeater task os150nb_lastensq starting 0.2 seconds late 2017-06-01 06:08:37,379 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 06:08:37,379 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:08:26 2017-06-01 06:08:37,379 INFO repeater task os150nb_quick starting 11.6 seconds late 2017-06-01 06:08:40,383 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 06:08:40,384 INFO repeater task os150nb_3dayplots starting 14.6 seconds late 2017-06-01 06:08:46,700 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 06:08:46,700 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 06:08:46,701 INFO repeater task os150nb_tsstats starting 20.9 seconds late 2017-06-01 06:08:47,265 INFO repeater task os150nb_tsstats ended after 0.6 seconds 2017-06-01 06:08:47,266 INFO repeater task os150bb_beamplots starting 21.5 seconds late 2017-06-01 06:08:48,185 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:08:48,185 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:08:48,185 INFO repeater task os150bb_beamplots starting 22.4 seconds late 2017-06-01 06:08:49,112 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:08:49,112 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:08:49,112 INFO repeater task os150nb_beamplots starting 23.3 seconds late 2017-06-01 06:08:50,020 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:08:50,021 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:08:50,021 INFO repeater task os150nb_beamplots starting 24.2 seconds late 2017-06-01 06:08:50,933 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:08:50,933 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:08:50,934 INFO repeater task posmv_hcorrstats starting 25.2 seconds late 2017-06-01 06:08:51,757 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:08:51,757 INFO repeater task posmv_plotposmv starting 26.0 seconds late 2017-06-01 06:08:52,353 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:08:57,358 INFO repeater task os150bb_lastensq starting 21.4 seconds late 2017-06-01 06:08:59,090 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 06:08:59,090 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:08:26 2017-06-01 06:08:59,090 INFO repeater task os150bb_10pings starting 13.3 seconds late 2017-06-01 06:08:59,188 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 06:08:59,190 INFO repeater task os150nb_10pings starting 13.4 seconds late 2017-06-01 06:08:59,285 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:13:29,905 INFO repeater task posmv_hcorrstats starting 4.1 seconds late 2017-06-01 06:13:30,742 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:13:30,743 INFO repeater task posmv_plotposmv starting 5.0 seconds late 2017-06-01 06:13:31,354 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:13:36,357 INFO repeater task os150bb_lastensq starting 0.4 seconds late 2017-06-01 06:13:37,935 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2017-06-01 06:13:37,935 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:13:26 2017-06-01 06:13:37,936 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2017-06-01 06:13:39,057 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 06:13:39,057 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:13:26 2017-06-01 06:14:09,113 INFO repeater task os150bb_10pings starting 3.3 seconds late 2017-06-01 06:14:09,310 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:14:09,311 INFO repeater task os150nb_10pings starting 3.5 seconds late 2017-06-01 06:14:09,419 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:18:29,995 INFO repeater task posmv_hcorrstats starting 4.2 seconds late 2017-06-01 06:18:30,872 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 06:18:30,872 INFO repeater task posmv_plotposmv starting 5.1 seconds late 2017-06-01 06:18:31,465 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:18:36,469 INFO repeater task os150bb_lastensq starting 0.5 seconds late 2017-06-01 06:18:38,223 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 06:18:38,223 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:18:26 2017-06-01 06:18:38,224 INFO repeater task os150nb_lastensq starting 2.2 seconds late 2017-06-01 06:18:39,408 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 06:18:39,408 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:18:26 2017-06-01 06:19:29,517 INFO repeater task os150bb_10pings starting 3.7 seconds late 2017-06-01 06:19:29,689 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:19:29,690 INFO repeater task os150nb_10pings starting 3.9 seconds late 2017-06-01 06:19:29,783 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:23:30,266 INFO repeater task os150bb_quick starting 4.5 seconds late 2017-06-01 06:23:33,368 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 06:23:33,368 INFO repeater task os150bb_3dayplots starting 7.6 seconds late 2017-06-01 06:23:39,565 INFO repeater task os150bb_3dayplots ended after 6.2 seconds 2017-06-01 06:23:39,565 INFO repeater task os150bb_tsstats starting 13.8 seconds late 2017-06-01 06:23:40,122 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 06:23:40,123 INFO repeater task os150nb_lastensq starting 4.1 seconds late 2017-06-01 06:23:41,306 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 06:23:41,306 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:23:26 2017-06-01 06:23:41,307 INFO repeater task os150nb_quick starting 15.5 seconds late 2017-06-01 06:23:44,282 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 06:23:44,282 INFO repeater task os150nb_3dayplots starting 18.5 seconds late 2017-06-01 06:23:50,530 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 06:23:50,530 INFO repeater task os150nb_3dayplots ended after 6.2 seconds 2017-06-01 06:23:50,531 INFO repeater task os150nb_tsstats starting 24.7 seconds late 2017-06-01 06:23:51,080 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 06:23:51,080 INFO repeater task os150bb_beamplots starting 25.3 seconds late 2017-06-01 06:23:51,992 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:23:51,992 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:23:51,992 INFO repeater task os150bb_beamplots starting 26.2 seconds late 2017-06-01 06:23:52,901 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:23:52,901 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:23:52,901 INFO repeater task os150nb_beamplots starting 27.1 seconds late 2017-06-01 06:23:53,823 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:23:53,823 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:23:53,824 INFO repeater task os150nb_beamplots starting 28.0 seconds late 2017-06-01 06:23:54,726 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:23:54,726 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:23:54,726 INFO repeater task posmv_hcorrstats starting 28.9 seconds late 2017-06-01 06:23:55,568 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:23:55,568 INFO repeater task posmv_plotposmv starting 29.8 seconds late 2017-06-01 06:23:56,177 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:24:01,182 INFO repeater task os150bb_lastensq starting 25.2 seconds late 2017-06-01 06:24:02,959 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 06:24:02,959 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:23:26 2017-06-01 06:24:48,045 INFO repeater task os150bb_10pings starting 2.3 seconds late 2017-06-01 06:24:48,195 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 06:24:48,195 INFO repeater task os150nb_10pings starting 2.4 seconds late 2017-06-01 06:24:48,288 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:28:28,761 INFO repeater task posmv_hcorrstats starting 3.0 seconds late 2017-06-01 06:28:29,668 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 06:28:29,668 INFO repeater task posmv_plotposmv starting 3.9 seconds late 2017-06-01 06:28:30,287 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:28:40,300 INFO repeater task os150bb_lastensq starting 4.3 seconds late 2017-06-01 06:28:42,091 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 06:28:42,092 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:28:26 2017-06-01 06:28:42,092 INFO repeater task os150nb_lastensq starting 6.1 seconds late 2017-06-01 06:28:43,399 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 06:28:43,400 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:28:26 2017-06-01 06:30:08,565 INFO repeater task os150bb_10pings starting 2.8 seconds late 2017-06-01 06:30:08,726 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:30:08,726 INFO repeater task os150nb_10pings starting 2.9 seconds late 2017-06-01 06:30:08,817 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:33:29,240 INFO repeater task posmv_hcorrstats starting 3.5 seconds late 2017-06-01 06:33:30,067 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:33:30,067 INFO repeater task posmv_plotposmv starting 4.3 seconds late 2017-06-01 06:33:30,697 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:33:40,714 INFO repeater task os150bb_lastensq starting 4.7 seconds late 2017-06-01 06:33:42,587 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 06:33:42,587 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:33:26 2017-06-01 06:33:42,588 INFO repeater task os150nb_lastensq starting 6.6 seconds late 2017-06-01 06:33:43,854 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 06:33:43,854 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:33:26 2017-06-01 06:35:29,080 INFO repeater task os150bb_10pings starting 3.3 seconds late 2017-06-01 06:35:29,211 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 06:35:29,211 INFO repeater task os150nb_10pings starting 3.4 seconds late 2017-06-01 06:35:29,302 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:38:29,665 INFO repeater task os150bb_quick starting 3.9 seconds late 2017-06-01 06:38:32,796 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 06:38:32,796 INFO repeater task os150bb_3dayplots starting 7.0 seconds late 2017-06-01 06:38:39,004 INFO repeater task os150bb_3dayplots ended after 6.2 seconds 2017-06-01 06:38:39,005 INFO repeater task os150bb_tsstats starting 13.2 seconds late 2017-06-01 06:38:39,561 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 06:38:39,561 INFO repeater task os150nb_lastensq starting 3.6 seconds late 2017-06-01 06:38:40,709 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 06:38:40,710 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:38:26 2017-06-01 06:38:40,710 INFO repeater task os150nb_quick starting 14.9 seconds late 2017-06-01 06:38:43,673 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 06:38:43,673 INFO repeater task os150nb_3dayplots starting 17.9 seconds late 2017-06-01 06:38:49,926 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 06:38:49,926 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 06:38:49,927 INFO repeater task os150nb_tsstats starting 24.1 seconds late 2017-06-01 06:38:50,477 INFO repeater task os150nb_tsstats ended after 0.6 seconds 2017-06-01 06:38:50,477 INFO repeater task os150bb_beamplots starting 24.7 seconds late 2017-06-01 06:38:51,385 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:38:51,385 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:38:51,386 INFO repeater task os150bb_beamplots starting 25.6 seconds late 2017-06-01 06:38:52,320 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:38:52,320 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:38:52,320 INFO repeater task os150nb_beamplots starting 26.5 seconds late 2017-06-01 06:38:53,230 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:38:53,230 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:38:53,233 INFO repeater task os150nb_beamplots starting 27.5 seconds late 2017-06-01 06:38:54,189 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:38:54,189 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 06:38:54,190 INFO repeater task posmv_hcorrstats starting 28.4 seconds late 2017-06-01 06:38:55,009 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:38:55,009 INFO repeater task posmv_plotposmv starting 29.2 seconds late 2017-06-01 06:38:55,635 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:39:00,640 INFO repeater task os150bb_lastensq starting 24.6 seconds late 2017-06-01 06:39:02,407 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 06:39:02,408 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:38:26 2017-06-01 06:40:47,618 INFO repeater task os150bb_10pings starting 1.8 seconds late 2017-06-01 06:40:47,761 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 06:40:47,762 INFO repeater task os150nb_10pings starting 2.0 seconds late 2017-06-01 06:40:47,855 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:43:28,192 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2017-06-01 06:43:29,047 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 06:43:29,048 INFO repeater task posmv_plotposmv starting 3.3 seconds late 2017-06-01 06:43:29,648 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:43:39,665 INFO repeater task os150bb_lastensq starting 3.7 seconds late 2017-06-01 06:43:41,352 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 06:43:41,352 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:43:26 2017-06-01 06:43:41,353 INFO repeater task os150nb_lastensq starting 5.4 seconds late 2017-06-01 06:43:42,505 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 06:43:42,505 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:43:26 2017-06-01 06:46:07,802 INFO repeater task os150bb_10pings starting 2.0 seconds late 2017-06-01 06:46:07,938 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 06:46:07,939 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 06:46:08,040 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:48:28,315 INFO repeater task posmv_hcorrstats starting 2.5 seconds late 2017-06-01 06:48:29,263 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 06:48:29,264 INFO repeater task posmv_plotposmv starting 3.5 seconds late 2017-06-01 06:48:29,925 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 06:48:39,943 INFO repeater task os150bb_lastensq starting 3.9 seconds late 2017-06-01 06:48:41,844 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 06:48:41,844 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:48:26 2017-06-01 06:48:41,845 INFO repeater task os150nb_lastensq starting 5.8 seconds late 2017-06-01 06:48:43,183 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 06:48:43,183 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:48:26 2017-06-01 06:51:28,518 INFO repeater task os150bb_10pings starting 2.7 seconds late 2017-06-01 06:51:28,690 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:51:28,691 INFO repeater task os150nb_10pings starting 2.9 seconds late 2017-06-01 06:51:28,787 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:53:29,067 INFO repeater task os150bb_quick starting 3.3 seconds late 2017-06-01 06:53:32,199 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 06:53:32,200 INFO repeater task os150bb_3dayplots starting 6.4 seconds late 2017-06-01 06:53:38,908 INFO repeater task os150bb_3dayplots ended after 6.7 seconds 2017-06-01 06:53:38,908 INFO repeater task os150bb_tsstats starting 13.1 seconds late 2017-06-01 06:53:39,480 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 06:53:39,480 INFO repeater task os150nb_lastensq starting 3.5 seconds late 2017-06-01 06:53:40,759 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 06:53:40,759 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:53:26 2017-06-01 06:53:40,760 INFO repeater task os150nb_quick starting 15.0 seconds late 2017-06-01 06:53:43,876 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 06:53:43,876 INFO repeater task os150nb_3dayplots starting 18.1 seconds late 2017-06-01 06:53:50,616 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 06:53:50,616 INFO repeater task os150nb_3dayplots ended after 6.7 seconds 2017-06-01 06:53:50,616 INFO repeater task os150nb_tsstats starting 24.8 seconds late 2017-06-01 06:53:51,161 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 06:53:51,162 INFO repeater task os150bb_beamplots starting 25.4 seconds late 2017-06-01 06:53:52,105 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:53:52,105 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:53:52,105 INFO repeater task os150bb_beamplots starting 26.3 seconds late 2017-06-01 06:53:53,033 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:53:53,033 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 06:53:53,033 INFO repeater task os150nb_beamplots starting 27.3 seconds late 2017-06-01 06:53:53,944 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:53:53,944 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 06:53:53,945 INFO repeater task os150nb_beamplots starting 28.2 seconds late 2017-06-01 06:53:54,935 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 06:53:54,935 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 06:53:54,936 INFO repeater task posmv_hcorrstats starting 29.2 seconds late 2017-06-01 06:53:55,773 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 06:53:55,774 INFO repeater task posmv_plotposmv starting 30.0 seconds late 2017-06-01 06:53:56,407 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:54:01,412 INFO repeater task os150bb_lastensq starting 25.4 seconds late 2017-06-01 06:54:03,133 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 06:54:03,133 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:53:26 2017-06-01 06:56:48,442 INFO repeater task os150bb_10pings starting 2.7 seconds late 2017-06-01 06:56:48,615 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 06:56:48,616 INFO repeater task os150nb_10pings starting 2.8 seconds late 2017-06-01 06:56:48,709 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 06:58:28,930 INFO repeater task posmv_hcorrstats starting 3.1 seconds late 2017-06-01 06:58:29,878 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 06:58:29,879 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2017-06-01 06:58:30,490 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 06:58:40,508 INFO repeater task os150bb_lastensq starting 4.5 seconds late 2017-06-01 06:58:42,190 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 06:58:42,190 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 06:58:26 2017-06-01 06:58:42,190 INFO repeater task os150nb_lastensq starting 6.2 seconds late 2017-06-01 06:58:43,395 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 06:58:43,396 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 06:58:26 2017-06-01 07:02:08,824 INFO repeater task os150bb_10pings starting 3.0 seconds late 2017-06-01 07:02:08,982 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 07:02:08,983 INFO repeater task os150nb_10pings starting 3.2 seconds late 2017-06-01 07:02:09,080 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:03:29,268 INFO repeater task posmv_hcorrstats starting 3.5 seconds late 2017-06-01 07:03:30,183 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:03:30,183 INFO repeater task posmv_plotposmv starting 4.4 seconds late 2017-06-01 07:03:30,812 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:03:40,829 INFO repeater task os150bb_lastensq starting 4.8 seconds late 2017-06-01 07:03:42,528 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:03:42,529 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:03:26 2017-06-01 07:03:42,530 INFO repeater task os150nb_lastensq starting 6.5 seconds late 2017-06-01 07:03:43,703 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:03:43,703 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:03:26 2017-06-01 07:07:29,213 INFO repeater task os150bb_10pings starting 3.4 seconds late 2017-06-01 07:07:29,304 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:07:29,305 INFO repeater task os150nb_10pings starting 3.5 seconds late 2017-06-01 07:07:29,399 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:08:29,530 INFO repeater task os150bb_quick starting 3.8 seconds late 2017-06-01 07:08:32,807 INFO repeater task os150bb_quick ended after 3.3 seconds 2017-06-01 07:08:32,808 INFO repeater task os150bb_3dayplots starting 7.0 seconds late 2017-06-01 07:08:39,483 INFO repeater task os150bb_3dayplots ended after 6.7 seconds 2017-06-01 07:08:39,483 INFO repeater task os150bb_tsstats starting 13.7 seconds late 2017-06-01 07:08:40,056 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 07:08:40,056 INFO repeater task os150nb_lastensq starting 4.1 seconds late 2017-06-01 07:08:41,287 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:08:41,288 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:08:26 2017-06-01 07:08:41,288 INFO repeater task os150nb_quick starting 15.5 seconds late 2017-06-01 07:08:44,423 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 07:08:44,423 INFO repeater task os150nb_3dayplots starting 18.6 seconds late 2017-06-01 07:08:51,138 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 07:08:51,139 INFO repeater task os150nb_3dayplots ended after 6.7 seconds 2017-06-01 07:08:51,139 INFO repeater task os150nb_tsstats starting 25.4 seconds late 2017-06-01 07:08:51,713 INFO repeater task os150nb_tsstats ended after 0.6 seconds 2017-06-01 07:08:51,714 INFO repeater task os150bb_beamplots starting 25.9 seconds late 2017-06-01 07:08:52,650 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:08:52,650 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 07:08:52,650 INFO repeater task os150bb_beamplots starting 26.9 seconds late 2017-06-01 07:08:53,594 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:08:53,594 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 07:08:53,595 INFO repeater task os150nb_beamplots starting 27.8 seconds late 2017-06-01 07:08:54,568 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:08:54,568 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 07:08:54,569 INFO repeater task os150nb_beamplots starting 28.8 seconds late 2017-06-01 07:08:55,532 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:08:55,532 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 07:08:55,532 INFO repeater task posmv_hcorrstats starting 29.8 seconds late 2017-06-01 07:08:56,392 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:08:56,393 INFO repeater task posmv_plotposmv starting 30.6 seconds late 2017-06-01 07:08:57,019 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:09:02,025 INFO repeater task os150bb_lastensq starting 26.0 seconds late 2017-06-01 07:09:03,797 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 07:09:03,798 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:08:26 2017-06-01 07:12:49,241 INFO repeater task os150bb_10pings starting 3.5 seconds late 2017-06-01 07:12:49,341 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:12:49,341 INFO repeater task os150nb_10pings starting 3.6 seconds late 2017-06-01 07:12:49,438 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:13:29,507 INFO repeater task posmv_hcorrstats starting 3.7 seconds late 2017-06-01 07:13:30,412 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:13:30,412 INFO repeater task posmv_plotposmv starting 4.6 seconds late 2017-06-01 07:13:31,054 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:13:36,060 INFO repeater task os150bb_lastensq starting 0.1 seconds late 2017-06-01 07:13:37,852 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 07:13:37,852 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:13:26 2017-06-01 07:13:37,853 INFO repeater task os150nb_lastensq starting 1.9 seconds late 2017-06-01 07:13:39,048 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:13:39,049 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:13:26 2017-06-01 07:18:09,526 INFO repeater task os150bb_10pings starting 3.7 seconds late 2017-06-01 07:18:09,683 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 07:18:09,683 INFO repeater task os150nb_10pings starting 3.9 seconds late 2017-06-01 07:18:09,779 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:18:29,826 INFO repeater task posmv_hcorrstats starting 4.0 seconds late 2017-06-01 07:18:30,796 INFO repeater task posmv_hcorrstats ended after 1.0 seconds 2017-06-01 07:18:30,796 INFO repeater task posmv_plotposmv starting 5.0 seconds late 2017-06-01 07:18:31,418 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:18:36,424 INFO repeater task os150bb_lastensq starting 0.4 seconds late 2017-06-01 07:18:38,214 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 07:18:38,214 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:18:26 2017-06-01 07:18:38,215 INFO repeater task os150nb_lastensq starting 2.2 seconds late 2017-06-01 07:18:39,428 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:18:39,429 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:18:26 2017-06-01 07:23:30,049 INFO repeater task os150bb_10pings starting 4.3 seconds late 2017-06-01 07:23:30,195 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:23:30,196 INFO repeater task os150bb_quick starting 4.4 seconds late 2017-06-01 07:23:33,206 INFO repeater task os150bb_quick ended after 3.0 seconds 2017-06-01 07:23:33,206 INFO repeater task os150bb_3dayplots starting 7.4 seconds late 2017-06-01 07:23:39,519 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 07:23:39,519 INFO repeater task os150bb_tsstats starting 13.7 seconds late 2017-06-01 07:23:40,115 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 07:23:40,115 INFO repeater task os150nb_lastensq starting 4.1 seconds late 2017-06-01 07:23:41,420 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 07:23:41,420 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:23:26 2017-06-01 07:23:41,420 INFO repeater task os150nb_10pings starting 15.6 seconds late 2017-06-01 07:23:41,518 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:23:41,519 INFO repeater task os150nb_quick starting 15.7 seconds late 2017-06-01 07:23:44,598 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 07:23:44,598 INFO repeater task os150nb_3dayplots starting 18.8 seconds late 2017-06-01 07:23:50,957 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 07:23:50,958 INFO repeater task os150nb_3dayplots ended after 6.4 seconds 2017-06-01 07:23:50,958 INFO repeater task os150nb_tsstats starting 25.2 seconds late 2017-06-01 07:23:51,539 INFO repeater task os150nb_tsstats output: /usr/lib/python2.7/dist-packages/numpy/ma/core.py:1073: RuntimeWarning: overflow encountered in true_divide result = self.f(da, db, *args, **kwargs) 2017-06-01 07:23:51,539 INFO repeater task os150nb_tsstats ended after 0.6 seconds 2017-06-01 07:23:51,540 INFO repeater task os150bb_beamplots starting 25.8 seconds late 2017-06-01 07:23:52,482 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:23:52,482 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 07:23:52,483 INFO repeater task os150bb_beamplots starting 26.7 seconds late 2017-06-01 07:23:53,463 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:23:53,464 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 07:23:53,464 INFO repeater task os150nb_beamplots starting 27.7 seconds late 2017-06-01 07:23:54,405 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:23:54,406 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 07:23:54,406 INFO repeater task os150nb_beamplots starting 28.6 seconds late 2017-06-01 07:23:55,363 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:23:55,363 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 07:23:55,364 INFO repeater task posmv_hcorrstats starting 29.6 seconds late 2017-06-01 07:23:56,197 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 07:23:56,198 INFO repeater task posmv_plotposmv starting 30.4 seconds late 2017-06-01 07:23:56,857 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 07:24:01,862 INFO repeater task os150bb_lastensq starting 25.9 seconds late 2017-06-01 07:24:03,579 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:24:03,579 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:23:26 2017-06-01 07:28:29,119 INFO repeater task posmv_hcorrstats starting 3.3 seconds late 2017-06-01 07:28:30,024 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:28:30,025 INFO repeater task posmv_plotposmv starting 4.2 seconds late 2017-06-01 07:28:30,673 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:28:40,691 INFO repeater task os150bb_lastensq starting 4.7 seconds late 2017-06-01 07:28:42,537 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 07:28:42,537 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:28:26 2017-06-01 07:28:42,538 INFO repeater task os150nb_lastensq starting 6.5 seconds late 2017-06-01 07:28:43,866 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 07:28:43,866 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:28:26 2017-06-01 07:28:48,871 INFO repeater task os150bb_10pings starting 3.1 seconds late 2017-06-01 07:28:48,973 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:28:48,974 INFO repeater task os150nb_10pings starting 3.2 seconds late 2017-06-01 07:28:49,066 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:33:29,627 INFO repeater task posmv_hcorrstats starting 3.8 seconds late 2017-06-01 07:33:30,536 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:33:30,537 INFO repeater task posmv_plotposmv starting 4.8 seconds late 2017-06-01 07:33:31,138 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:33:36,144 INFO repeater task os150bb_lastensq starting 0.1 seconds late 2017-06-01 07:33:37,847 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:33:37,847 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:33:26 2017-06-01 07:33:37,848 INFO repeater task os150nb_lastensq starting 1.8 seconds late 2017-06-01 07:33:38,989 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 07:33:38,990 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:33:26 2017-06-01 07:34:09,048 INFO repeater task os150bb_10pings starting 3.3 seconds late 2017-06-01 07:34:09,196 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:34:09,197 INFO repeater task os150nb_10pings starting 3.4 seconds late 2017-06-01 07:34:09,291 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:38:29,802 INFO repeater task os150bb_quick starting 4.0 seconds late 2017-06-01 07:38:33,043 INFO repeater task os150bb_quick ended after 3.2 seconds 2017-06-01 07:38:33,043 INFO repeater task os150bb_3dayplots starting 7.3 seconds late 2017-06-01 07:38:39,309 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 07:38:39,309 INFO repeater task os150bb_tsstats starting 13.5 seconds late 2017-06-01 07:38:39,849 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 07:38:39,850 INFO repeater task os150nb_lastensq starting 3.9 seconds late 2017-06-01 07:38:41,008 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:38:41,009 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:38:26 2017-06-01 07:38:41,009 INFO repeater task os150nb_quick starting 15.2 seconds late 2017-06-01 07:38:44,048 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 07:38:44,048 INFO repeater task os150nb_3dayplots starting 18.3 seconds late 2017-06-01 07:38:50,332 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 07:38:50,332 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 07:38:50,332 INFO repeater task os150nb_tsstats starting 24.6 seconds late 2017-06-01 07:38:50,900 INFO repeater task os150nb_tsstats ended after 0.6 seconds 2017-06-01 07:38:50,900 INFO repeater task os150bb_beamplots starting 25.1 seconds late 2017-06-01 07:38:51,851 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:38:51,851 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 07:38:51,852 INFO repeater task os150bb_beamplots starting 26.1 seconds late 2017-06-01 07:38:52,825 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:38:52,825 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 07:38:52,826 INFO repeater task os150nb_beamplots starting 27.0 seconds late 2017-06-01 07:38:53,748 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:38:53,748 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 07:38:53,748 INFO repeater task os150nb_beamplots starting 28.0 seconds late 2017-06-01 07:38:54,670 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:38:54,670 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 07:38:54,670 INFO repeater task posmv_hcorrstats starting 28.9 seconds late 2017-06-01 07:38:55,502 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 07:38:55,503 INFO repeater task posmv_plotposmv starting 29.7 seconds late 2017-06-01 07:38:56,118 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:39:01,124 INFO repeater task os150bb_lastensq starting 25.1 seconds late 2017-06-01 07:39:02,840 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:39:02,840 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:38:26 2017-06-01 07:39:27,895 INFO repeater task os150bb_10pings starting 2.1 seconds late 2017-06-01 07:39:28,039 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:39:28,040 INFO repeater task os150nb_10pings starting 2.3 seconds late 2017-06-01 07:39:28,130 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:43:28,695 INFO repeater task posmv_hcorrstats starting 2.9 seconds late 2017-06-01 07:43:29,638 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:43:29,638 INFO repeater task posmv_plotposmv starting 3.9 seconds late 2017-06-01 07:43:30,281 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:43:40,299 INFO repeater task os150bb_lastensq starting 4.3 seconds late 2017-06-01 07:43:42,021 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:43:42,021 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:43:26 2017-06-01 07:43:42,022 INFO repeater task os150nb_lastensq starting 6.0 seconds late 2017-06-01 07:43:43,195 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:43:43,195 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:43:26 2017-06-01 07:44:48,347 INFO repeater task os150bb_10pings starting 2.6 seconds late 2017-06-01 07:44:48,523 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 07:44:48,524 INFO repeater task os150nb_10pings starting 2.7 seconds late 2017-06-01 07:44:48,619 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:48:28,983 INFO repeater task posmv_hcorrstats starting 3.2 seconds late 2017-06-01 07:48:29,839 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 07:48:29,839 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2017-06-01 07:48:30,449 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:48:40,464 INFO repeater task os150bb_lastensq starting 4.5 seconds late 2017-06-01 07:48:42,208 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:48:42,208 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:48:26 2017-06-01 07:48:42,209 INFO repeater task os150nb_lastensq starting 6.2 seconds late 2017-06-01 07:48:43,351 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 07:48:43,351 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:48:26 2017-06-01 07:50:08,533 INFO repeater task os150bb_10pings starting 2.8 seconds late 2017-06-01 07:50:08,705 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 07:50:08,706 INFO repeater task os150nb_10pings starting 2.9 seconds late 2017-06-01 07:50:08,799 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:53:29,347 INFO repeater task os150bb_quick starting 3.6 seconds late 2017-06-01 07:53:32,530 INFO repeater task os150bb_quick ended after 3.2 seconds 2017-06-01 07:53:32,530 INFO repeater task os150bb_3dayplots starting 6.7 seconds late 2017-06-01 07:53:38,785 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 07:53:38,785 INFO repeater task os150bb_tsstats starting 13.0 seconds late 2017-06-01 07:53:39,316 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 07:53:39,317 INFO repeater task os150nb_lastensq starting 3.3 seconds late 2017-06-01 07:53:40,462 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 07:53:40,463 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:53:26 2017-06-01 07:53:40,463 INFO repeater task os150nb_quick starting 14.7 seconds late 2017-06-01 07:53:43,530 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 07:53:43,530 INFO repeater task os150nb_3dayplots starting 17.7 seconds late 2017-06-01 07:53:49,851 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 07:53:49,851 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 07:53:49,852 INFO repeater task os150nb_tsstats starting 24.1 seconds late 2017-06-01 07:53:50,388 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 07:53:50,388 INFO repeater task os150bb_beamplots starting 24.6 seconds late 2017-06-01 07:53:51,305 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:53:51,305 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 07:53:51,306 INFO repeater task os150bb_beamplots starting 25.5 seconds late 2017-06-01 07:53:52,231 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:53:52,231 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 07:53:52,231 INFO repeater task os150nb_beamplots starting 26.5 seconds late 2017-06-01 07:53:53,154 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:53:53,154 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 07:53:53,154 INFO repeater task os150nb_beamplots starting 27.4 seconds late 2017-06-01 07:53:54,098 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 07:53:54,098 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 07:53:54,099 INFO repeater task posmv_hcorrstats starting 28.3 seconds late 2017-06-01 07:53:54,943 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 07:53:54,943 INFO repeater task posmv_plotposmv starting 29.2 seconds late 2017-06-01 07:53:55,559 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 07:54:00,565 INFO repeater task os150bb_lastensq starting 24.6 seconds late 2017-06-01 07:54:02,232 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 07:54:02,232 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:53:26 2017-06-01 07:55:27,398 INFO repeater task os150bb_10pings starting 1.6 seconds late 2017-06-01 07:55:27,493 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 07:55:27,494 INFO repeater task os150nb_10pings starting 1.7 seconds late 2017-06-01 07:55:27,587 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 07:58:27,957 INFO repeater task posmv_hcorrstats starting 2.2 seconds late 2017-06-01 07:58:28,952 INFO repeater task posmv_hcorrstats ended after 1.0 seconds 2017-06-01 07:58:28,953 INFO repeater task posmv_plotposmv starting 3.2 seconds late 2017-06-01 07:58:29,625 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 07:58:39,641 INFO repeater task os150bb_lastensq starting 3.6 seconds late 2017-06-01 07:58:41,408 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 07:58:41,408 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 07:58:26 2017-06-01 07:58:41,409 INFO repeater task os150nb_lastensq starting 5.4 seconds late 2017-06-01 07:58:42,618 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 07:58:42,618 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 07:58:26 2017-06-01 08:00:47,816 INFO repeater task os150bb_10pings starting 2.0 seconds late 2017-06-01 08:00:47,989 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:00:47,990 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 08:00:48,083 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:03:28,363 INFO repeater task posmv_hcorrstats starting 2.6 seconds late 2017-06-01 08:03:29,317 INFO repeater task posmv_hcorrstats ended after 1.0 seconds 2017-06-01 08:03:29,317 INFO repeater task posmv_plotposmv starting 3.5 seconds late 2017-06-01 08:03:29,942 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:03:39,960 INFO repeater task os150bb_lastensq starting 4.0 seconds late 2017-06-01 08:03:41,836 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 08:03:41,837 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:03:26 2017-06-01 08:03:41,837 INFO repeater task os150nb_lastensq starting 5.8 seconds late 2017-06-01 08:03:43,094 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 08:03:43,095 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:03:26 2017-06-01 08:06:08,396 INFO repeater task os150bb_10pings starting 2.6 seconds late 2017-06-01 08:06:08,534 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 08:06:08,535 INFO repeater task os150nb_10pings starting 2.8 seconds late 2017-06-01 08:06:08,627 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:08:28,912 INFO repeater task os150bb_quick starting 3.1 seconds late 2017-06-01 08:08:32,084 INFO repeater task os150bb_quick ended after 3.2 seconds 2017-06-01 08:08:32,084 INFO repeater task os150bb_3dayplots starting 6.3 seconds late 2017-06-01 08:08:38,429 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 08:08:38,429 INFO repeater task os150bb_tsstats starting 12.6 seconds late 2017-06-01 08:08:38,962 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 08:08:38,962 INFO repeater task os150nb_lastensq starting 3.0 seconds late 2017-06-01 08:08:40,120 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:08:40,120 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:08:26 2017-06-01 08:08:40,120 INFO repeater task os150nb_quick starting 14.3 seconds late 2017-06-01 08:08:43,139 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 08:08:43,139 INFO repeater task os150nb_3dayplots starting 17.4 seconds late 2017-06-01 08:08:49,424 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 08:08:49,424 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 08:08:49,425 INFO repeater task os150nb_tsstats starting 23.6 seconds late 2017-06-01 08:08:49,966 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 08:08:49,966 INFO repeater task os150bb_beamplots starting 24.2 seconds late 2017-06-01 08:08:50,883 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:08:50,883 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 08:08:50,884 INFO repeater task os150bb_beamplots starting 25.1 seconds late 2017-06-01 08:08:51,809 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:08:51,809 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 08:08:51,809 INFO repeater task os150nb_beamplots starting 26.0 seconds late 2017-06-01 08:08:52,712 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:08:52,712 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 08:08:52,713 INFO repeater task os150nb_beamplots starting 26.9 seconds late 2017-06-01 08:08:53,662 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:08:53,663 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 08:08:53,663 INFO repeater task posmv_hcorrstats starting 27.9 seconds late 2017-06-01 08:08:54,487 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 08:08:54,487 INFO repeater task posmv_plotposmv starting 28.7 seconds late 2017-06-01 08:08:55,087 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:09:00,093 INFO repeater task os150bb_lastensq starting 24.1 seconds late 2017-06-01 08:09:01,747 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 08:09:01,747 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:08:26 2017-06-01 08:11:27,060 INFO repeater task os150bb_10pings starting 1.3 seconds late 2017-06-01 08:11:27,234 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:11:27,235 INFO repeater task os150nb_10pings starting 1.5 seconds late 2017-06-01 08:11:27,328 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:13:27,591 INFO repeater task posmv_hcorrstats starting 1.8 seconds late 2017-06-01 08:13:28,490 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 08:13:28,490 INFO repeater task posmv_plotposmv starting 2.7 seconds late 2017-06-01 08:13:29,080 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:13:39,097 INFO repeater task os150bb_lastensq starting 3.1 seconds late 2017-06-01 08:13:40,754 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 08:13:40,755 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:13:26 2017-06-01 08:13:40,755 INFO repeater task os150nb_lastensq starting 4.8 seconds late 2017-06-01 08:13:41,899 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 08:13:41,900 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:13:26 2017-06-01 08:16:47,237 INFO repeater task os150bb_10pings starting 1.5 seconds late 2017-06-01 08:16:47,411 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:16:47,411 INFO repeater task os150nb_10pings starting 1.6 seconds late 2017-06-01 08:16:47,508 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:18:27,702 INFO repeater task posmv_hcorrstats starting 1.9 seconds late 2017-06-01 08:18:28,689 INFO repeater task posmv_hcorrstats ended after 1.0 seconds 2017-06-01 08:18:28,689 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2017-06-01 08:18:29,326 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:18:39,343 INFO repeater task os150bb_lastensq starting 3.3 seconds late 2017-06-01 08:18:41,105 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 08:18:41,105 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:18:26 2017-06-01 08:18:41,106 INFO repeater task os150nb_lastensq starting 5.1 seconds late 2017-06-01 08:18:42,359 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 08:18:42,359 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:18:26 2017-06-01 08:22:07,786 INFO repeater task os150bb_10pings starting 2.0 seconds late 2017-06-01 08:22:07,941 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:22:07,942 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 08:22:08,037 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:23:28,188 INFO repeater task os150bb_quick starting 2.4 seconds late 2017-06-01 08:23:31,423 INFO repeater task os150bb_quick ended after 3.2 seconds 2017-06-01 08:23:31,423 INFO repeater task os150bb_3dayplots starting 5.6 seconds late 2017-06-01 08:23:38,115 INFO repeater task os150bb_3dayplots ended after 6.7 seconds 2017-06-01 08:23:38,115 INFO repeater task os150bb_tsstats starting 12.3 seconds late 2017-06-01 08:23:38,703 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 08:23:38,703 INFO repeater task os150nb_lastensq starting 2.7 seconds late 2017-06-01 08:23:39,885 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:23:39,886 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:23:26 2017-06-01 08:23:39,886 INFO repeater task os150nb_quick starting 14.1 seconds late 2017-06-01 08:23:43,002 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 08:23:43,002 INFO repeater task os150nb_3dayplots starting 17.2 seconds late 2017-06-01 08:23:49,628 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 08:23:49,629 INFO repeater task os150nb_3dayplots ended after 6.6 seconds 2017-06-01 08:23:49,629 INFO repeater task os150nb_tsstats starting 23.8 seconds late 2017-06-01 08:23:50,172 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 08:23:50,173 INFO repeater task os150bb_beamplots starting 24.4 seconds late 2017-06-01 08:23:51,103 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:23:51,104 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 08:23:51,104 INFO repeater task os150bb_beamplots starting 25.3 seconds late 2017-06-01 08:23:52,113 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:23:52,113 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 08:23:52,113 INFO repeater task os150nb_beamplots starting 26.3 seconds late 2017-06-01 08:23:53,116 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:23:53,116 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 08:23:53,117 INFO repeater task os150nb_beamplots starting 27.3 seconds late 2017-06-01 08:23:54,018 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:23:54,018 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 08:23:54,018 INFO repeater task posmv_hcorrstats starting 28.2 seconds late 2017-06-01 08:23:54,847 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 08:23:54,847 INFO repeater task posmv_plotposmv starting 29.1 seconds late 2017-06-01 08:23:55,460 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:24:00,466 INFO repeater task os150bb_lastensq starting 24.5 seconds late 2017-06-01 08:24:02,114 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2017-06-01 08:24:02,114 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:23:26 2017-06-01 08:27:27,546 INFO repeater task os150bb_10pings starting 1.8 seconds late 2017-06-01 08:27:27,705 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:27:27,706 INFO repeater task os150nb_10pings starting 1.9 seconds late 2017-06-01 08:27:27,798 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:28:27,942 INFO repeater task posmv_hcorrstats starting 2.2 seconds late 2017-06-01 08:28:28,910 INFO repeater task posmv_hcorrstats ended after 1.0 seconds 2017-06-01 08:28:28,910 INFO repeater task posmv_plotposmv starting 3.1 seconds late 2017-06-01 08:28:29,513 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:28:39,527 INFO repeater task os150bb_lastensq starting 3.5 seconds late 2017-06-01 08:28:41,201 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 08:28:41,202 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:28:26 2017-06-01 08:28:41,202 INFO repeater task os150nb_lastensq starting 5.2 seconds late 2017-06-01 08:28:42,348 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 08:28:42,348 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:28:26 2017-06-01 08:32:47,808 INFO repeater task os150bb_10pings starting 2.0 seconds late 2017-06-01 08:32:47,979 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:32:47,980 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 08:32:48,073 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:33:28,146 INFO repeater task posmv_hcorrstats starting 2.4 seconds late 2017-06-01 08:33:28,975 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 08:33:28,976 INFO repeater task posmv_plotposmv starting 3.2 seconds late 2017-06-01 08:33:29,622 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:33:39,635 INFO repeater task os150bb_lastensq starting 3.6 seconds late 2017-06-01 08:33:41,480 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 08:33:41,481 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:33:26 2017-06-01 08:33:41,481 INFO repeater task os150nb_lastensq starting 5.5 seconds late 2017-06-01 08:33:42,695 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:33:42,695 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:33:26 2017-06-01 08:38:08,195 INFO repeater task os150bb_10pings starting 2.4 seconds late 2017-06-01 08:38:08,370 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:38:08,371 INFO repeater task os150nb_10pings starting 2.6 seconds late 2017-06-01 08:38:08,466 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:38:28,507 INFO repeater task os150bb_quick starting 2.7 seconds late 2017-06-01 08:38:31,702 INFO repeater task os150bb_quick ended after 3.2 seconds 2017-06-01 08:38:31,702 INFO repeater task os150bb_3dayplots starting 5.9 seconds late 2017-06-01 08:38:38,155 INFO repeater task os150bb_3dayplots ended after 6.5 seconds 2017-06-01 08:38:38,156 INFO repeater task os150bb_tsstats starting 12.4 seconds late 2017-06-01 08:38:38,728 INFO repeater task os150bb_tsstats ended after 0.6 seconds 2017-06-01 08:38:38,728 INFO repeater task os150nb_lastensq starting 2.7 seconds late 2017-06-01 08:38:39,948 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:38:39,948 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:38:26 2017-06-01 08:38:39,949 INFO repeater task os150nb_quick starting 14.2 seconds late 2017-06-01 08:38:43,088 INFO repeater task os150nb_quick ended after 3.1 seconds 2017-06-01 08:38:43,089 INFO repeater task os150nb_3dayplots starting 17.3 seconds late 2017-06-01 08:38:49,916 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 08:38:49,916 INFO repeater task os150nb_3dayplots ended after 6.8 seconds 2017-06-01 08:38:49,916 INFO repeater task os150nb_tsstats starting 24.1 seconds late 2017-06-01 08:38:50,465 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 08:38:50,465 INFO repeater task os150bb_beamplots starting 24.7 seconds late 2017-06-01 08:38:51,430 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:38:51,430 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 08:38:51,430 INFO repeater task os150bb_beamplots starting 25.6 seconds late 2017-06-01 08:38:52,370 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:38:52,370 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 08:38:52,370 INFO repeater task os150nb_beamplots starting 26.6 seconds late 2017-06-01 08:38:53,319 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:38:53,319 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 08:38:53,319 INFO repeater task os150nb_beamplots starting 27.5 seconds late 2017-06-01 08:38:54,285 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:38:54,285 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 08:38:54,285 INFO repeater task posmv_hcorrstats starting 28.5 seconds late 2017-06-01 08:38:55,157 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 08:38:55,158 INFO repeater task posmv_plotposmv starting 29.4 seconds late 2017-06-01 08:38:55,804 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:39:00,810 INFO repeater task os150bb_lastensq starting 24.8 seconds late 2017-06-01 08:39:02,608 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 08:39:02,608 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:38:26 2017-06-01 08:43:28,122 INFO repeater task os150bb_10pings starting 2.3 seconds late 2017-06-01 08:43:28,296 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:43:28,297 INFO repeater task os150nb_10pings starting 2.5 seconds late 2017-06-01 08:43:28,394 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:43:28,395 INFO repeater task posmv_hcorrstats starting 2.6 seconds late 2017-06-01 08:43:29,237 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 08:43:29,237 INFO repeater task posmv_plotposmv starting 3.5 seconds late 2017-06-01 08:43:29,863 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:43:39,875 INFO repeater task os150bb_lastensq starting 3.9 seconds late 2017-06-01 08:43:41,765 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 08:43:41,765 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:43:26 2017-06-01 08:43:41,766 INFO repeater task os150nb_lastensq starting 5.8 seconds late 2017-06-01 08:43:42,967 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:43:42,968 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:43:26 2017-06-01 08:48:28,570 INFO repeater task posmv_hcorrstats starting 2.8 seconds late 2017-06-01 08:48:29,390 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 08:48:29,390 INFO repeater task posmv_plotposmv starting 3.6 seconds late 2017-06-01 08:48:30,001 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:48:40,019 INFO repeater task os150bb_lastensq starting 4.0 seconds late 2017-06-01 08:48:41,701 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 08:48:41,701 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:48:26 2017-06-01 08:48:41,701 INFO repeater task os150nb_lastensq starting 5.7 seconds late 2017-06-01 08:48:42,864 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:48:42,864 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:48:26 2017-06-01 08:48:47,871 INFO repeater task os150bb_10pings starting 2.1 seconds late 2017-06-01 08:48:48,023 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:48:48,024 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 08:48:48,117 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:53:28,724 INFO repeater task os150bb_quick starting 2.9 seconds late 2017-06-01 08:53:32,020 INFO repeater task os150bb_quick ended after 3.3 seconds 2017-06-01 08:53:32,021 INFO repeater task os150bb_3dayplots starting 6.2 seconds late 2017-06-01 08:53:38,761 INFO repeater task os150bb_3dayplots ended after 6.7 seconds 2017-06-01 08:53:38,761 INFO repeater task os150bb_tsstats starting 13.0 seconds late 2017-06-01 08:53:39,305 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 08:53:39,305 INFO repeater task os150nb_lastensq starting 3.3 seconds late 2017-06-01 08:53:40,463 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 08:53:40,463 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:53:26 2017-06-01 08:53:40,463 INFO repeater task os150nb_quick starting 14.7 seconds late 2017-06-01 08:53:43,705 INFO repeater task os150nb_quick ended after 3.2 seconds 2017-06-01 08:53:43,706 INFO repeater task os150nb_3dayplots starting 17.9 seconds late 2017-06-01 08:53:50,049 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 08:53:50,049 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 08:53:50,049 INFO repeater task os150nb_tsstats starting 24.3 seconds late 2017-06-01 08:53:50,587 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 08:53:50,587 INFO repeater task os150bb_beamplots starting 24.8 seconds late 2017-06-01 08:53:51,522 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:53:51,522 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 08:53:51,522 INFO repeater task os150bb_beamplots starting 25.7 seconds late 2017-06-01 08:53:52,487 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:53:52,487 INFO repeater task os150bb_beamplots ended after 1.0 seconds 2017-06-01 08:53:52,488 INFO repeater task os150nb_beamplots starting 26.7 seconds late 2017-06-01 08:53:53,497 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:53:53,497 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 08:53:53,498 INFO repeater task os150nb_beamplots starting 27.7 seconds late 2017-06-01 08:53:54,436 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 08:53:54,436 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 08:53:54,436 INFO repeater task posmv_hcorrstats starting 28.7 seconds late 2017-06-01 08:53:55,302 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 08:53:55,302 INFO repeater task posmv_plotposmv starting 29.5 seconds late 2017-06-01 08:53:55,941 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 08:54:00,947 INFO repeater task os150bb_lastensq starting 24.9 seconds late 2017-06-01 08:54:02,802 INFO repeater task os150bb_lastensq ended after 1.9 seconds 2017-06-01 08:54:02,802 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:53:26 2017-06-01 08:54:07,808 INFO repeater task os150bb_10pings starting 2.0 seconds late 2017-06-01 08:54:07,979 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 08:54:07,980 INFO repeater task os150nb_10pings starting 2.2 seconds late 2017-06-01 08:54:08,074 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 08:58:28,657 INFO repeater task posmv_hcorrstats starting 2.9 seconds late 2017-06-01 08:58:29,580 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 08:58:29,580 INFO repeater task posmv_plotposmv starting 3.8 seconds late 2017-06-01 08:58:30,238 INFO repeater task posmv_plotposmv ended after 0.7 seconds 2017-06-01 08:58:40,256 INFO repeater task os150bb_lastensq starting 4.3 seconds late 2017-06-01 08:58:41,954 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 08:58:41,954 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 08:58:26 2017-06-01 08:58:41,955 INFO repeater task os150nb_lastensq starting 6.0 seconds late 2017-06-01 08:58:43,218 INFO repeater task os150nb_lastensq ended after 1.3 seconds 2017-06-01 08:58:43,218 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 08:58:26 2017-06-01 08:59:28,314 INFO repeater task os150bb_10pings starting 2.5 seconds late 2017-06-01 08:59:28,424 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 08:59:28,425 INFO repeater task os150nb_10pings starting 2.6 seconds late 2017-06-01 08:59:28,520 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 09:03:28,993 INFO repeater task posmv_hcorrstats starting 3.2 seconds late 2017-06-01 09:03:29,846 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 09:03:29,847 INFO repeater task posmv_plotposmv starting 4.1 seconds late 2017-06-01 09:03:30,466 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 09:03:40,476 INFO repeater task os150bb_lastensq starting 4.5 seconds late 2017-06-01 09:03:42,247 INFO repeater task os150bb_lastensq ended after 1.8 seconds 2017-06-01 09:03:42,247 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 09:03:26 2017-06-01 09:03:42,248 INFO repeater task os150nb_lastensq starting 6.2 seconds late 2017-06-01 09:03:43,412 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 09:03:43,413 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 09:03:26 2017-06-01 09:04:48,529 INFO repeater task os150bb_10pings starting 2.7 seconds late 2017-06-01 09:04:48,685 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 09:04:48,686 INFO repeater task os150nb_10pings starting 2.9 seconds late 2017-06-01 09:04:48,780 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 09:08:29,231 INFO repeater task os150bb_quick starting 3.5 seconds late 2017-06-01 09:08:32,334 INFO repeater task os150bb_quick ended after 3.1 seconds 2017-06-01 09:08:32,335 INFO repeater task os150bb_3dayplots starting 6.6 seconds late 2017-06-01 09:08:38,602 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 09:08:38,602 INFO repeater task os150bb_tsstats starting 12.8 seconds late 2017-06-01 09:08:39,139 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 09:08:39,139 INFO repeater task os150nb_lastensq starting 3.1 seconds late 2017-06-01 09:08:40,310 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 09:08:40,310 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 09:08:26 2017-06-01 09:08:40,310 INFO repeater task os150nb_quick starting 14.5 seconds late 2017-06-01 09:08:43,320 INFO repeater task os150nb_quick ended after 3.0 seconds 2017-06-01 09:08:43,320 INFO repeater task os150nb_3dayplots starting 17.5 seconds late 2017-06-01 09:08:49,578 INFO repeater task os150nb_3dayplots output: /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:319: RuntimeWarning: All-NaN slice encountered warnings.warn("All-NaN slice encountered", RuntimeWarning) /usr/lib/python2.7/dist-packages/numpy/lib/nanfunctions.py:220: RuntimeWarning: All-NaN axis encountered warnings.warn("All-NaN axis encountered", RuntimeWarning) 2017-06-01 09:08:49,578 INFO repeater task os150nb_3dayplots ended after 6.3 seconds 2017-06-01 09:08:49,578 INFO repeater task os150nb_tsstats starting 23.8 seconds late 2017-06-01 09:08:50,117 INFO repeater task os150nb_tsstats ended after 0.5 seconds 2017-06-01 09:08:50,117 INFO repeater task os150bb_beamplots starting 24.3 seconds late 2017-06-01 09:08:51,009 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 09:08:51,010 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 09:08:51,010 INFO repeater task os150bb_beamplots starting 25.2 seconds late 2017-06-01 09:08:51,942 INFO repeater task os150bb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 09:08:51,942 INFO repeater task os150bb_beamplots ended after 0.9 seconds 2017-06-01 09:08:51,942 INFO repeater task os150nb_beamplots starting 26.2 seconds late 2017-06-01 09:08:52,911 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 09:08:52,911 INFO repeater task os150nb_beamplots ended after 1.0 seconds 2017-06-01 09:08:52,911 INFO repeater task os150nb_beamplots starting 27.1 seconds late 2017-06-01 09:08:53,845 INFO repeater task os150nb_beamplots output: Starting procsetup scriptpath is /usr/local/currents/bin 2017-06-01 09:08:53,845 INFO repeater task os150nb_beamplots ended after 0.9 seconds 2017-06-01 09:08:53,845 INFO repeater task posmv_hcorrstats starting 28.1 seconds late 2017-06-01 09:08:54,695 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 09:08:54,695 INFO repeater task posmv_plotposmv starting 28.9 seconds late 2017-06-01 09:08:55,302 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 09:09:00,308 INFO repeater task os150bb_lastensq starting 24.3 seconds late 2017-06-01 09:09:01,944 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2017-06-01 09:09:01,944 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 09:08:26 2017-06-01 09:10:07,077 INFO repeater task os150bb_10pings starting 1.3 seconds late 2017-06-01 09:10:07,168 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 09:10:07,169 INFO repeater task os150nb_10pings starting 1.4 seconds late 2017-06-01 09:10:07,263 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 09:13:27,699 INFO repeater task posmv_hcorrstats starting 1.9 seconds late 2017-06-01 09:13:28,556 INFO repeater task posmv_hcorrstats ended after 0.9 seconds 2017-06-01 09:13:28,557 INFO repeater task posmv_plotposmv starting 2.8 seconds late 2017-06-01 09:13:29,188 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 09:13:39,201 INFO repeater task os150bb_lastensq starting 3.2 seconds late 2017-06-01 09:13:40,824 INFO repeater task os150bb_lastensq ended after 1.6 seconds 2017-06-01 09:13:40,824 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 09:13:26 2017-06-01 09:13:40,825 INFO repeater task os150nb_lastensq starting 4.8 seconds late 2017-06-01 09:13:41,985 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 09:13:41,986 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 09:13:26 2017-06-01 09:15:27,202 INFO repeater task os150bb_10pings starting 1.4 seconds late 2017-06-01 09:15:27,366 INFO repeater task os150bb_10pings ended after 0.2 seconds 2017-06-01 09:15:27,367 INFO repeater task os150nb_10pings starting 1.6 seconds late 2017-06-01 09:15:27,462 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 09:18:27,841 INFO repeater task posmv_hcorrstats starting 2.1 seconds late 2017-06-01 09:18:28,690 INFO repeater task posmv_hcorrstats ended after 0.8 seconds 2017-06-01 09:18:28,690 INFO repeater task posmv_plotposmv starting 2.9 seconds late 2017-06-01 09:18:29,287 INFO repeater task posmv_plotposmv ended after 0.6 seconds 2017-06-01 09:18:39,304 INFO repeater task os150bb_lastensq starting 3.3 seconds late 2017-06-01 09:18:40,966 INFO repeater task os150bb_lastensq ended after 1.7 seconds 2017-06-01 09:18:40,966 INFO repeater task os150bb_lastensq: Time from /home/data/NF1704_B/proc/os150bb/load/wrote_ens_time: 2017/06/01 09:18:26 2017-06-01 09:18:40,967 INFO repeater task os150nb_lastensq starting 5.0 seconds late 2017-06-01 09:18:42,086 INFO repeater task os150nb_lastensq ended after 1.1 seconds 2017-06-01 09:18:42,086 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 09:18:26 2017-06-01 09:20:47,395 INFO repeater task os150bb_10pings starting 1.6 seconds late 2017-06-01 09:20:47,486 INFO repeater task os150bb_10pings ended after 0.1 seconds 2017-06-01 09:20:47,487 INFO repeater task os150nb_10pings starting 1.7 seconds late 2017-06-01 09:20:47,579 INFO repeater task os150nb_10pings ended after 0.1 seconds 2017-06-01 09:23:27,894 INFO repeater task os150bb_quick starting 2.1 seconds late 2017-06-01 09:23:30,939 INFO repeater task os150bb_quick ended after 3.0 seconds 2017-06-01 09:23:30,940 INFO repeater task os150bb_3dayplots starting 5.2 seconds late 2017-06-01 09:23:37,192 INFO repeater task os150bb_3dayplots ended after 6.3 seconds 2017-06-01 09:23:37,192 INFO repeater task os150bb_tsstats starting 11.4 seconds late 2017-06-01 09:23:37,734 INFO repeater task os150bb_tsstats ended after 0.5 seconds 2017-06-01 09:23:37,734 INFO repeater task os150nb_lastensq starting 1.7 seconds late 2017-06-01 09:23:38,926 INFO repeater task os150nb_lastensq ended after 1.2 seconds 2017-06-01 09:23:38,927 INFO repeater task os150nb_lastensq: Time from /home/data/NF1704_B/proc/os150nb/load/wrote_ens_time: 2017/06/01 09:23:26 2017-06-01 09:23:38,927 INFO repeater task os150nb_quick starting 13.1 seconds late 2017-06-01 09:23:41,960 INFO repeater task os150nb_quick ended after 3.0 seconds