Task 21112859

Name	wah2_global_30lz_208812_145_696_011386804_2
Workunit	11386804
Created	5 Mar 2018, 16:51:24 UTC
Sent	5 Mar 2018, 17:12:39 UTC
Report deadline	15 Feb 2019, 22:32:39 UTC
Received	15 Mar 2018, 22:02:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1397720
Run time	5 days 4 hours 40 min 11 sec
CPU time	5 days 1 hours 23 min 8 sec
Validate state	Invalid
Credit	5,893.93
Device peak FLOPS	3.81 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	238.48 MB
Peak swap size	174.14 MB
Peak disk usage	47.98 MB
Stderr	<core_client_version>7.8.3</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... 17:51:06 (1928): start_timer_thread(): CreateThread() failed, errno 0 17:51:07 (1308): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 19:10:37 (5824): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 21:42:26 (2184): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:43:44 (812): start_timer_thread(): CreateThread() failed, errno 0 09:43:46 (2088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:07:36 (11728): start_timer_thread(): CreateThread() failed, errno 0 10:07:38 (10332): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 10:14:02 (11436): start_timer_thread(): CreateThread() failed, errno 0 10:14:04 (9252): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:28:13 (4680): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:51:28 (228): start_timer_thread(): CreateThread() failed, errno 0 10:51:29 (8400): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:07:37 (372): start_timer_thread(): CreateThread() failed, errno 0 11:07:39 (4408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:32:35 (3104): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 11:41:42 (10152): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 11:50:26 (5280): start_timer_thread(): CreateThread() failed, errno 0 11:50:27 (10176): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:54:49 (2320): start_timer_thread(): CreateThread() failed, errno 0 11:54:51 (8588): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:59:10 (5460): start_timer_thread(): CreateThread() failed, errno 0 12:59:11 (5256): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:29:34 (8248): start_timer_thread(): CreateThread() failed, errno 0 13:29:36 (11884): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 16:49:10 (11324): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:55:18 (6720): start_timer_thread(): CreateThread() failed, errno 0 16:55:20 (12252): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 17:03:02 (6888): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:22:39 (7188): start_timer_thread(): CreateThread() failed, errno 0 18:22:41 (2232): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:34:46 (4916): start_timer_thread(): CreateThread() failed, errno 0 18:34:47 (8552): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:42:12 (4580): start_timer_thread(): CreateThread() failed, errno 0 18:42:13 (11728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:49:28 (11284): start_timer_thread(): CreateThread() failed, errno 0 18:49:30 (11448): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:58:06 (12180): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:59:29 (11608): start_timer_thread(): CreateThread() failed, errno 0 18:59:31 (10996): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 21:23:55 (7288): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:41:32 (10792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:53:55 (9968): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:26:48 (8972): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 22:48:35 (4992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:59:18 (1364): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 23:10:47 (10200): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:35:06 (9072): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:20:37 (11344): start_timer_thread(): CreateThread() failed, errno 0 08:20:39 (6872): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 08:29:08 (372): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:32:11 (1784): start_timer_thread(): CreateThread() failed, errno 0 08:32:13 (1284): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:09:00 (1808): start_timer_thread(): CreateThread() failed, errno 0 09:09:02 (2792): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:21:27 (9732): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:40:35 (12160): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:53:48 (6736): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 11:55:13 (7868): start_timer_thread(): CreateThread() failed, errno 0 11:55:14 (7588): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:15:02 (10172): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 12:21:31 (9556): start_timer_thread(): CreateThread() failed, errno 0 12:21:33 (4728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:28:59 (196): start_timer_thread(): CreateThread() failed, errno 0 12:29:00 (5864): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:35:53 (3236): start_timer_thread(): CreateThread() failed, errno 0 12:35:55 (4136): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 12:43:38 (5792): start_timer_thread(): CreateThread() failed, errno 0 12:43:40 (2108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:46:17 (8548): start_timer_thread(): CreateThread() failed, errno 0 12:46:18 (10460): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 13:04:54 (7192): start_timer_thread(): CreateThread() failed, errno 0 13:04:55 (10996): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:26:59 (7488): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:29:49 (8304): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:55:20 (9628): start_timer_thread(): CreateThread() failed, errno 0 13:55:21 (2992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:58:19 (8648): start_timer_thread(): CreateThread() failed, errno 0 13:58:21 (2156): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:05:16 (7128): start_timer_thread(): CreateThread() failed, errno 0 14:05:17 (7212): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 14:24:50 (8536): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:34:07 (1380): start_timer_thread(): CreateThread() failed, errno 0 14:34:08 (5388): start_timer_thread(): CreateThread() failed, errno 0 forrtl: The handle is invalid. CPDN Monitor - Quit request from BOINC... 16:01:50 (10492): start_timer_thread(): CreateThread() failed, errno 0 Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=7868, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=10492, selfPID=9596, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 16:01:53 (9596): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_96.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_97.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_98.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_99.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_100.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_101.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_102.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_103.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_104.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_105.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_106.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_107.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_108.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_109.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_110.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_111.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_112.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_113.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_114.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_115.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_116.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_117.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_118.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_119.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_120.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_121.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_122.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_123.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_124.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_125.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_126.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_127.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_128.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_129.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_130.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_131.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_132.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_133.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_134.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_135.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_136.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_137.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_138.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_139.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_140.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_141.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_142.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_143.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_144.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_145.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_global_30lz_208812_145_696_011386804_2_r69831925_restart.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Mar 2018 15:13:55	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	89,347	144,918	1.6220
07 Mar 2018 13:53:12	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	86,467	140,296	1.6225
07 Mar 2018 12:37:26	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	83,587	135,685	1.6233
07 Mar 2018 11:16:39	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	80,707	131,161	1.6252
07 Mar 2018 10:00:39	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	77,827	126,664	1.6275
07 Mar 2018 08:44:47	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	74,947	122,221	1.6308
07 Mar 2018 07:28:47	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	72,067	117,771	1.6342
07 Mar 2018 06:12:54	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	69,187	113,299	1.6376
07 Mar 2018 04:41:52	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	66,307	108,738	1.6399
07 Mar 2018 02:45:44	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	63,427	104,069	1.6408
07 Mar 2018 01:45:16	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	60,547	99,496	1.6433
06 Mar 2018 23:44:34	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	57,667	94,853	1.6448
06 Mar 2018 22:44:08	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	54,787	90,180	1.6460
06 Mar 2018 21:43:32	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	51,907	85,455	1.6463
06 Mar 2018 19:41:59	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	49,027	80,775	1.6476
06 Mar 2018 17:55:41	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	46,147	76,010	1.6471
06 Mar 2018 16:24:25	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	43,267	71,261	1.6470
06 Mar 2018 15:23:17	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	40,387	66,523	1.6471
06 Mar 2018 13:20:41	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	37,507	61,795	1.6476
06 Mar 2018 12:19:22	1397720	21112859	wah2_global_30lz_208812_145_696_011386804_2	34,627	57,057	1.6478