Task 16034310

Name	hadcm3n_7x9k_1980_40_008454395_2
Workunit	8605251
Created	25 Sep 2013, 12:49:36 UTC
Sent	25 Sep 2013, 12:50:11 UTC
Report deadline	25 Dec 2013, 20:17:22 UTC
Received	22 Oct 2013, 13:48:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1278777
Run time	8 days 8 hours 47 min 5 sec
CPU time	6 days 18 hours 26 min 8 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	3.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:56:42 (4000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7804, iMonCtr=1 Model crash detected, will try to restart... 06:05:09 (6700): No heartbeat from core client for 30 sec - exiting 06:05:10 (6700): No heartbeat from core client for 30 sec - exiting 06:05:11 (6700): No heartbeat from core client for 30 sec - exiting 06:05:12 (6700): No heartbeat from core client for 30 sec - exiting 06:05:13 (6700): No heartbeat from core client for 30 sec - exiting 06:05:14 (6700): No heartbeat from core client for 30 sec - exiting 06:05:15 (6700): No heartbeat from core client for 30 sec - exiting 06:05:16 (6700): No heartbeat from core client for 30 sec - exiting 06:05:17 (6700): No heartbeat from core client for 30 sec - exiting 06:05:18 (6700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/7x9kko.pji1c10 Error converting file to netcdf: dataout/7x9kko.pii1c10 Error converting file to netcdf: dataout/7x9kko.pfi1c10 Error converting file to netcdf: dataout/7x9kka.phi1c10 Error converting file to netcdf: dataout/7x9kka.pgi1c10 Error converting file to netcdf: dataout/7x9kka.pei1c10 Error converting file to netcdf: dataout/7x9kka.pdi1c10 CPDN Monitor - Quit request from BOINC... 13:46:29 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:46:12 (8720): Can't set up shared mem: -1. Will run in standalone mode. 18:46:15 (3748): Can't set up shared mem: -1. Will run in standalone mode. 19:19:52 (1252): Can't acquire lockfile (32) - waiting 35s 19:20:27 (1252): Can't acquire lockfile (32) - exiting 19:20:27 (1252): Error: The process cannot access the file because it is being used by another process. (0x20) 19:31:10 (8868): Can't acquire lockfile (32) - waiting 35s 19:31:45 (8868): Can't acquire lockfile (32) - exiting 19:31:45 (8868): Error: The process cannot access the file because it is being used by another process. (0x20) 19:41:52 (5228): Can't acquire lockfile (32) - waiting 35s 19:42:27 (5228): Can't acquire lockfile (32) - exiting 19:42:27 (5228): Error: The process cannot access the file because it is being used by another process. (0x20) 19:52:51 (6676): Can't acquire lockfile (32) - waiting 35s 19:53:26 (6676): Can't acquire lockfile (32) - exiting 19:53:26 (6676): Error: The process cannot access the file because it is being used by another process. (0x20) 20:03:55 (8956): Can't acquire lockfile (32) - waiting 35s 20:04:30 (8956): Can't acquire lockfile (32) - exiting 20:04:30 (8956): Error: The process cannot access the file because it is being used by another process. (0x20) 20:15:02 (4644): Can't acquire lockfile (32) - waiting 35s 20:15:37 (4644): Can't acquire lockfile (32) - exiting 20:15:37 (4644): Error: The process cannot access the file because it is being used by another process. (0x20) 20:26:23 (6328): Can't acquire lockfile (32) - waiting 35s 20:26:58 (6328): Can't acquire lockfile (32) - exiting 20:26:58 (6328): Error: The process cannot access the file because it is being used by another process. (0x20) 20:37:48 (8304): Can't acquire lockfile (32) - waiting 35s 20:38:23 (8304): Can't acquire lockfile (32) - exiting 20:38:24 (8304): Error: The process cannot access the file because it is being used by another process. (0x20) 22:08:37 (5956): Can't acquire lockfile (32) - waiting 35s 22:09:12 (5956): Can't acquire lockfile (32) - exiting 22:09:12 (5956): Error: The process cannot access the file because it is being used by another process. (0x20) 22:19:58 (8420): Can't acquire lockfile (32) - waiting 35s 22:20:33 (8420): Can't acquire lockfile (32) - exiting 22:20:33 (8420): Error: The process cannot access the file because it is being used by another process. (0x20) 22:31:10 (1488): Can't acquire lockfile (32) - waiting 35s 22:31:45 (1488): Can't acquire lockfile (32) - exiting 22:31:45 (1488): Error: The process cannot access the file because it is being used by another process. (0x20) 22:42:14 (4768): Can't acquire lockfile (32) - waiting 35s 22:42:49 (4768): Can't acquire lockfile (32) - exiting 22:42:49 (4768): Error: The process cannot access the file because it is being used by another process. (0x20) 22:53:47 (3148): Can't acquire lockfile (32) - waiting 35s 22:54:22 (3148): Can't acquire lockfile (32) - exiting 22:54:22 (3148): Error: The process cannot access the file because it is being used by another process. (0x20) 23:05:25 (3644): Can't acquire lockfile (32) - waiting 35s 23:06:00 (3644): Can't acquire lockfile (32) - exiting 23:06:01 (3644): Error: The process cannot access the file because it is being used by another process. (0x20) 23:16:44 (8932): Can't acquire lockfile (32) - waiting 35s 23:17:19 (8932): Can't acquire lockfile (32) - exiting 23:17:19 (8932): Error: The process cannot access the file because it is being used by another process. (0x20) 23:41:30 (4408): Can't acquire lockfile (32) - waiting 35s 23:42:05 (4408): Can't acquire lockfile (32) - exiting 23:42:05 (4408): Error: The process cannot access the file because it is being used by another process. (0x20) 23:52:12 (5452): Can't acquire lockfile (32) - waiting 35s 23:52:47 (5452): Can't acquire lockfile (32) - exiting 23:52:47 (5452): Error: The process cannot access the file because it is being used by another process. (0x20) 00:02:53 (9056): Can't acquire lockfile (32) - waiting 35s 00:03:28 (9056): Can't acquire lockfile (32) - exiting 00:03:28 (9056): Error: The process cannot access the file because it is being used by another process. (0x20) 00:13:55 (6368): Can't acquire lockfile (32) - waiting 35s 00:14:30 (6368): Can't acquire lockfile (32) - exiting 00:14:30 (6368): Error: The process cannot access the file because it is being used by another process. (0x20) 00:24:39 (5460): Can't acquire lockfile (32) - waiting 35s 00:25:14 (5460): Can't acquire lockfile (32) - exiting 00:25:14 (5460): Error: The process cannot access the file because it is being used by another process. (0x20) 00:36:01 (7948): Can't acquire lockfile (32) - waiting 35s 00:36:36 (7948): Can't acquire lockfile (32) - exiting 00:36:36 (7948): Error: The process cannot access the file because it is being used by another process. (0x20) 00:47:27 (6476): Can't acquire lockfile (32) - waiting 35s 00:48:02 (6476): Can't acquire lockfile (32) - exiting 00:48:02 (6476): Error: The process cannot access the file because it is being used by another process. (0x20) 10:24:53 (1232): No heartbeat from core client for 30 sec - exiting 10:24:54 (1232): No heartbeat from core client for 30 sec - exiting 10:24:55 (1232): No heartbeat from core client for 30 sec - exiting 10:24:56 (1232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:19:54 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:33 (7824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:19:22 (9768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:50:59 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:26:06 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:10 (1496): No heartbeat from core client for 30 sec - exiting 12:26:11 (1496): No heartbeat from core client for 30 sec - exiting 12:26:12 (1496): No heartbeat from core client for 30 sec - exiting 12:26:13 (1496): No heartbeat from core client for 30 sec - exiting 12:26:14 (1496): No heartbeat from core client for 30 sec - exiting 12:26:15 (1496): No heartbeat from core client for 30 sec - exiting 12:38:33 (3576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:12 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:13 (1648): No heartbeat from core client for 30 sec - exiting 15:57:14 (1648): No heartbeat from core client for 30 sec - exiting 15:57:15 (1648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:20:21 (6784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:02:54 (6516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:37:26 (5296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1096, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1096, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:37:47 (5952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:38:20 (6336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/7x9kko.pjj2c10 Error converting file to netcdf: dataout/7x9kko.pij2c10 Error converting file to netcdf: dataout/7x9kko.pfj2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/7x9kko.pjj3c10 Error converting file to netcdf: dataout/7x9kko.pij3c10 Error converting file to netcdf: dataout/7x9kko.pfj3c10 Error converting file to netcdf: dataout/7x9kka.phj3c10 Error converting file to netcdf: dataout/7x9kka.pgj3c10 Error converting file to netcdf: dataout/7x9kka.pej3c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:55:47 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:34 (8564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:06 (5268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:53:22 (7624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:53:49 (7668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:14:38 (8164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:15:53 (1268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:10:08 (2124): No heartbeat from core client for 30 sec - exiting 06:10:09 (2124): No heartbeat from core client for 30 sec - exiting 06:10:10 (2124): No heartbeat from core client for 30 sec - exiting 06:10:11 (2124): No heartbeat from core client for 30 sec - exiting 06:10:12 (2124): No heartbeat from core client for 30 sec - exiting 06:10:13 (2124): No heartbeat from core client for 30 sec - exiting 06:10:14 (2124): No heartbeat from core client for 30 sec - exiting 06:10:15 (2124): No heartbeat from core client for 30 sec - exiting 06:10:16 (2124): No heartbeat from core client for 30 sec - exiting 06:10:17 (2124): No heartbeat from core client for 30 sec - exiting 06:10:18 (2124): No heartbeat from core client for 30 sec - exiting 06:10:19 (2124): No heartbeat from core client for 30 sec - exiting 06:10:20 (2124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:10:21 (2124): No heartbeat from core client for 30 sec - exiting 06:10:22 (2124): No heartbeat from core client for 30 sec - exiting 06:10:23 (2124): No heartbeat from core client for 30 sec - exiting 06:10:24 (2124): No heartbeat from core client for 30 sec - exiting 06:10:25 (2124): No heartbeat from core client for 30 sec - exiting 06:12:16 (8064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Oct 2013 13:47:01	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	518,400	584,430	1.1274
18 Oct 2013 17:24:15	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	492,480	554,307	1.1255
17 Oct 2013 16:01:43	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	466,560	525,004	1.1253
16 Oct 2013 03:12:39	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	440,640	494,970	1.1233
15 Oct 2013 03:22:59	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	414,720	465,329	1.1220
13 Oct 2013 21:51:31	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	388,800	435,691	1.1206
12 Oct 2013 02:47:27	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	362,880	406,672	1.1207
10 Oct 2013 20:03:33	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	336,960	376,995	1.1188
09 Oct 2013 17:06:02	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	311,040	347,652	1.1177
08 Oct 2013 04:26:23	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	285,120	318,078	1.1156
07 Oct 2013 15:10:48	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	259,200	288,755	1.1140
05 Oct 2013 06:38:11	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	233,280	259,192	1.1111
04 Oct 2013 02:07:51	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	207,360	229,178	1.1052
02 Oct 2013 17:43:14	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	181,440	199,419	1.0991
01 Oct 2013 18:22:06	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	155,520	169,561	1.0903
30 Sep 2013 07:29:33	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	129,600	139,487	1.0763
28 Sep 2013 22:55:42	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	103,680	116,368	1.1224
27 Sep 2013 15:51:48	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	77,760	87,187	1.1212
27 Sep 2013 06:06:17	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	51,840	58,094	1.1206
26 Sep 2013 13:14:27	1278777	16034310	hadcm3n_7x9k_1980_40_008454395_2	25,920	28,965	1.1175