Task 13600349

Name	hadcm3n_t0lv_1940_40_007535992_0
Workunit	7733224
Created	5 Nov 2011, 11:10:59 UTC
Sent	17 Nov 2011, 14:57:11 UTC
Report deadline	16 Feb 2012, 22:24:22 UTC
Received	11 Dec 2011, 20:48:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1142551
Run time	9 days 19 hours 18 min 18 sec
CPU time	9 days 18 hours 11 min 33 sec
Validate state	Invalid
Credit	9,020.16
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:14:08 (5424): Can't acquire lockfile (32) - waiting 35s 15:14:34 (4972): Can't acquire lockfile (32) - waiting 35s 15:14:36 (4944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:56 (5284): Can't acquire lockfile (32) - waiting 35s 15:15:09 (4972): Can't acquire lockfile (32) - exiting 15:15:09 (4972): Error: The process cannot access the file because it is being used by another process. (0x20) 15:15:22 (5424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:23:12 (1904): Can't acquire lockfile (32) - waiting 35s 19:23:32 (3856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:47 (1904): Can't set up shared mem: -1. Will run in standalone mode. 19:23:48 (2468): Can't set up shared mem: -1. Will run in standalone mode. 19:25:55 (5844): Can't acquire lockfile (32) - waiting 35s 19:26:30 (5844): Can't acquire lockfile (32) - exiting 19:26:30 (5844): Error: The process cannot access the file because it is being used by another process. (0x20) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:41:48 (1460): Can't acquire lockfile (32) - waiting 35s 11:42:11 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:42:23 (1460): Can't set up shared mem: -1. Will run in standalone mode. 11:42:23 (5572): Can't set up shared mem: -1. Will run in standalone mode. 11:42:39 (3428): Can't acquire lockfile (32) - waiting 35s 11:43:14 (3428): Can't acquire lockfile (32) - exiting 11:43:14 (3428): Error: The process cannot access the file because it is being used by another process. (0x20) 11:54:11 (5648): Can't acquire lockfile (32) - waiting 35s 11:54:46 (5648): Can't acquire lockfile (32) - exiting 11:54:46 (5648): Error: The process cannot access the file because it is being used by another process. (0x20) 12:04:47 (1212): Can't acquire lockfile (32) - waiting 35s 12:05:22 (1212): Can't acquire lockfile (32) - exiting 12:05:22 (1212): Error: The process cannot access the file because it is being used by another process. (0x20) 12:15:44 (3128): Can't acquire lockfile (32) - waiting 35s 12:16:19 (3128): Can't acquire lockfile (32) - exiting 12:16:19 (3128): Error: The process cannot access the file because it is being used by another process. (0x20) 12:26:19 (4560): Can't acquire lockfile (32) - waiting 35s 12:26:54 (4560): Can't acquire lockfile (32) - exiting 12:26:54 (4560): Error: The process cannot access the file because it is being used by another process. (0x20) 12:37:16 (3664): Can't acquire lockfile (32) - waiting 35s 12:37:51 (3664): Can't acquire lockfile (32) - exiting 12:37:51 (3664): Error: The process cannot access the file because it is being used by another process. (0x20) 12:47:51 (3220): Can't acquire lockfile (32) - waiting 35s 12:48:26 (3220): Can't acquire lockfile (32) - exiting 12:48:26 (3220): Error: The process cannot access the file because it is being used by another process. (0x20) 12:58:28 (728): Can't acquire lockfile (32) - waiting 35s 12:59:03 (728): Can't acquire lockfile (32) - exiting 12:59:03 (728): Error: The process cannot access the file because it is being used by another process. (0x20) 13:09:03 (4528): Can't acquire lockfile (32) - waiting 35s 13:09:38 (4528): Can't acquire lockfile (32) - exiting 13:09:38 (4528): Error: The process cannot access the file because it is being used by another process. (0x20) 13:19:55 (3844): Can't acquire lockfile (32) - waiting 35s 13:20:30 (3844): Can't acquire lockfile (32) - exiting 13:20:30 (3844): Error: The process cannot access the file because it is being used by another process. (0x20) 13:30:31 (3068): Can't acquire lockfile (32) - waiting 35s 13:31:06 (3068): Can't acquire lockfile (32) - exiting 13:31:06 (3068): Error: The process cannot access the file because it is being used by another process. (0x20) 13:41:06 (4420): Can't acquire lockfile (32) - waiting 35s 13:41:41 (4420): Can't acquire lockfile (32) - exiting 13:41:41 (4420): Error: The process cannot access the file because it is being used by another process. (0x20) 13:51:41 (1888): Can't acquire lockfile (32) - waiting 35s 13:52:16 (1888): Can't acquire lockfile (32) - exiting 13:52:16 (1888): Error: The process cannot access the file because it is being used by another process. (0x20) 14:02:17 (1532): Can't acquire lockfile (32) - waiting 35s 14:02:52 (1532): Can't acquire lockfile (32) - exiting 14:02:52 (1532): Error: The process cannot access the file because it is being used by another process. (0x20) 14:12:53 (6132): Can't acquire lockfile (32) - waiting 35s 14:13:28 (6132): Can't acquire lockfile (32) - exiting 14:13:28 (6132): Error: The process cannot access the file because it is being used by another process. (0x20) 14:50:58 (3612): Can't acquire lockfile (32) - waiting 35s 14:51:33 (3612): Can't acquire lockfile (32) - exiting 14:51:33 (3612): Error: The process cannot access the file because it is being used by another process. (0x20) 15:14:34 (5112): Can't acquire lockfile (32) - waiting 35s 15:15:09 (5112): Can't acquire lockfile (32) - exiting 15:15:09 (5112): Error: The process cannot access the file because it is being used by another process. (0x20) 15:45:19 (4896): Can't acquire lockfile (32) - waiting 35s 15:45:54 (4896): Can't acquire lockfile (32) - exiting 15:45:54 (4896): Error: The process cannot access the file because it is being used by another process. (0x20) 16:17:28 (5796): Can't acquire lockfile (32) - waiting 35s 16:18:03 (5796): Can't acquire lockfile (32) - exiting 16:18:03 (5796): Error: The process cannot access the file because it is being used by another process. (0x20) 16:48:20 (6136): Can't acquire lockfile (32) - waiting 35s 16:48:55 (6136): Can't acquire lockfile (32) - exiting 16:48:55 (6136): Error: The process cannot access the file because it is being used by another process. (0x20) 17:11:39 (3284): Can't acquire lockfile (32) - waiting 35s 17:12:14 (3284): Can't acquire lockfile (32) - exiting 17:12:14 (3284): Error: The process cannot access the file because it is being used by another process. (0x20) 17:42:50 (2592): Can't acquire lockfile (32) - waiting 35s 17:43:25 (2592): Can't acquire lockfile (32) - exiting 17:43:25 (2592): Error: The process cannot access the file because it is being used by another process. (0x20) 18:15:17 (1888): Can't acquire lockfile (32) - waiting 35s 18:15:52 (1888): Can't acquire lockfile (32) - exiting 18:15:52 (1888): Error: The process cannot access the file because it is being used by another process. (0x20) 18:32:37 (5988): Can't acquire lockfile (32) - waiting 35s 18:33:12 (5988): Can't acquire lockfile (32) - exiting 18:33:12 (5988): Error: The process cannot access the file because it is being used by another process. (0x20) 18:46:16 (4780): Can't acquire lockfile (32) - waiting 35s 18:46:51 (4780): Can't acquire lockfile (32) - exiting 18:46:51 (4780): Error: The process cannot access the file because it is being used by another process. (0x20) 18:59:10 (384): Can't acquire lockfile (32) - waiting 35s 18:59:45 (384): Can't acquire lockfile (32) - exiting 18:59:45 (384): Error: The process cannot access the file because it is being used by another process. (0x20) 19:00:15 (4912): Can't acquire lockfile (32) - waiting 35s 19:00:50 (4912): Can't acquire lockfile (32) - exiting 19:00:50 (4912): Error: The process cannot access the file because it is being used by another process. (0x20) 19:31:11 (6004): Can't acquire lockfile (32) - waiting 35s 19:31:46 (6004): Can't acquire lockfile (32) - exiting 19:31:46 (6004): Error: The process cannot access the file because it is being used by another process. (0x20) 20:02:44 (2236): Can't acquire lockfile (32) - waiting 35s 20:03:19 (2236): Can't acquire lockfile (32) - exiting 20:03:19 (2236): Error: The process cannot access the file because it is being used by another process. (0x20) 20:13:56 (3512): Can't acquire lockfile (32) - waiting 35s 20:14:31 (3512): Can't acquire lockfile (32) - exiting 20:14:31 (3512): Error: The process cannot access the file because it is being used by another process. (0x20) 20:33:33 (6104): Can't acquire lockfile (32) - waiting 35s 20:34:08 (6104): Can't acquire lockfile (32) - exiting 20:34:08 (6104): Error: The process cannot access the file because it is being used by another process. (0x20) 20:45:09 (6104): Can't acquire lockfile (32) - waiting 35s 20:45:44 (6104): Can't acquire lockfile (32) - exiting 20:45:44 (6104): Error: The process cannot access the file because it is being used by another process. (0x20) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:26:27 (4236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:25:33 (5684): Can't acquire lockfile (32) - waiting 35s 11:25:39 (4148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:56:34 (1732): Can't acquire lockfile (32) - waiting 35s 15:56:36 (1444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:45:42 (3596): Can't acquire lockfile (32) - waiting 35s 09:45:49 (3572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:29:28 (2192): Can't acquire lockfile (32) - waiting 35s 14:29:49 (6020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:03 (2192): Can't set up shared mem: -1. Will run in standalone mode. 14:30:04 (4144): Can't set up shared mem: -1. Will run in standalone mode. 14:30:18 (888): Can't acquire lockfile (32) - waiting 35s 14:30:53 (888): Can't acquire lockfile (32) - exiting 14:30:53 (888): Error: The process cannot access the file because it is being used by another process. (0x20) 15:03:59 (4912): Can't acquire lockfile (32) - waiting 35s 15:04:34 (4912): Can't acquire lockfile (32) - exiting 15:04:34 (4912): Error: The process cannot access the file because it is being used by another process. (0x20) 15:33:25 (5336): Can't acquire lockfile (32) - waiting 35s 15:34:00 (5336): Can't acquire lockfile (32) - exiting 15:34:00 (5336): Error: The process cannot access the file because it is being used by another process. (0x20) 15:44:00 (1348): Can't acquire lockfile (32) - waiting 35s 15:44:35 (1348): Can't acquire lockfile (32) - exiting 15:44:35 (1348): Error: The process cannot access the file because it is being used by another process. (0x20) 16:04:20 (4928): Can't acquire lockfile (32) - waiting 35s 16:04:55 (4928): Can't acquire lockfile (32) - exiting 16:04:55 (4928): Error: The process cannot access the file because it is being used by another process. (0x20) 16:23:29 (5440): Can't acquire lockfile (32) - waiting 35s 16:24:04 (5440): Can't acquire lockfile (32) - exiting 16:24:04 (5440): Error: The process cannot access the file because it is being used by another process. (0x20) 16:36:19 (5636): Can't acquire lockfile (32) - waiting 35s 16:36:54 (5636): Can't acquire lockfile (32) - exiting 16:36:55 (5636): Error: The process cannot access the file because it is being used by another process. (0x20) 17:06:56 (4168): Can't acquire lockfile (32) - waiting 35s 17:07:31 (4168): Can't acquire lockfile (32) - exiting 17:07:31 (4168): Error: The process cannot access the file because it is being used by another process. (0x20) 17:24:06 (5004): Can't acquire lockfile (32) - waiting 35s 17:24:41 (5004): Can't acquire lockfile (32) - exiting 17:24:41 (5004): Error: The process cannot access the file because it is being used by another process. (0x20) 17:37:57 (6048): Can't acquire lockfile (32) - waiting 35s 17:38:32 (6048): Can't acquire lockfile (32) - exiting 17:38:32 (6048): Error: The process cannot access the file because it is being used by another process. (0x20) 17:55:33 (3392): Can't acquire lockfile (32) - waiting 35s 17:56:08 (3392): Can't acquire lockfile (32) - exiting 17:56:08 (3392): Error: The process cannot access the file because it is being used by another process. (0x20) 18:09:09 (1588): Can't acquire lockfile (32) - waiting 35s 18:09:44 (1588): Can't acquire lockfile (32) - exiting 18:09:44 (1588): Error: The process cannot access the file because it is being used by another process. (0x20) 18:26:02 (5816): Can't acquire lockfile (32) - waiting 35s 18:26:37 (5816): Can't acquire lockfile (32) - exiting 18:26:37 (5816): Error: The process cannot access the file because it is being used by another process. (0x20) 18:39:17 (5772): Can't acquire lockfile (32) - waiting 35s 18:39:52 (5772): Can't acquire lockfile (32) - exiting 18:39:52 (5772): Error: The process cannot access the file because it is being used by another process. (0x20) 19:09:22 (4300): Can't acquire lockfile (32) - waiting 35s 19:09:57 (4300): Can't acquire lockfile (32) - exiting 19:09:57 (4300): Error: The process cannot access the file because it is being used by another process. (0x20) 19:40:53 (3200): Can't acquire lockfile (32) - waiting 35s 19:41:28 (3200): Can't acquire lockfile (32) - exiting 19:41:28 (3200): Error: The process cannot access the file because it is being used by another process. (0x20) 20:12:05 (5324): Can't acquire lockfile (32) - waiting 35s 20:12:40 (5324): Can't acquire lockfile (32) - exiting 20:12:40 (5324): Error: The process cannot access the file because it is being used by another process. (0x20) 20:22:42 (2220): Can't acquire lockfile (32) - waiting 35s 20:23:17 (2220): Can't acquire lockfile (32) - exiting 20:23:17 (2220): Error: The process cannot access the file because it is being used by another process. (0x20) 20:43:26 (5540): Can't acquire lockfile (32) - waiting 35s 20:44:01 (5540): Can't acquire lockfile (32) - exiting 20:44:01 (5540): Error: The process cannot access the file because it is being used by another process. (0x20) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:09:02 (5908): Can't acquire lockfile (32) - waiting 35s 13:09:19 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:37 (5908): Can't acquire lockfile (32) - exiting 13:09:37 (5908): Error: The process cannot access the file because it is being used by another process. (0x20) 13:09:55 (5464): Can't acquire lockfile (32) - waiting 35s 13:10:10 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:40:43 (4844): Can't acquire lockfile (32) - waiting 35s 07:41:13 (4928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:18 (4844): Can't acquire lockfile (32) - exiting 07:41:18 (4844): Error: The process cannot access the file because it is being used by another process. (0x20) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 15:07:29 (3112): Can't acquire lockfile (32) - waiting 35s 15:07:36 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6080, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
11 Dec 2011 14:08:10	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	751,680	821,916	1.0934
10 Dec 2011 16:37:51	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	725,760	792,005	1.0913
09 Dec 2011 22:08:22	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	699,840	761,786	1.0885
09 Dec 2011 13:43:51	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	673,920	731,593	1.0856
08 Dec 2011 20:09:05	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	648,000	701,929	1.0832
08 Dec 2011 02:06:00	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	622,080	671,870	1.0800
07 Dec 2011 17:19:52	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	596,160	642,264	1.0773
06 Dec 2011 18:38:47	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	570,240	612,265	1.0737
05 Dec 2011 21:55:58	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	544,320	582,012	1.0692
05 Dec 2011 00:59:05	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	518,400	551,664	1.0642
04 Dec 2011 00:48:04	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	492,480	521,337	1.0586
03 Dec 2011 15:48:01	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	466,560	491,137	1.0527
02 Dec 2011 20:02:00	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	440,640	460,859	1.0459
01 Dec 2011 18:14:01	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	388,800	426,766	1.0976
30 Nov 2011 23:27:23	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	362,880	396,826	1.0935
30 Nov 2011 01:39:21	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	336,960	366,599	1.0880
29 Nov 2011 17:18:36	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	311,040	336,456	1.0817
28 Nov 2011 19:56:02	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	285,120	306,075	1.0735
27 Nov 2011 19:25:26	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	259,200	275,792	1.0640
26 Nov 2011 21:32:01	1142551	13600349	hadcm3n_t0lv_1940_40_007535992_0	233,280	245,160	1.0509