Task 12740513

Name	hadcm3n_o3c9_1900_40_007199660_1
Workunit	7397940
Created	28 Mar 2011, 14:06:36 UTC
Sent	31 Mar 2011, 9:15:06 UTC
Report deadline	30 Jun 2011, 16:42:17 UTC
Received	16 May 2011, 1:25:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1085787
Run time	5 days 22 hours 5 min 5 sec
CPU time	5 days 17 hours 31 min 45 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.79 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:08:28 (5408): No heartbeat from core client for 30 sec - exiting 16:08:29 (5408): No heartbeat from core client for 30 sec - exiting 16:08:30 (5408): No heartbeat from core client for 30 sec - exiting 16:08:31 (5408): No heartbeat from core client for 30 sec - exiting 16:08:32 (5408): No heartbeat from core client for 30 sec - exiting 16:08:33 (5408): No heartbeat from core client for 30 sec - exiting 16:08:34 (5408): No heartbeat from core client for 30 sec - exiting 16:08:35 (5408): No heartbeat from core client for 30 sec - exiting 16:08:36 (5408): No heartbeat from core client for 30 sec - exiting 16:08:37 (5408): No heartbeat from core client for 30 sec - exiting 16:08:38 (5408): No heartbeat from core client for 30 sec - exiting 16:08:39 (5408): No heartbeat from core client for 30 sec - exiting 16:08:40 (5408): No heartbeat from core client for 30 sec - exiting 16:08:41 (5408): No heartbeat from core client for 30 sec - exiting 16:08:42 (5408): No heartbeat from core client for 30 sec - exiting 16:08:43 (5408): No heartbeat from core client for 30 sec - exiting 16:08:44 (5408): No heartbeat from core client for 30 sec - exiting 16:08:45 (5408): No heartbeat from core client for 30 sec - exiting 16:08:46 (5408): No heartbeat from core client for 30 sec - exiting 16:08:47 (5408): No heartbeat from core client for 30 sec - exiting 16:08:48 (5408): No heartbeat from core client for 30 sec - exiting 16:08:49 (5408): No heartbeat from core client for 30 sec - exiting 16:08:50 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:51 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:06:15 (5088): No heartbeat from core client for 30 sec - exiting 14:06:16 (5088): No heartbeat from core client for 30 sec - exiting 14:06:17 (5088): No heartbeat from core client for 30 sec - exiting 14:06:18 (5088): No heartbeat from core client for 30 sec - exiting 14:06:19 (5088): No heartbeat from core client for 30 sec - exiting 14:06:20 (5088): No heartbeat from core client for 30 sec - exiting 14:06:21 (5088): No heartbeat from core client for 30 sec - exiting 14:06:22 (5088): No heartbeat from core client for 30 sec - exiting 14:06:23 (5088): No heartbeat from core client for 30 sec - exiting 14:06:24 (5088): No heartbeat from core client for 30 sec - exiting 14:06:25 (5088): No heartbeat from core client for 30 sec - exiting 14:06:26 (5088): No heartbeat from core client for 30 sec - exiting 14:06:27 (5088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4108, iMonCtr=1 Model crash detected, will try to restart... 13:02:08 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:54:52 (5332): No heartbeat from core client for 30 sec - exiting 18:54:53 (5332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:35:47 (452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:31:56 (6744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:05 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:57 (5928): No heartbeat from core client for 30 sec - exiting 13:56:58 (5928): No heartbeat from core client for 30 sec - exiting 13:56:59 (5928): No heartbeat from core client for 30 sec - exiting 13:57:00 (5928): No heartbeat from core client for 30 sec - exiting 13:57:01 (5928): No heartbeat from core client for 30 sec - exiting 13:57:02 (5928): No heartbeat from core client for 30 sec - exiting 13:57:03 (5928): No heartbeat from core client for 30 sec - exiting 13:57:04 (5928): No heartbeat from core client for 30 sec - exiting 13:57:05 (5928): No heartbeat from core client for 30 sec - exiting 13:57:06 (5928): No heartbeat from core client for 30 sec - exiting 13:57:07 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:08 (5928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 17:08:55 (5304): No heartbeat from core client for 30 sec - exiting 17:08:56 (5304): No heartbeat from core client for 30 sec - exiting 17:08:57 (5304): No heartbeat from core client for 30 sec - exiting 17:08:58 (5304): No heartbeat from core client for 30 sec - exiting 17:08:59 (5304): No heartbeat from core client for 30 sec - exiting 17:09:00 (5304): No heartbeat from core client for 30 sec - exiting 17:09:01 (5304): No heartbeat from core client for 30 sec - exiting 17:09:02 (5304): No heartbeat from core client for 30 sec - exiting 17:09:03 (5304): No heartbeat from core client for 30 sec - exiting 17:09:04 (5304): No heartbeat from core client for 30 sec - exiting 17:09:05 (5304): No heartbeat from core client for 30 sec - exiting 17:09:06 (5304): No heartbeat from core client for 30 sec - exiting 17:09:07 (5304): No heartbeat from core client for 30 sec - exiting 17:09:08 (5304): No heartbeat from core client for 30 sec - exiting 17:09:09 (5304): No heartbeat from core client for 30 sec - exiting 17:09:10 (5304): No heartbeat from core client for 30 sec - exiting 17:09:11 (5304): No heartbeat from core client for 30 sec - exiting 17:09:12 (5304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:47:31 (1564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:48:25 (6500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:25 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:01:32 (6920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:40 (5816): No heartbeat from core client for 30 sec - exiting 11:36:41 (5816): No heartbeat from core client for 30 sec - exiting 11:36:42 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:43 (5816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:47:17 (6396): No heartbeat from core client for 30 sec - exiting 12:47:18 (6396): No heartbeat from core client for 30 sec - exiting 12:47:19 (6396): No heartbeat from core client for 30 sec - exiting 12:47:20 (6396): No heartbeat from core client for 30 sec - exiting 12:47:21 (6396): No heartbeat from core client for 30 sec - exiting 12:47:22 (6396): No heartbeat from core client for 30 sec - exiting 12:47:23 (6396): No heartbeat from core client for 30 sec - exiting 12:47:24 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:47:25 (6396): No heartbeat from core client for 30 sec - exiting 12:47:26 (6396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:13:12 (1444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:37:07 (3428): No heartbeat from core client for 30 sec - exiting 09:37:08 (3428): No heartbeat from core client for 30 sec - exiting 09:37:09 (3428): No heartbeat from core client for 30 sec - exiting 09:37:10 (3428): No heartbeat from core client for 30 sec - exiting 09:37:11 (3428): No heartbeat from core client for 30 sec - exiting 09:37:12 (3428): No heartbeat from core client for 30 sec - exiting 09:37:13 (3428): No heartbeat from core client for 30 sec - exiting 09:37:14 (3428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:19 (1568): No heartbeat from core client for 30 sec - exiting 12:35:20 (1568): No heartbeat from core client for 30 sec - exiting 12:35:21 (1568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:04:34 (1688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:54:27 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:28:32 (4232): No heartbeat from core client for 30 sec - exiting 15:28:33 (4232): No heartbeat from core client for 30 sec - exiting 15:28:34 (4232): No heartbeat from core client for 30 sec - exiting 15:28:35 (4232): No heartbeat from core client for 30 sec - exiting 15:28:36 (4232): No heartbeat from core client for 30 sec - exiting 15:28:37 (4232): No heartbeat from core client for 30 sec - exiting 15:28:38 (4232): No heartbeat from core client for 30 sec - exiting 15:28:39 (4232): No heartbeat from core client for 30 sec - exiting 15:28:40 (4232): No heartbeat from core client for 30 sec - exiting 15:28:41 (4232): No heartbeat from core client for 30 sec - exiting 15:28:42 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:57 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:45:32 (4268): No heartbeat from core client for 30 sec - exiting 10:45:33 (4268): No heartbeat from core client for 30 sec - exiting 10:45:34 (4268): No heartbeat from core client for 30 sec - exiting 10:45:35 (4268): No heartbeat from core client for 30 sec - exiting 10:45:36 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 May 2011 22:26:52	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	259,200	495,098	1.9101
13 May 2011 21:51:01	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	233,280	446,373	1.9135
12 May 2011 19:01:28	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	207,360	397,479	1.9169
10 May 2011 21:51:35	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	181,440	348,688	1.9218
09 May 2011 20:02:14	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	155,520	299,456	1.9255
20 Apr 2011 20:12:17	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	129,600	249,973	1.9288
04 Apr 2011 22:33:07	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	103,680	201,211	1.9407
02 Apr 2011 15:19:21	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	77,760	152,243	1.9579
02 Apr 2011 01:27:07	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	51,840	103,041	1.9877
01 Apr 2011 10:20:55	1085787	12740513	hadcm3n_o3c9_1900_40_007199660_1	25,920	51,293	1.9789