Task 14771674

Name	hadcm3n_u4qe_1980_40_007999485_1
Workunit	8154599
Created	4 Jun 2012, 13:43:23 UTC
Sent	4 Jun 2012, 14:11:23 UTC
Report deadline	3 Sep 2012, 21:38:34 UTC
Received	26 Jul 2012, 11:54:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1122077
Run time	10 days 21 hours 27 min 7 sec
CPU time	9 days 18 hours 8 min 30 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.24 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1360, iMonCtr=1 Model crash detected, will try to restart... 15:30:03 (3848): No heartbeat from core client for 30 sec - exiting 15:30:04 (3848): No heartbeat from core client for 30 sec - exiting 15:30:05 (3848): No heartbeat from core client for 30 sec - exiting 15:30:06 (3848): No heartbeat from core client for 30 sec - exiting 15:30:07 (3848): No heartbeat from core client for 30 sec - exiting 15:30:08 (3848): No heartbeat from core client for 30 sec - exiting 15:30:09 (3848): No heartbeat from core client for 30 sec - exiting 15:30:10 (3848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:24 (4412): No heartbeat from core client for 30 sec - exiting 09:05:25 (4412): No heartbeat from core client for 30 sec - exiting 09:05:26 (4412): No heartbeat from core client for 30 sec - exiting 09:05:27 (4412): No heartbeat from core client for 30 sec - exiting 09:05:28 (4412): No heartbeat from core client for 30 sec - exiting 09:05:29 (4412): No heartbeat from core client for 30 sec - exiting 09:05:31 (4412): No heartbeat from core client for 30 sec - exiting 09:05:32 (4412): No heartbeat from core client for 30 sec - exiting 09:05:33 (4412): No heartbeat from core client for 30 sec - exiting 09:05:34 (4412): No heartbeat from core client for 30 sec - exiting 09:05:35 (4412): No heartbeat from core client for 30 sec - exiting 09:05:37 (4412): No heartbeat from core client for 30 sec - exiting 09:05:38 (4412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4900, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:11:58 (4616): No heartbeat from core client for 30 sec - exiting 09:12:00 (4616): No heartbeat from core client for 30 sec - exiting 09:12:01 (4616): No heartbeat from core client for 30 sec - exiting 09:12:02 (4616): No heartbeat from core client for 30 sec - exiting 09:12:03 (4616): No heartbeat from core client for 30 sec - exiting 09:12:04 (4616): No heartbeat from core client for 30 sec - exiting 09:12:05 (4616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:54:52 (4676): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:00 (5056): No heartbeat from core client for 30 sec - exiting 10:00:01 (5056): No heartbeat from core client for 30 sec - exiting 10:00:02 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:52:55 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:15:42 (4344): No heartbeat from core client for 30 sec - exiting 11:15:43 (4344): No heartbeat from core client for 30 sec - exiting 11:15:44 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:12:30 (4992): No heartbeat from core client for 30 sec - exiting 15:12:32 (4992): No heartbeat from core client for 30 sec - exiting 15:12:33 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 12:32:06 (5052): No heartbeat from core client for 30 sec - exiting 12:32:07 (5052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5028, iMonCtr=1 Model crash detected, will try to restart... 13:10:07 (5008): No heartbeat from core client for 30 sec - exiting 13:10:08 (5008): No heartbeat from core client for 30 sec - exiting 13:10:09 (5008): No heartbeat from core client for 30 sec - exiting 13:10:10 (5008): No heartbeat from core client for 30 sec - exiting 13:10:11 (5008): No heartbeat from core client for 30 sec - exiting 13:10:12 (5008): No heartbeat from core client for 30 sec - exiting 13:10:13 (5008): No heartbeat from core client for 30 sec - exiting 13:10:14 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2448, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=1 Model crash detected, will try to restart... 18:37:01 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:44:04 (4868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:38 (4628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:04:14 (4936): No heartbeat from core client for 30 sec - exiting 10:04:15 (4936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4840, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 18:04:31 (1148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:05 (5028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4588, iMonCtr=1 Model crash detected, will try to restart... 18:51:50 (5024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:17 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:18 (5016): No heartbeat from core client for 30 sec - exiting 13:00:20 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jul 2012 11:56:06	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	259,200	842,906	3.2520
19 Jul 2012 14:42:22	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	233,280	757,856	3.2487
17 Jul 2012 09:30:27	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	207,360	673,214	3.2466
12 Jul 2012 14:12:52	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	181,440	589,764	3.2505
09 Jul 2012 08:39:46	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	155,520	504,576	3.2444
03 Jul 2012 12:58:50	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	129,600	419,992	3.2407
27 Jun 2012 10:24:33	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	103,680	335,433	3.2353
20 Jun 2012 14:29:56	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	77,760	252,085	3.2418
14 Jun 2012 13:11:12	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	51,840	168,404	3.2485
11 Jun 2012 12:39:03	1122077	14771674	hadcm3n_u4qe_1980_40_007999485_1	25,920	83,320	3.2145