Task 13420233

Name	hadcm3n_u5fg_1980_40_007459608_4
Workunit	7657111
Created	25 Sep 2011, 8:25:03 UTC
Sent	25 Sep 2011, 8:37:22 UTC
Report deadline	25 Dec 2011, 16:04:33 UTC
Received	7 Dec 2011, 21:05:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1060393
Run time	21 days 12 hours 42 min 48 sec
CPU time	14 days 19 hours 0 min 19 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.25 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5928, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12092, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4456, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4520, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5536, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4532, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5636, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=812, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5348, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4804, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 09:40:57 (10212): No heartbeat from core client for 30 sec - exiting 09:40:58 (10212): No heartbeat from core client for 30 sec - exiting 09:40:59 (10212): No heartbeat from core client for 30 sec - exiting 09:41:00 (10212): No heartbeat from core client for 30 sec - exiting 09:41:01 (10212): No heartbeat from core client for 30 sec - exiting 09:41:03 (10212): No heartbeat from core client for 30 sec - exiting 09:41:04 (10212): No heartbeat from core client for 30 sec - exiting 09:41:05 (10212): No heartbeat from core client for 30 sec - exiting 09:41:06 (10212): No heartbeat from core client for 30 sec - exiting 09:41:07 (10212): No heartbeat from core client for 30 sec - exiting 09:41:08 (10212): No heartbeat from core client for 30 sec - exiting 09:41:09 (10212): No heartbeat from core client for 30 sec - exiting 09:41:10 (10212): No heartbeat from core client for 30 sec - exiting 09:41:12 (10212): No heartbeat from core client for 30 sec - exiting 09:41:13 (10212): No heartbeat from core client for 30 sec - exiting 09:41:14 (10212): No heartbeat from core client for 30 sec - exiting 09:41:15 (10212): No heartbeat from core client for 30 sec - exiting 09:41:16 (10212): No heartbeat from core client for 30 sec - exiting 09:41:17 (10212): No heartbeat from core client for 30 sec - exiting 09:41:18 (10212): No heartbeat from core client for 30 sec - exiting 09:41:20 (10212): No heartbeat from core client for 30 sec - exiting 09:41:21 (10212): No heartbeat from core client for 30 sec - exiting 09:41:22 (10212): No heartbeat from core client for 30 sec - exiting 09:41:23 (10212): No heartbeat from core client for 30 sec - exiting 09:41:24 (10212): No heartbeat from core client for 30 sec - exiting 09:41:25 (10212): No heartbeat from core client for 30 sec - exiting 09:41:26 (10212): No heartbeat from core client for 30 sec - exiting 09:41:27 (10212): No heartbeat from core client for 30 sec - exiting 09:41:29 (10212): No heartbeat from core client for 30 sec - exiting 09:41:30 (10212): No heartbeat from core client for 30 sec - exiting 09:41:31 (10212): No heartbeat from core client for 30 sec - exiting 09:41:32 (10212): No heartbeat from core client for 30 sec - exiting 09:41:33 (10212): No heartbeat from core client for 30 sec - exiting 09:41:34 (10212): No heartbeat from core client for 30 sec - exiting 09:41:35 (10212): No heartbeat from core client for 30 sec - exiting 09:41:36 (10212): No heartbeat from core client for 30 sec - exiting 09:41:37 (10212): No heartbeat from core client for 30 sec - exiting 09:41:39 (10212): No heartbeat from core client for 30 sec - exiting 09:41:40 (10212): No heartbeat from core client for 30 sec - exiting 09:41:41 (10212): No heartbeat from core client for 30 sec - exiting 09:41:42 (10212): No heartbeat from core client for 30 sec - exiting 09:41:43 (10212): No heartbeat from core client for 30 sec - exiting 09:41:44 (10212): No heartbeat from core client for 30 sec - exiting 09:41:45 (10212): No heartbeat from core client for 30 sec - exiting 09:41:46 (10212): No heartbeat from core client for 30 sec - exiting 09:41:47 (10212): No heartbeat from core client for 30 sec - exiting 09:41:48 (10212): No heartbeat from core client for 30 sec - exiting 09:41:50 (10212): No heartbeat from core client for 30 sec - exiting 09:41:51 (10212): No heartbeat from core client for 30 sec - exiting 09:41:52 (10212): No heartbeat from core client for 30 sec - exiting 09:41:53 (10212): No heartbeat from core client for 30 sec - exiting 09:41:54 (10212): No heartbeat from core client for 30 sec - exiting 09:41:55 (10212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5940, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5408, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2011 12:53:07	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	259,200	1,278,013	4.9306
26 Nov 2011 16:26:25	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	233,280	1,152,480	4.9403
20 Nov 2011 20:09:50	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	207,360	1,031,647	4.9751
15 Nov 2011 17:29:45	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	181,440	906,880	4.9982
03 Nov 2011 19:30:37	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	155,520	774,126	4.9777
31 Oct 2011 16:41:20	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	129,600	643,801	4.9676
31 Oct 2011 14:15:03	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	103,680	514,601	4.9634
15 Oct 2011 22:02:26	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	77,760	386,733	4.9734
08 Oct 2011 16:53:12	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	51,840	258,335	4.9833
02 Oct 2011 00:44:27	1060393	13420233	hadcm3n_u5fg_1980_40_007459608_4	25,920	132,172	5.0992