Task 13339436

Name	hadcm3n_o2r4_1940_40_007419316_2
Workunit	7616951
Created	6 Sep 2011, 2:10:32 UTC
Sent	6 Sep 2011, 2:15:56 UTC
Report deadline	6 Dec 2011, 9:43:07 UTC
Received	25 Oct 2011, 14:42:08 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1055313
Run time	23 days 13 hours 9 min 12 sec
CPU time	18 days 11 hours 17 min 5 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:59:04 (5972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C11:30:23 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:38:26 (1324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:33 (1324): No heartbeat from core client for 30 sec - exiting 20:38:35 (1324): No heartbeat from core client for 30 sec - exiting 20:38:36 (1324): No heartbeat from core client for 30 sec - exiting Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x7C812AFB Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00738FE0 read attempt to address 0x00000044 Engaging BOINC Windows Runtime Debugger... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1268, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4504, selfPID=4504, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
31 Oct 2011 14:44:13	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	518,400	1,595,737	3.0782
31 Oct 2011 14:44:13	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	492,480	1,514,242	3.0747
16 Oct 2011 18:26:40	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	466,560	1,432,932	3.0713
14 Oct 2011 18:42:20	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	440,640	1,353,993	3.0728
12 Oct 2011 11:22:49	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	414,720	1,272,576	3.0685
10 Oct 2011 20:56:27	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	388,800	1,193,795	3.0705
08 Oct 2011 15:26:39	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	362,880	1,112,380	3.0654
06 Oct 2011 12:22:42	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	336,960	1,033,768	3.0679
04 Oct 2011 17:04:58	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	311,040	953,983	3.0671
02 Oct 2011 11:02:40	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	285,120	872,093	3.0587
30 Sep 2011 08:51:12	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	259,200	791,475	3.0535
28 Sep 2011 10:09:59	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	233,280	712,814	3.0556
26 Sep 2011 05:32:45	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	207,360	635,736	3.0659
23 Sep 2011 14:15:09	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	181,440	558,128	3.0761
21 Sep 2011 17:05:38	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	155,520	478,476	3.0766
19 Sep 2011 06:36:27	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	129,600	398,252	3.0729
16 Sep 2011 17:46:30	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	103,680	317,420	3.0615
16 Sep 2011 17:46:29	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	77,760	240,396	3.0915
11 Sep 2011 09:47:25	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	51,840	160,324	3.0927
09 Sep 2011 11:12:13	1055313	13339436	hadcm3n_o2r4_1940_40_007419316_2	25,920	80,581	3.1088