Task 15840594

Name	hadcm3n_n3my_1920_40_008377616_2
Workunit	8528475
Created	12 Jun 2013, 20:09:52 UTC
Sent	12 Jun 2013, 20:24:13 UTC
Report deadline	12 Sep 2013, 3:51:24 UTC
Received	14 Aug 2013, 16:31:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1186368
Run time	40 days 15 hours 55 min 29 sec
CPU time	36 days 1 hours 55 min 50 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5284, iMonCtr=1 Model crash detected, will try to restart... 02:56:35 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:11:54 (3056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:29:16 (6280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:21:43 (6320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:03:08 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:37 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6200, iMonCtr=1 Model crash detected, will try to restart... 10:46:54 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6884, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3096, iMonCtr=1 Model crash detected, will try to restart... 21:01:22 (2704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:31:46 (5408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:18:31 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:51:22 (4484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:39:48 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:40:21 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:05:30 (5364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5784, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:41:59 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5968, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1376, iMonCtr=1 Model crash detected, will try to restart... 21:26:23 (5812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5416, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4868, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 00:22:54 (5616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x76F23AB3 read attempt to address 0x40609F76 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_n3my_1920_40_008377616/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Aug 2013 16:34:40	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	1,036,800	3,117,346	3.0067
14 Aug 2013 16:34:40	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	1,010,880	3,039,653	3.0069
14 Aug 2013 16:34:40	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	984,960	2,960,760	3.0060
14 Aug 2013 16:34:40	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	959,040	2,879,442	3.0024
30 Jul 2013 10:26:33	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	933,120	2,802,519	3.0034
29 Jul 2013 13:51:50	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	907,200	2,725,017	3.0038
26 Jul 2013 04:51:01	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	881,280	2,645,078	3.0014
24 Jul 2013 19:26:19	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	855,360	2,563,561	2.9971
23 Jul 2013 22:16:23	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	829,440	2,484,368	2.9952
23 Jul 2013 21:50:14	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	803,520	2,407,066	2.9957
23 Jul 2013 21:20:50	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	777,600	2,329,499	2.9958
23 Jul 2013 20:37:43	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	751,680	2,251,836	2.9957
23 Jul 2013 19:57:23	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	725,760	2,172,432	2.9933
23 Jul 2013 18:37:57	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	699,840	2,094,779	2.9932
23 Jul 2013 14:34:49	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	673,920	2,016,811	2.9927
23 Jul 2013 14:34:49	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	648,000	1,938,223	2.9911
23 Jul 2013 14:34:49	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	622,080	1,861,311	2.9921
23 Jul 2013 14:34:49	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	596,160	1,784,298	2.9930
23 Jul 2013 14:34:49	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	570,240	1,707,184	2.9938
12 Jul 2013 01:06:58	1186368	15840594	hadcm3n_n3my_1920_40_008377616_2	544,320	1,630,559	2.9956