Task 15778320

Name	hadcm3n_o064_1980_40_008284651_2
Workunit	8435786
Created	11 May 2013, 22:16:51 UTC
Sent	11 May 2013, 22:17:03 UTC
Report deadline	11 Aug 2013, 5:44:14 UTC
Received	6 Jun 2013, 22:33:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1267244
Run time	5 days 16 hours 42 min 10 sec
CPU time	5 days 7 hours 6 min 41 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.22 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 08:49:40 (4544): No heartbeat from core client for 30 sec - exiting 08:49:41 (4544): No heartbeat from core client for 30 sec - exiting 08:49:42 (4544): No heartbeat from core client for 30 sec - exiting 08:49:43 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:42 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:27 (4528): No heartbeat from core client for 30 sec - exiting 18:17:28 (4528): No heartbeat from core client for 30 sec - exiting 18:17:29 (4528): No heartbeat from core client for 30 sec - exiting 18:17:30 (4528): No heartbeat from core client for 30 sec - exiting 18:17:31 (4528): No heartbeat from core client for 30 sec - exiting 18:17:32 (4528): No heartbeat from core client for 30 sec - exiting 18:17:33 (4528): No heartbeat from core client for 30 sec - exiting 18:17:34 (4528): No heartbeat from core client for 30 sec - exiting 18:17:35 (4528): No heartbeat from core client for 30 sec - exiting 18:17:37 (4528): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8424, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4700, iMonCtr=1 Model crash detected, will try to restart... 15:05:37 (4540): No heartbeat from core client for 30 sec - exiting 15:05:44 (4540): No heartbeat from core client for 30 sec - exiting 15:05:45 (4540): No heartbeat from core client for 30 sec - exiting 15:05:46 (4540): No heartbeat from core client for 30 sec - exiting 15:05:47 (4540): No heartbeat from core client for 30 sec - exiting 15:05:48 (4540): No heartbeat from core client for 30 sec - exiting 15:05:49 (4540): No heartbeat from core client for 30 sec - exiting 15:05:50 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:05:52 (4540): No heartbeat from core client for 30 sec - exiting 15:12:20 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:20 (4140): No heartbeat from core client for 30 sec - exiting 14:47:30 (4140): No heartbeat from core client for 30 sec - exiting 14:47:31 (4140): No heartbeat from core client for 30 sec - exiting 14:47:32 (4140): No heartbeat from core client for 30 sec - exiting 14:47:33 (4140): No heartbeat from core client for 30 sec - exiting 14:47:34 (4140): No heartbeat from core client for 30 sec - exiting 14:47:35 (4140): No heartbeat from core client for 30 sec - exiting 14:47:36 (4140): No heartbeat from core client for 30 sec - exiting 14:47:37 (4140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:38 (4140): No heartbeat from core client for 30 sec - exiting 15:01:29 (5076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:18 (5048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:23:55 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:23 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:05 (2996): No heartbeat from core client for 30 sec - exiting 09:28:06 (2996): No heartbeat from core client for 30 sec - exiting 09:28:07 (2996): No heartbeat from core client for 30 sec - exiting 09:28:08 (2996): No heartbeat from core client for 30 sec - exiting 09:28:09 (2996): No heartbeat from core client for 30 sec - exiting 09:28:10 (2996): No heartbeat from core client for 30 sec - exiting 09:28:11 (2996): No heartbeat from core client for 30 sec - exiting 09:28:12 (2996): No heartbeat from core client for 30 sec - exiting 09:29:25 (5436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:52 (2028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:03 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:08 (352): No heartbeat from core client for 30 sec - exiting 10:54:09 (352): No heartbeat from core client for 30 sec - exiting 10:54:10 (352): No heartbeat from core client for 30 sec - exiting 10:54:11 (352): No heartbeat from core client for 30 sec - exiting 10:54:12 (352): No heartbeat from core client for 30 sec - exiting 10:54:13 (352): No heartbeat from core client for 30 sec - exiting 10:54:14 (352): No heartbeat from core client for 30 sec - exiting 10:54:15 (352): No heartbeat from core client for 30 sec - exiting 10:54:16 (352): No heartbeat from core client for 30 sec - exiting 10:54:17 (352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:11:58 (2216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:11:59 (2216): No heartbeat from core client for 30 sec - exiting 16:12:00 (2216): No heartbeat from core client for 30 sec - exiting 16:12:01 (2216): No heartbeat from core client for 30 sec - exiting 16:12:02 (2216): No heartbeat from core client for 30 sec - exiting 16:12:03 (2216): No heartbeat from core client for 30 sec - exiting 16:12:04 (2216): No heartbeat from core client for 30 sec - exiting 16:12:05 (2216): No heartbeat from core client for 30 sec - exiting 16:12:06 (2216): No heartbeat from core client for 30 sec - exiting 16:12:07 (2216): No heartbeat from core client for 30 sec - exiting 16:12:08 (2216): No heartbeat from core client for 30 sec - exiting 16:12:09 (2216): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2760, iMonCtr=1 Model crash detected, will try to restart... 02:45:44 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771F3AB3 read attempt to address 0x405EEE1A Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x771F7373 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o064_1980_40_008284651/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2013 04:59:31	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	259,200	452,726	1.7466
05 Jun 2013 15:58:41	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	233,280	406,906	1.7443
05 Jun 2013 02:42:44	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	207,360	361,500	1.7433
27 May 2013 15:41:21	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	181,440	316,334	1.7435
27 May 2013 00:31:05	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	155,520	272,386	1.7515
26 May 2013 11:51:03	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	129,600	227,564	1.7559
25 May 2013 23:17:11	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	103,680	182,674	1.7619
21 May 2013 01:00:06	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	77,760	137,319	1.7659
18 May 2013 22:23:13	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	51,840	91,603	1.7670
12 May 2013 21:02:29	1267244	15778320	hadcm3n_o064_1980_40_008284651_2	25,920	44,791	1.7280