Task 16662821

Name	hadcm3n_863d_1980_40_008514400_4
Workunit	8661912
Created	17 Jun 2014, 11:53:59 UTC
Sent	17 Jun 2014, 11:54:02 UTC
Report deadline	16 Sep 2014, 19:21:13 UTC
Received	30 Jun 2014, 3:19:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1322748
Run time	5 days 6 hours 0 min 44 sec
CPU time	5 days 0 hours 25 min 43 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.83 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:49:58 (8720): No heartbeat from core client for 30 sec - exiting 08:49:59 (8720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:09:12 (5312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on 863dko.dai6ad0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=13092, selfPID=13092, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... 13:22:12 (9772): No heartbeat from core client for 30 sec - exiting 13:22:13 (9772): No heartbeat from core client for 30 sec - exiting 13:22:14 (9772): No heartbeat from core client for 30 sec - exiting 13:22:15 (9772): No heartbeat from core client for 30 sec - exiting 13:22:16 (9772): No heartbeat from core client for 30 sec - exiting 13:22:17 (9772): No heartbeat from core client for 30 sec - exiting 13:22:18 (9772): No heartbeat from core client for 30 sec - exiting 13:22:19 (9772): No heartbeat from core client for 30 sec - exiting 13:22:20 (9772): No heartbeat from core client for 30 sec - exiting 13:22:22 (9772): No heartbeat from core client for 30 sec - exiting 13:22:23 (9772): No heartbeat from core client for 30 sec - exiting 13:22:24 (9772): No heartbeat from core client for 30 sec - exiting 13:22:25 (9772): No heartbeat from core client for 30 sec - exiting 13:22:26 (9772): No heartbeat from core client for 30 sec - exiting 13:22:27 (9772): No heartbeat from core client for 30 sec - exiting 13:22:28 (9772): No heartbeat from core client for 30 sec - exiting 13:22:29 (9772): No heartbeat from core client for 30 sec - exiting 13:22:30 (9772): No heartbeat from core client for 30 sec - exiting 13:22:31 (9772): No heartbeat from core client for 30 sec - exiting 13:22:33 (9772): No heartbeat from core client for 30 sec - exiting 13:22:34 (9772): No heartbeat from core client for 30 sec - exiting 13:22:35 (9772): No heartbeat from core client for 30 sec - exiting 13:22:36 (9772): No heartbeat from core client for 30 sec - exiting 13:22:37 (9772): No heartbeat from core client for 30 sec - exiting 13:22:38 (9772): No heartbeat from core client for 30 sec - exiting 13:22:39 (9772): No heartbeat from core client for 30 sec - exiting 13:22:40 (9772): No heartbeat from core client for 30 sec - exiting 13:22:41 (9772): No heartbeat from core client for 30 sec - exiting 13:22:42 (9772): No heartbeat from core client for 30 sec - exiting 13:22:43 (9772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11508, selfPID=11508, iMonCtr=1 No Process Handle Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4188, selfPID=4188, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x00417B59 read attempt to address 0x0000004C Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77B912A4 read attempt to address 0x40D583FC Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_863d_1980_40_008514400/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jun 2014 04:48:36	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	259,200	409,378	1.5794
27 Jun 2014 09:18:00	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	233,280	377,898	1.6199
26 Jun 2014 10:45:03	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	207,360	339,511	1.6373
25 Jun 2014 07:53:29	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	181,440	293,668	1.6185
24 Jun 2014 08:32:24	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	155,520	250,322	1.6096
24 Jun 2014 04:31:42	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	129,600	209,903	1.6196
21 Jun 2014 05:25:01	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	103,680	167,024	1.6110
20 Jun 2014 03:30:30	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	77,760	122,597	1.5766
19 Jun 2014 04:35:39	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	51,840	79,487	1.5333
18 Jun 2014 07:09:02	1322748	16662821	hadcm3n_863d_1980_40_008514400_4	25,920	36,239	1.3981