Task 16280564

Name	hadcm3n_7aoq_1980_40_008425133_2
Workunit	8575989
Created	5 Feb 2014, 13:58:36 UTC
Sent	5 Feb 2014, 13:58:43 UTC
Report deadline	9 Aug 2023, 19:18:43 UTC
Received	23 Feb 2014, 10:07:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1243774
Run time	6 days 21 hours 1 min 28 sec
CPU time	6 days 15 hours 3 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.27 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.39</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:03:47 (13740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:48 (13740): No heartbeat from core client for 30 sec - exiting 09:03:49 (13740): No heartbeat from core client for 30 sec - exiting 09:12:17 (12552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:12:19 (12552): No heartbeat from core client for 30 sec - exiting 09:12:20 (12552): No heartbeat from core client for 30 sec - exiting 09:12:21 (12552): No heartbeat from core client for 30 sec - exiting 09:12:22 (12552): No heartbeat from core client for 30 sec - exiting 09:12:23 (12552): No heartbeat from core client for 30 sec - exiting 09:12:24 (12552): No heartbeat from core client for 30 sec - exiting 09:12:25 (12552): No heartbeat from core client for 30 sec - exiting 09:12:27 (12552): No heartbeat from core client for 30 sec - exiting 09:12:28 (12552): No heartbeat from core client for 30 sec - exiting 09:12:29 (12552): No heartbeat from core client for 30 sec - exiting 09:12:30 (12552): No heartbeat from core client for 30 sec - exiting 09:12:31 (12552): No heartbeat from core client for 30 sec - exiting 09:12:32 (12552): No heartbeat from core client for 30 sec - exiting 09:12:33 (12552): No heartbeat from core client for 30 sec - exiting 09:12:34 (12552): No heartbeat from core client for 30 sec - exiting 09:12:35 (12552): No heartbeat from core client for 30 sec - exiting 09:12:36 (12552): No heartbeat from core client for 30 sec - exiting 09:12:37 (12552): No heartbeat from core client for 30 sec - exiting 09:12:38 (12552): No heartbeat from core client for 30 sec - exiting 09:12:39 (12552): No heartbeat from core client for 30 sec - exiting 09:12:40 (12552): No heartbeat from core client for 30 sec - exiting 09:12:41 (12552): No heartbeat from core client for 30 sec - exiting 09:12:42 (12552): No heartbeat from core client for 30 sec - exiting 09:12:43 (12552): No heartbeat from core client for 30 sec - exiting 09:12:44 (12552): No heartbeat from core client for 30 sec - exiting 09:12:45 (12552): No heartbeat from core client for 30 sec - exiting 09:12:46 (12552): No heartbeat from core client for 30 sec - exiting 09:12:47 (12552): No heartbeat from core client for 30 sec - exiting 09:22:47 (13540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:51 (13540): No heartbeat from core client for 30 sec - exiting 09:22:52 (13540): No heartbeat from core client for 30 sec - exiting 09:22:53 (13540): No heartbeat from core client for 30 sec - exiting 09:22:54 (13540): No heartbeat from core client for 30 sec - exiting 09:22:55 (13540): No heartbeat from core client for 30 sec - exiting 09:22:56 (13540): No heartbeat from core client for 30 sec - exiting 09:22:57 (13540): No heartbeat from core client for 30 sec - exiting 09:22:58 (13540): No heartbeat from core client for 30 sec - exiting 09:22:59 (13540): No heartbeat from core client for 30 sec - exiting 09:23:00 (13540): No heartbeat from core client for 30 sec - exiting 09:23:01 (13540): No heartbeat from core client for 30 sec - exiting 09:23:02 (13540): No heartbeat from core client for 30 sec - exiting 09:23:03 (13540): No heartbeat from core client for 30 sec - exiting 09:23:04 (13540): No heartbeat from core client for 30 sec - exiting 09:23:05 (13540): No heartbeat from core client for 30 sec - exiting 09:23:06 (13540): No heartbeat from core client for 30 sec - exiting 09:23:07 (13540): No heartbeat from core client for 30 sec - exiting 09:23:08 (13540): No heartbeat from core client for 30 sec - exiting 09:23:09 (13540): No heartbeat from core client for 30 sec - exiting 09:25:44 (14112): No heartbeat from core client for 30 sec - exiting 09:25:45 (14112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:25:46 (14112): No heartbeat from core client for 30 sec - exiting 09:25:47 (14112): No heartbeat from core client for 30 sec - exiting 09:34:24 (13892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:25 (13892): No heartbeat from core client for 30 sec - exiting 09:34:26 (13892): No heartbeat from core client for 30 sec - exiting 09:34:27 (13892): No heartbeat from core client for 30 sec - exiting 09:34:28 (13892): No heartbeat from core client for 30 sec - exiting 09:44:42 (13880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:45 (13880): No heartbeat from core client for 30 sec - exiting 09:44:46 (13880): No heartbeat from core client for 30 sec - exiting 09:44:47 (13880): No heartbeat from core client for 30 sec - exiting 09:44:48 (13880): No heartbeat from core client for 30 sec - exiting 09:44:49 (13880): No heartbeat from core client for 30 sec - exiting 09:44:50 (13880): No heartbeat from core client for 30 sec - exiting 09:44:51 (13880): No heartbeat from core client for 30 sec - exiting 09:44:52 (13880): No heartbeat from core client for 30 sec - exiting 09:44:53 (13880): No heartbeat from core client for 30 sec - exiting 09:44:54 (13880): No heartbeat from core client for 30 sec - exiting 09:44:55 (13880): No heartbeat from core client for 30 sec - exiting 09:44:56 (13880): No heartbeat from core client for 30 sec - exiting 09:44:57 (13880): No heartbeat from core client for 30 sec - exiting 09:44:58 (13880): No heartbeat from core client for 30 sec - exiting 09:44:59 (13880): No heartbeat from core client for 30 sec - exiting 09:45:00 (13880): No heartbeat from core client for 30 sec - exiting 09:45:01 (13880): No heartbeat from core client for 30 sec - exiting 09:45:02 (13880): No heartbeat from core client for 30 sec - exiting 09:53:37 (13656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:39 (13656): No heartbeat from core client for 30 sec - exiting 09:53:40 (13656): No heartbeat from core client for 30 sec - exiting 09:53:41 (13656): No heartbeat from core client for 30 sec - exiting 09:53:42 (13656): No heartbeat from core client for 30 sec - exiting 09:53:44 (13656): No heartbeat from core client for 30 sec - exiting 09:53:45 (13656): No heartbeat from core client for 30 sec - exiting 09:53:46 (13656): No heartbeat from core client for 30 sec - exiting 09:53:47 (13656): No heartbeat from core client for 30 sec - exiting 09:53:48 (13656): No heartbeat from core client for 30 sec - exiting 09:53:49 (13656): No heartbeat from core client for 30 sec - exiting 09:53:50 (13656): No heartbeat from core client for 30 sec - exiting 09:53:51 (13656): No heartbeat from core client for 30 sec - exiting 09:53:52 (13656): No heartbeat from core client for 30 sec - exiting 09:53:53 (13656): No heartbeat from core client for 30 sec - exiting 09:53:54 (13656): No heartbeat from core client for 30 sec - exiting 09:53:55 (13656): No heartbeat from core client for 30 sec - exiting 09:53:56 (13656): No heartbeat from core client for 30 sec - exiting 09:53:57 (13656): No heartbeat from core client for 30 sec - exiting 09:53:58 (13656): No heartbeat from core client for 30 sec - exiting 09:53:59 (13656): No heartbeat from core client for 30 sec - exiting 09:54:00 (13656): No heartbeat from core client for 30 sec - exiting 09:54:01 (13656): No heartbeat from core client for 30 sec - exiting 09:54:02 (13656): No heartbeat from core client for 30 sec - exiting 10:04:28 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:04:35 (5012): No heartbeat from core client for 30 sec - exiting 10:04:36 (5012): No heartbeat from core client for 30 sec - exiting 10:04:37 (5012): No heartbeat from core client for 30 sec - exiting 10:04:38 (5012): No heartbeat from core client for 30 sec - exiting 10:04:39 (5012): No heartbeat from core client for 30 sec - exiting 10:04:40 (5012): No heartbeat from core client for 30 sec - exiting 10:04:42 (5012): No heartbeat from core client for 30 sec - exiting 10:04:43 (5012): No heartbeat from core client for 30 sec - exiting 10:04:44 (5012): No heartbeat from core client for 30 sec - exiting 10:04:45 (5012): No heartbeat from core client for 30 sec - exiting 10:04:46 (5012): No heartbeat from core client for 30 sec - exiting 10:04:47 (5012): No heartbeat from core client for 30 sec - exiting 10:04:48 (5012): No heartbeat from core client for 30 sec - exiting 10:04:49 (5012): No heartbeat from core client for 30 sec - exiting 10:04:50 (5012): No heartbeat from core client for 30 sec - exiting 10:04:51 (5012): No heartbeat from core client for 30 sec - exiting 10:04:52 (5012): No heartbeat from core client for 30 sec - exiting 10:04:53 (5012): No heartbeat from core client for 30 sec - exiting 10:04:54 (5012): No heartbeat from core client for 30 sec - exiting 10:04:55 (5012): No heartbeat from core client for 30 sec - exiting 10:04:56 (5012): No heartbeat from core client for 30 sec - exiting 10:04:57 (5012): No heartbeat from core client for 30 sec - exiting 10:04:58 (5012): No heartbeat from core client for 30 sec - exiting 10:04:59 (5012): No heartbeat from core client for 30 sec - exiting 10:05:00 (5012): No heartbeat from core client for 30 sec - exiting 10:05:01 (5012): No heartbeat from core client for 30 sec - exiting 10:05:02 (5012): No heartbeat from core client for 30 sec - exiting 10:05:03 (5012): No heartbeat from core client for 30 sec - exiting 10:05:04 (5012): No heartbeat from core client for 30 sec - exiting 10:05:05 (5012): No heartbeat from core client for 30 sec - exiting 10:05:06 (5012): No heartbeat from core client for 30 sec - exiting 10:05:07 (5012): No heartbeat from core client for 30 sec - exiting 10:05:08 (5012): No heartbeat from core client for 30 sec - exiting 10:05:09 (5012): No heartbeat from core client for 30 sec - exiting 10:05:10 (5012): No heartbeat from core client for 30 sec - exiting 10:05:11 (5012): No heartbeat from core client for 30 sec - exiting 10:05:12 (5012): No heartbeat from core client for 30 sec - exiting 10:05:13 (5012): No heartbeat from core client for 30 sec - exiting 10:05:14 (5012): No heartbeat from core client for 30 sec - exiting 10:05:15 (5012): No heartbeat from core client for 30 sec - exiting 10:05:16 (5012): No heartbeat from core client for 30 sec - exiting 10:05:17 (5012): No heartbeat from core client for 30 sec - exiting 10:05:18 (5012): No heartbeat from core client for 30 sec - exiting 10:05:19 (5012): No heartbeat from core client for 30 sec - exiting 10:05:20 (5012): No heartbeat from core client for 30 sec - exiting 10:05:21 (5012): No heartbeat from core client for 30 sec - exiting 10:05:22 (5012): No heartbeat from core client for 30 sec - exiting 10:05:23 (5012): No heartbeat from core client for 30 sec - exiting 10:05:24 (5012): No heartbeat from core client for 30 sec - exiting 10:05:25 (5012): No heartbeat from core client for 30 sec - exiting 10:05:26 (5012): No heartbeat from core client for 30 sec - exiting 10:05:27 (5012): No heartbeat from core client for 30 sec - exiting 10:05:28 (5012): No heartbeat from core client for 30 sec - exiting 10:05:29 (5012): No heartbeat from core client for 30 sec - exiting 10:05:30 (5012): No heartbeat from core client for 30 sec - exiting 10:05:31 (5012): No heartbeat from core client for 30 sec - exiting 10:05:32 (5012): No heartbeat from core client for 30 sec - exiting 10:33:57 (13804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:34:01 (13804): No heartbeat from core client for 30 sec - exiting 10:34:02 (13804): No heartbeat from core client for 30 sec - exiting 10:34:03 (13804): No heartbeat from core client for 30 sec - exiting 10:34:04 (13804): No heartbeat from core client for 30 sec - exiting 10:34:05 (13804): No heartbeat from core client for 30 sec - exiting 10:34:06 (13804): No heartbeat from core client for 30 sec - exiting 10:34:07 (13804): No heartbeat from core client for 30 sec - exiting 10:34:08 (13804): No heartbeat from core client for 30 sec - exiting 10:34:09 (13804): No heartbeat from core client for 30 sec - exiting 10:34:10 (13804): No heartbeat from core client for 30 sec - exiting 10:34:11 (13804): No heartbeat from core client for 30 sec - exiting 10:34:12 (13804): No heartbeat from core client for 30 sec - exiting 10:34:13 (13804): No heartbeat from core client for 30 sec - exiting 10:34:14 (13804): No heartbeat from core client for 30 sec - exiting 10:34:15 (13804): No heartbeat from core client for 30 sec - exiting 10:34:16 (13804): No heartbeat from core client for 30 sec - exiting 10:34:17 (13804): No heartbeat from core client for 30 sec - exiting 10:34:18 (13804): No heartbeat from core client for 30 sec - exiting 10:34:19 (13804): No heartbeat from core client for 30 sec - exiting 10:34:20 (13804): No heartbeat from core client for 30 sec - exiting 10:41:37 (13584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:49 (14092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:50 (14092): No heartbeat from core client for 30 sec - exiting 11:12:50 (13124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:51 (13124): No heartbeat from core client for 30 sec - exiting 11:12:52 (13124): No heartbeat from core client for 30 sec - exiting 11:20:19 (11912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:23 (11912): No heartbeat from core client for 30 sec - exiting 11:20:24 (11912): No heartbeat from core client for 30 sec - exiting 11:20:25 (11912): No heartbeat from core client for 30 sec - exiting 11:20:26 (11912): No heartbeat from core client for 30 sec - exiting 11:29:23 (11428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:26 (11428): No heartbeat from core client for 30 sec - exiting 11:29:27 (11428): No heartbeat from core client for 30 sec - exiting 11:33:50 (13400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:01 (12680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:02 (12680): No heartbeat from core client for 30 sec - exiting 11:40:03 (12680): No heartbeat from core client for 30 sec - exiting 11:40:04 (12680): No heartbeat from core client for 30 sec - exiting 11:40:05 (12680): No heartbeat from core client for 30 sec - exiting 11:40:06 (12680): No heartbeat from core client for 30 sec - exiting 11:40:07 (12680): No heartbeat from core client for 30 sec - exiting 11:40:08 (12680): No heartbeat from core client for 30 sec - exiting 11:50:44 (13648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:50:48 (13648): No heartbeat from core client for 30 sec - exiting 11:50:49 (13648): No heartbeat from core client for 30 sec - exiting 11:50:50 (13648): No heartbeat from core client for 30 sec - exiting 11:50:51 (13648): No heartbeat from core client for 30 sec - exiting 11:50:52 (13648): No heartbeat from core client for 30 sec - exiting 11:50:53 (13648): No heartbeat from core client for 30 sec - exiting 11:50:54 (13648): No heartbeat from core client for 30 sec - exiting 11:50:55 (13648): No heartbeat from core client for 30 sec - exiting 11:50:56 (13648): No heartbeat from core client for 30 sec - exiting 11:50:57 (13648): No heartbeat from core client for 30 sec - exiting 11:50:58 (13648): No heartbeat from core client for 30 sec - exiting 11:50:59 (13648): No heartbeat from core client for 30 sec - exiting 11:51:00 (13648): No heartbeat from core client for 30 sec - exiting 11:51:01 (13648): No heartbeat from core client for 30 sec - exiting 11:51:02 (13648): No heartbeat from core client for 30 sec - exiting 11:51:03 (13648): No heartbeat from core client for 30 sec - exiting 11:51:04 (13648): No heartbeat from core client for 30 sec - exiting 11:51:05 (13648): No heartbeat from core client for 30 sec - exiting 11:51:06 (13648): No heartbeat from core client for 30 sec - exiting 11:51:07 (13648): No heartbeat from core client for 30 sec - exiting 11:51:08 (13648): No heartbeat from core client for 30 sec - exiting 11:51:09 (13648): No heartbeat from core client for 30 sec - exiting 11:51:10 (13648): No heartbeat from core client for 30 sec - exiting 11:51:11 (13648): No heartbeat from core client for 30 sec - exiting 11:51:12 (13648): No heartbeat from core client for 30 sec - exiting 11:51:13 (13648): No heartbeat from core client for 30 sec - exiting 11:51:14 (13648): No heartbeat from core client for 30 sec - exiting 11:51:15 (13648): No heartbeat from core client for 30 sec - exiting 11:51:16 (13648): No heartbeat from core client for 30 sec - exiting 12:03:53 (10280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:54 (10280): No heartbeat from core client for 30 sec - exiting 12:12:08 (6504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:21:22 (13400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:14 (12704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:50 (11548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:34:02 (14960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:04 (14960): No heartbeat from core client for 30 sec - exiting 18:34:05 (14960): No heartbeat from core client for 30 sec - exiting 18:34:06 (14960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:14:00 (17144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:01 (17144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:26:48 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:49 (4820): No heartbeat from core client for 30 sec - exiting 03:26:50 (4820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77DD3AC3 read attempt to address 0x40C185D7 Engaging BOINC Windows Runtime Debugger... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77DD3AC3 read attempt to address 0x40C185D7 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_7aoq_1980_40_008425133/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Feb 2014 15:21:19	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	259,200	559,912	2.1602
21 Feb 2014 05:21:54	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	233,280	500,182	2.1441
14 Feb 2014 04:05:11	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	207,360	445,018	2.1461
12 Feb 2014 14:07:36	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	181,440	383,751	2.1150
11 Feb 2014 01:19:36	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	155,520	323,334	2.0791
08 Feb 2014 22:43:39	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	129,600	267,757	2.0660
08 Feb 2014 04:44:59	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	103,680	214,203	2.0660
07 Feb 2014 12:15:58	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	77,760	162,240	2.0864
06 Feb 2014 21:48:18	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	51,840	111,493	2.1507
06 Feb 2014 07:00:09	1243774	16280564	hadcm3n_7aoq_1980_40_008425133_2	25,920	59,169	2.2828