Task 13945304

Name	hadam3p_eu_86ox_2002_1_007690162_2
Workunit	7845270
Created	20 Jan 2012, 6:22:51 UTC
Sent	20 Jan 2012, 6:25:31 UTC
Report deadline	1 Jan 2013, 11:45:31 UTC
Received	1 Feb 2012, 5:57:53 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	1073807364 (0x40010004) Unknown error code
Computer ID	1156866
Run time	4 days 15 hours 46 min 27 sec
CPU time	4 days 15 hours 46 min 27 sec
Validate state	Invalid
Credit	1,194.02
Device peak FLOPS	1.13 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <message> - exit code 1073807364 (0x40010004) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:15:41 (5140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:43 (5140): No heartbeat from core client for 30 sec - exiting 12:15:44 (5140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:59:12 (16304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:59:14 (16304): No heartbeat from core client for 30 sec - exiting 15:15:48 (15340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:50 (15340): No heartbeat from core client for 30 sec - exiting 15:15:51 (15340): No heartbeat from core client for 30 sec - exiting 15:15:52 (15340): No heartbeat from core client for 30 sec - exiting 15:15:53 (15340): No heartbeat from core client for 30 sec - exiting 15:15:54 (15340): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 17:54:48 (14616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:54:50 (14616): No heartbeat from core client for 30 sec - exiting 17:54:51 (14616): No heartbeat from core client for 30 sec - exiting 17:54:52 (14616): No heartbeat from core client for 30 sec - exiting 17:54:53 (14616): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:06:16 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:06:18 (8056): No heartbeat from core client for 30 sec - exiting 20:06:19 (8056): No heartbeat from core client for 30 sec - exiting 20:08:20 (12940): No heartbeat from core client for 30 sec - exiting 20:08:21 (12940): No heartbeat from core client for 30 sec - exiting 20:08:22 (12940): No heartbeat from core client for 30 sec - exiting 20:08:23 (12940): No heartbeat from core client for 30 sec - exiting 20:08:24 (12940): No heartbeat from core client for 30 sec - exiting 20:08:25 (12940): No heartbeat from core client for 30 sec - exiting 20:08:26 (12940): No heartbeat from core client for 30 sec - exiting 20:08:27 (12940): No heartbeat from core client for 30 sec - exiting 20:08:28 (12940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:43 (2528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:24:44 (2528): No heartbeat from core client for 30 sec - exiting 20:41:19 (9384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:41:21 (9384): No heartbeat from core client for 30 sec - exiting 20:41:22 (9384): No heartbeat from core client for 30 sec - exiting 20:41:23 (9384): No heartbeat from core client for 30 sec - exiting 20:41:24 (9384): No heartbeat from core client for 30 sec - exiting 20:43:26 (12096): No heartbeat from core client for 30 sec - exiting 20:43:27 (12096): No heartbeat from core client for 30 sec - exiting 20:43:28 (12096): No heartbeat from core client for 30 sec - exiting 20:43:29 (12096): No heartbeat from core client for 30 sec - exiting 20:43:30 (12096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:20 (6196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:22 (6196): No heartbeat from core client for 30 sec - exiting 20:59:23 (6196): No heartbeat from core client for 30 sec - exiting 20:59:24 (6196): No heartbeat from core client for 30 sec - exiting 21:00:33 (10332): No heartbeat from core client for 30 sec - exiting 21:00:34 (10332): No heartbeat from core client for 30 sec - exiting 21:00:35 (10332): No heartbeat from core client for 30 sec - exiting 21:00:36 (10332): No heartbeat from core client for 30 sec - exiting 21:00:37 (10332): No heartbeat from core client for 30 sec - exiting 21:00:38 (10332): No heartbeat from core client for 30 sec - exiting 21:00:39 (10332): No heartbeat from core client for 30 sec - exiting 21:00:40 (10332): No heartbeat from core client for 30 sec - exiting 21:00:41 (10332): No heartbeat from core client for 30 sec - exiting 21:00:42 (10332): No heartbeat from core client for 30 sec - exiting 21:00:43 (10332): No heartbeat from core client for 30 sec - exiting 21:00:44 (10332): No heartbeat from core client for 30 sec - exiting 21:00:45 (10332): No heartbeat from core client for 30 sec - exiting 21:00:46 (10332): No heartbeat from core client for 30 sec - exiting 21:00:47 (10332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:34:15 (11668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:17 (11668): No heartbeat from core client for 30 sec - exiting 22:34:18 (11668): No heartbeat from core client for 30 sec - exiting 22:34:19 (11668): No heartbeat from core client for 30 sec - exiting 22:34:20 (11668): No heartbeat from core client for 30 sec - exiting 22:34:21 (11668): No heartbeat from core client for 30 sec - exiting 22:35:18 (15964): No heartbeat from core client for 30 sec - exiting 22:35:19 (15964): No heartbeat from core client for 30 sec - exiting 22:35:20 (15964): No heartbeat from core client for 30 sec - exiting 22:35:21 (15964): No heartbeat from core client for 30 sec - exiting 22:35:22 (15964): No heartbeat from core client for 30 sec - exiting 22:35:23 (15964): No heartbeat from core client for 30 sec - exiting 22:35:24 (15964): No heartbeat from core client for 30 sec - exiting 22:35:25 (15964): No heartbeat from core client for 30 sec - exiting 22:35:26 (15964): No heartbeat from core client for 30 sec - exiting 22:35:27 (15964): No heartbeat from core client for 30 sec - exiting 22:35:28 (15964): No heartbeat from core client for 30 sec - exiting 22:35:29 (15964): No heartbeat from core client for 30 sec - exiting 22:35:30 (15964): No heartbeat from core client for 30 sec - exiting 22:35:31 (15964): No heartbeat from core client for 30 sec - exiting 22:35:32 (15964): No heartbeat from core client for 30 sec - exiting 22:35:33 (15964): No heartbeat from core client for 30 sec - exiting 22:35:34 (15964): No heartbeat from core client for 30 sec - exiting 22:35:35 (15964): No heartbeat from core client for 30 sec - exiting 22:35:36 (15964): No heartbeat from core client for 30 sec - exiting 22:35:37 (15964): No heartbeat from core client for 30 sec - exiting 22:35:38 (15964): No heartbeat from core client for 30 sec - exiting 22:35:39 (15964): No heartbeat from core client for 30 sec - exiting 22:35:40 (15964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:29 (3796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:31 (3796): No heartbeat from core client for 30 sec - exiting 22:51:32 (3796): No heartbeat from core client for 30 sec - exiting 22:51:33 (3796): No heartbeat from core client for 30 sec - exiting 22:51:34 (3796): No heartbeat from core client for 30 sec - exiting 22:51:35 (3796): No heartbeat from core client for 30 sec - exiting 22:52:55 (11316): No heartbeat from core client for 30 sec - exiting 22:52:56 (11316): No heartbeat from core client for 30 sec - exiting 22:52:57 (11316): No heartbeat from core client for 30 sec - exiting 22:52:58 (11316): No heartbeat from core client for 30 sec - exiting 22:52:59 (11316): No heartbeat from core client for 30 sec - exiting 22:53:00 (11316): No heartbeat from core client for 30 sec - exiting 22:53:01 (11316): No heartbeat from core client for 30 sec - exiting 22:53:02 (11316): No heartbeat from core client for 30 sec - exiting 22:53:03 (11316): No heartbeat from core client for 30 sec - exiting 22:53:04 (11316): No heartbeat from core client for 30 sec - exiting 22:53:05 (11316): No heartbeat from core client for 30 sec - exiting 22:53:06 (11316): No heartbeat from core client for 30 sec - exiting 22:53:07 (11316): No heartbeat from core client for 30 sec - exiting 22:53:08 (11316): No heartbeat from core client for 30 sec - exiting 22:53:09 (11316): No heartbeat from core client for 30 sec - exiting 22:53:10 (11316): No heartbeat from core client for 30 sec - exiting 22:53:11 (11316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:55:06 (11600): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 17:55:07 (11600): No heartbeat from core client for 30 sec - exiting 17:55:08 (11600): No heartbeat from core client for 30 sec - exiting 17:55:09 (11600): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4664, iMonCtr=2 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Jan 2012 22:16:09	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	69,216	352,512	5.0929
27 Jan 2012 09:24:27	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	57,696	294,168	5.0986
25 Jan 2012 08:15:24	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	46,176	235,297	5.0957
23 Jan 2012 23:59:56	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	34,656	175,839	5.0738
22 Jan 2012 14:47:23	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	23,136	116,875	5.0517
21 Jan 2012 09:05:48	1156866	13945304	hadam3p_eu_86ox_2002_1_007690162_2	11,616	58,752	5.0579