Task 15829025

Name	hadam3p_pnw_q88f_2040_1_008390669_0
Workunit	8541528
Created	4 Jun 2013, 14:18:51 UTC
Sent	4 Jun 2013, 14:58:30 UTC
Report deadline	17 May 2014, 20:18:30 UTC
Received	21 Jul 2013, 3:43:55 UTC
Server state	Over
Outcome	Computation error
Client state	Done
Exit status	1073807364 (0x40010004) Unknown error code
Computer ID	1271684
Run time	6 days 18 hours 23 min 27 sec
CPU time	6 days 18 hours 23 min 27 sec
Validate state	Invalid
Credit	2,505.24
Device peak FLOPS	1.55 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>5.10.30</core_client_version> <![CDATA[ <message> - exit code 1073807364 (0x40010004) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:29:54 (1736): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 09:29:56 (1736): No heartbeat from core client for 30 sec - exiting 09:29:57 (1736): No heartbeat from core client for 30 sec - exiting 09:29:58 (1736): No heartbeat from core client for 30 sec - exiting 09:29:59 (1736): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:21:54 (3328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:56 (3328): No heartbeat from core client for 30 sec - exiting 07:21:57 (3328): No heartbeat from core client for 30 sec - exiting 07:21:58 (3328): No heartbeat from core client for 30 sec - exiting 07:21:59 (3328): No heartbeat from core client for 30 sec - exiting 07:22:00 (3328): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:13:02 (2592): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:24:20 (1888): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:24:22 (1888): No heartbeat from core client for 30 sec - exiting 14:24:23 (1888): No heartbeat from core client for 30 sec - exiting 14:24:25 (1888): No heartbeat from core client for 30 sec - exiting 14:24:26 (1888): No heartbeat from core client for 30 sec - exiting 14:24:27 (1888): No heartbeat from core client for 30 sec - exiting 14:24:28 (1888): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:46:54 (3624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:46:57 (3624): No heartbeat from core client for 30 sec - exiting 14:46:58 (3624): No heartbeat from core client for 30 sec - exiting 14:46:59 (3624): No heartbeat from core client for 30 sec - exiting 14:47:01 (3624): No heartbeat from core client for 30 sec - exiting 14:47:02 (3624): No heartbeat from core client for 30 sec - exiting 14:47:03 (3624): No heartbeat from core client for 30 sec - exiting 14:47:04 (3624): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:06:41 (3996): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:06:43 (3996): No heartbeat from core client for 30 sec - exiting 21:06:44 (3996): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CreateProcess failed: 'The system cannot find the path specified. (0x3)' Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:02:20 (3400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:09:46 (476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:09:47 (476): No heartbeat from core client for 30 sec - exiting 08:09:48 (476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 03:13:38 (2520): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:05:19 (2392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 18:05:20 (2392): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:31:09 (2288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 01:31:10 (2288): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 11:40:41 (2220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:40:42 (2220): No heartbeat from core client for 30 sec - exiting 11:40:44 (2220): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:22:31 (1656): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 19:22:32 (1656): No heartbeat from core client for 30 sec - exiting 19:22:34 (1656): No heartbeat from core client for 30 sec - exiting 19:22:35 (1656): No heartbeat from core client for 30 sec - exiting 19:22:36 (1656): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:29:58 (3396): No heartbeat from core client for 30 sec - exiting 15:29:59 (3396): No heartbeat from core client for 30 sec - exiting 15:30:01 (3396): No heartbeat from core client for 30 sec - exiting 15:30:02 (3396): No heartbeat from core client for 30 sec - exiting 15:30:03 (3396): No heartbeat from core client for 30 sec - exiting 15:30:04 (3396): No heartbeat from core client for 30 sec - exiting 15:30:05 (3396): No heartbeat from core client for 30 sec - exiting 15:30:06 (3396): No heartbeat from core client for 30 sec - exiting 15:30:07 (3396): No heartbeat from core client for 30 sec - exiting 15:30:08 (3396): No heartbeat from core client for 30 sec - exiting 15:30:09 (3396): No heartbeat from core client for 30 sec - exiting 15:30:10 (3396): No heartbeat from core client for 30 sec - exiting 15:30:11 (3396): No heartbeat from core client for 30 sec - exiting 15:30:13 (3396): No heartbeat from core client for 30 sec - exiting 15:30:14 (3396): No heartbeat from core client for 30 sec - exiting 15:30:15 (3396): No heartbeat from core client for 30 sec - exiting 15:30:16 (3396): No heartbeat from core client for 30 sec - exiting 15:30:17 (3396): No heartbeat from core client for 30 sec - exiting 15:30:18 (3396): No heartbeat from core client for 30 sec - exiting 15:30:19 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:42:41 (2856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 06:42:43 (2856): No heartbeat from core client for 30 sec - exiting 06:42:44 (2856): No heartbeat from core client for 30 sec - exiting 06:42:45 (2856): No heartbeat from core client for 30 sec - exiting 06:42:46 (2856): No heartbeat from core client for 30 sec - exiting 06:42:47 (2856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:06:41 (3688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 20:06:44 (3688): No heartbeat from core client for 30 sec - exiting 20:06:45 (3688): No heartbeat from core client for 30 sec - exiting 20:06:46 (3688): No heartbeat from core client for 30 sec - exiting 20:06:47 (3688): No heartbeat from core client for 30 sec - exiting 20:06:48 (3688): No heartbeat from core client for 30 sec - exiting 20:06:49 (3688): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:47:14 (4008): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:47:15 (4008): No heartbeat from core client for 30 sec - exiting 08:47:16 (4008): No heartbeat from core client for 30 sec - exiting 17:37:55 (3880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:13:40 (3948): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 08:13:41 (3948): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 01:44:50 (2960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 14:10:45 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regi14:11:47 (492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:00 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3452, selfPID=3452, iMonCtr=2 14:14:02 (1020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:15:15 (868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:18 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:17:31 (1796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:31 (2128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3308, selfPID=3308, iMonCtr=2 14:19:44 (4056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:20:35 (3920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:24 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:49 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:23:49 (3620): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:14 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1136, selfPID=1136, iMonCtr=2 14:26:17 (3040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3420, selfPID=3420, iMonCtr=2 14:27:42 (292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:42 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:30:08 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:31:10 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:35 (1892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=2 14:33:36 (1936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:01 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:52 (3612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:28 (960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:37:53 (2768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:38:53 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:18 (2616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:21 (3532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:42:46 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:47 (2224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=4076, iMonCtr=2 14:45:12 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:14 (1900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:47:39 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:48:40 (860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:05 (3468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:50:55 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3384, selfPID=3384, iMonCtr=2 14:51:32 (2808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:57 (2980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:57 (460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:55:22 (2712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:25 (2168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:32:10 (2060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 16:32:12 (2060): No heartbeat from core client for 30 sec - exiting 16:32:13 (2060): No heartbeat from core client for 30 sec - exiting 16:32:14 (2060): No heartbeat from core client for 30 sec - exiting 16:32:16 (2060): No heartbeat from core client for 30 sec - exiting 16:32:17 (2060): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:10:40 (800): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1420, iMonCtr=2 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 18:57:37	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	115,296	538,177	4.6678
23 Jul 2013 18:57:37	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	103,776	485,180	4.6753
09 Jul 2013 16:33:15	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	92,256	431,660	4.6789
07 Jul 2013 05:15:25	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	80,736	380,258	4.7099
04 Jul 2013 19:23:09	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	69,216	328,800	4.7503
02 Jul 2013 11:58:18	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	57,696	274,894	4.7645
28 Jun 2013 08:18:11	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	46,176	220,359	4.7722
25 Jun 2013 02:23:23	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	34,656	165,553	4.7770
21 Jun 2013 05:21:56	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	23,136	113,262	4.8955
17 Jun 2013 03:03:37	1271684	15829025	hadam3p_pnw_q88f_2040_1_008390669_0	11,616	57,159	4.9207