Task 14625618

Name	hadam3p_pnw_043w_2003_1_006776100_2
Workunit	6979416
Created	3 May 2012, 20:43:47 UTC
Sent	3 May 2012, 20:55:07 UTC
Report deadline	16 Apr 2013, 2:15:07 UTC
Received	15 May 2012, 7:59:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1186467
Run time	4 days 0 hours 58 min 10 sec
CPU time	2 days 19 hours 24 min 49 sec
Validate state	Invalid
Credit	1,754.30
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.23</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3852, selfPID=3852, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16528, selfPID=17264, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 15:48:47 (7792): No heartbeat from core client for 30 sec - exiting 15:48:49 (7792): No heartbeat from core client for 30 sec - exiting 15:48:50 (7792): No heartbeat from core client for 30 sec - exiting 15:48:51 (7792): No heartbeat from core client for 30 sec - exiting 15:48:52 (7792): No heartbeat from core client for 30 sec - exiting 15:48:53 (7792): No heartbeat from core client for 30 sec - exiting 15:48:54 (7792): No heartbeat from core client for 30 sec - exiting 15:48:55 (7792): No heartbeat from core client for 30 sec - exiting 15:48:56 (7792): No heartbeat from core client for 30 sec - exiting 15:48:57 (7792): No heartbeat from core client for 30 sec - exiting 15:48:58 (7792): No heartbeat from core client for 30 sec - exiting 15:48:59 (7792): No heartbeat from core client for 30 sec - exiting 15:49:00 (7792): No heartbeat from core client for 30 sec - exiting 15:49:01 (7792): No heartbeat from core client for 30 sec - exiting 15:49:02 (7792): No heartbeat from core client for 30 sec - exiting 15:49:03 (7792): No heartbeat from core client for 30 sec - exiting 15:49:04 (7792): No heartbeat from core client for 30 sec - exiting 15:49:05 (7792): No heartbeat from core client for 30 sec - exiting 15:49:06 (7792): No heartbeat from core client for 30 sec - exiting 15:49:07 (7792): No heartbeat from core client for 30 sec - exiting 15:49:08 (7792): No heartbeat from core client for 30 sec - exiting 15:49:09 (7792): No heartbeat from core client for 30 sec - exiting 15:49:10 (7792): No heartbeat from core client for 30 sec - exiting 15:49:11 (7792): No heartbeat from core client for 30 sec - exiting 15:49:12 (7792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:36:31 (5548): No heartbeat from core client for 30 sec - exiting 19:36:32 (5548): No heartbeat from core client for 30 sec - exiting 19:36:33 (5548): No heartbeat from core client for 30 sec - exiting 19:36:34 (5548): No heartbeat from core client for 30 sec - exiting 19:36:35 (5548): No heartbeat from core client for 30 sec - exiting 19:36:37 (5548): No heartbeat from core client for 30 sec - exiting 19:36:38 (5548): No heartbeat from core client for 30 sec - exiting 19:36:39 (5548): No heartbeat from core client for 30 sec - exiting 19:36:40 (5548): No heartbeat from core client for 30 sec - exiting 19:36:41 (5548): No heartbeat from core client for 30 sec - exiting 19:36:42 (5548): No heartbeat from core client for 30 sec - exiting 19:36:43 (5548): No heartbeat from core client for 30 sec - exiting 19:36:44 (5548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:36:09 (8220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:02 (2492): No heartbeat from core client for 30 sec - exiting 04:44:03 (2492): No heartbeat from core client for 30 sec - exiting 04:44:04 (2492): No heartbeat from core client for 30 sec - exiting 04:44:05 (2492): No heartbeat from core client for 30 sec - exiting 04:44:06 (2492): No heartbeat from core client for 30 sec - exiting 04:44:07 (2492): No heartbeat from core client for 30 sec - exiting 04:44:08 (2492): No heartbeat from core client for 30 sec - exiting 04:44:10 (2492): No heartbeat from core client for 30 sec - exiting 04:44:11 (2492): No heartbeat from core client for 30 sec - exiting 04:44:12 (2492): No heartbeat from core client for 30 sec - exiting 04:44:13 (2492): No heartbeat from core client for 30 sec - exiting 04:44:14 (2492): No heartbeat from core client for 30 sec - exiting 04:44:15 (2492): No heartbeat from core client for 30 sec - exiting 04:44:16 (2492): No heartbeat from core client for 30 sec - exiting 04:44:17 (2492): No heartbeat from core client for 30 sec - exiting 04:44:18 (2492): No heartbeat from core client for 30 sec - exiting 04:44:19 (2492): No heartbeat from core client for 30 sec - exiting 04:44:20 (2492): No heartbeat from core client for 30 sec - exiting 04:44:22 (2492): No heartbeat from core client for 30 sec - exiting 04:44:23 (2492): No heartbeat from core client for 30 sec - exiting 04:44:24 (2492): No heartbeat from core client for 30 sec - exiting 04:44:25 (2492): No heartbeat from core client for 30 sec - exiting 04:44:26 (2492): No heartbeat from core client for 30 sec - exiting 04:44:27 (2492): No heartbeat from core client for 30 sec - exiting 04:44:28 (2492): No heartbeat from core client for 30 sec - exiting 04:44:29 (2492): No heartbeat from core client for 30 sec - exiting 04:44:30 (2492): No heartbeat from core client for 30 sec - exiting 04:44:31 (2492): No heartbeat from core client for 30 sec - exiting 04:44:33 (2492): No heartbeat from core client for 30 sec - exiting 04:44:34 (2492): No heartbeat from core client for 30 sec - exiting 04:44:35 (2492): No heartbeat from core client for 30 sec - exiting 04:44:36 (2492): No heartbeat from core client for 30 sec - exiting 04:44:37 (2492): No heartbeat from core client for 30 sec - exiting 04:44:38 (2492): No heartbeat from core client for 30 sec - exiting 04:44:39 (2492): No heartbeat from core client for 30 sec - exiting 04:44:40 (2492): No heartbeat from core client for 30 sec - exiting 04:44:41 (2492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:42 (2492): No heartbeat from core client for 30 sec - exiting 07:28:01 (7464): No heartbeat from core client for 30 sec - exiting 07:28:02 (7464): No heartbeat from core client for 30 sec - exiting 07:28:03 (7464): No heartbeat from core client for 30 sec - exiting 07:28:04 (7464): No heartbeat from core client for 30 sec - exiting 07:28:05 (7464): No heartbeat from core client for 30 sec - exiting 07:28:06 (7464): No heartbeat from core client for 30 sec - exiting 07:28:07 (7464): No heartbeat from core client for 30 sec - exiting 07:28:08 (7464): No heartbeat from core client for 30 sec - exiting 07:28:09 (7464): No heartbeat from core client for 30 sec - exiting 07:28:10 (7464): No heartbeat from core client for 30 sec - exiting 07:28:12 (7464): No heartbeat from core client for 30 sec - exiting 07:28:13 (7464): No heartbeat from core client for 30 sec - exiting 07:28:14 (7464): No heartbeat from core client for 30 sec - exiting 07:28:15 (7464): No heartbeat from core client for 30 sec - exiting 07:28:16 (7464): No heartbeat from core client for 30 sec - exiting 07:28:17 (7464): No heartbeat from core client for 30 sec - exiting 07:28:18 (7464): No heartbeat from core client for 30 sec - exiting 07:28:19 (7464): No heartbeat from core client for 30 sec - exiting 07:28:20 (7464): No heartbeat from core client for 30 sec - exiting 07:28:21 (7464): No heartbeat from core client for 30 sec - exiting 07:28:22 (7464): No heartbeat from core client for 30 sec - exiting 07:28:24 (7464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4744, selfPID=1676, iMonCtr=1 Model crash detected, will try to restart... 17:47:52 (6712): No heartbeat from core client for 30 sec - exiting 17:47:53 (6712): No heartbeat from core client for 30 sec - exiting 17:47:54 (6712): No heartbeat from core client for 30 sec - exiting 17:47:55 (6712): No heartbeat from core client for 30 sec - exiting 17:47:56 (6712): No heartbeat from core client for 30 sec - exiting 17:47:57 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:58 (6712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:34:53 (6868): No heartbeat from core client for 30 sec - exiting 06:34:54 (6868): No heartbeat from core client for 30 sec - exiting 06:34:55 (6868): No heartbeat from core client for 30 sec - exiting 06:34:56 (6868): No heartbeat from core client for 30 sec - exiting 06:34:57 (6868): No heartbeat from core client for 30 sec - exiting 06:34:58 (6868): No heartbeat from core client for 30 sec - exiting 06:34:59 (6868): No heartbeat from core client for 30 sec - exiting 06:35:00 (6868): No heartbeat from core client for 30 sec - exiting 06:35:01 (6868): No heartbeat from core client for 30 sec - exiting 06:35:02 (6868): No heartbeat from core client for 30 sec - exiting 06:35:03 (6868): No heartbeat from core client for 30 sec - exiting 06:35:04 (6868): No heartbeat from core client for 30 sec - exiting 06:35:05 (6868): No heartbeat from core client for 30 sec - exiting 06:35:06 (6868): No heartbeat from core client for 30 sec - exiting 06:35:07 (6868): No heartbeat from core client for 30 sec - exiting 06:35:08 (6868): No heartbeat from core client for 30 sec - exiting 06:35:09 (6868): No heartbeat from core client for 30 sec - exiting 06:35:10 (6868): No heartbeat from core client for 30 sec - exiting 06:35:11 (6868): No heartbeat from core client for 30 sec - exiting 06:35:12 (6868): No heartbeat from core client for 30 sec - exiting 06:35:13 (6868): No heartbeat from core client for 30 sec - exiting 06:35:14 (6868): No heartbeat from core client for 30 sec - exiting 06:35:15 (6868): No heartbeat from core client for 30 sec - exiting 06:35:16 (6868): No heartbeat from core client for 30 sec - exiting 06:35:17 (6868): No heartbeat from core client for 30 sec - exiting 06:35:18 (6868): No heartbeat from core client for 30 sec - exiting 06:35:19 (6868): No heartbeat from core client for 30 sec - exiting 06:35:20 (6868): No heartbeat from core client for 30 sec - exiting 06:35:21 (6868): No heartbeat from core client for 30 sec - exiting 06:35:22 (6868): No heartbeat from core client for 30 sec - exiting 06:35:23 (6868): No heartbeat from core client for 30 sec - exiting 06:35:24 (6868): No heartbeat from core client for 30 sec - exiting 06:35:25 (6868): No heartbeat from core client for 30 sec - exiting 06:35:26 (6868): No heartbeat from core client for 30 sec - exiting 06:35:27 (6868): No heartbeat from core client for 30 sec - exiting 06:35:28 (6868): No heartbeat from core client for 30 sec - exiting 06:35:29 (6868): No heartbeat from core client for 30 sec - exiting 06:35:30 (6868): No heartbeat from core client for 30 sec - exiting 06:35:31 (6868): No heartbeat from core client for 30 sec - exiting 06:35:32 (6868): No heartbeat from core client for 30 sec - exiting 06:35:33 (6868): No heartbeat from core client for 30 sec - exiting 06:35:34 (6868): No heartbeat from core client for 30 sec - exiting 06:35:35 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:51 (6640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:40:48 (8068): No heartbeat from core client for 30 sec - exiting 01:40:49 (8068): No heartbeat from core client for 30 sec - exiting 01:40:50 (8068): No heartbeat from core client for 30 sec - exiting 01:40:51 (8068): No heartbeat from core client for 30 sec - exiting 01:40:52 (8068): No heartbeat from core client for 30 sec - exiting 01:40:53 (8068): No heartbeat from core client for 30 sec - exiting 01:40:54 (8068): No heartbeat from core client for 30 sec - exiting 01:40:55 (8068): No heartbeat from core client for 30 sec - exiting 01:40:56 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:11:54 (10880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7332, iMonCtr=2 04:13:08 (5360): No heartbeat from core client for 30 sec - exiting 04:13:09 (5360): No heartbeat from core client for 30 sec - exiting 04:13:10 (5360): No heartbeat from core client for 30 sec - exiting 04:13:11 (5360): No heartbeat from core client for 30 sec - exiting 04:13:12 (5360): No heartbeat from core client for 30 sec - exiting 04:13:13 (5360): No heartbeat from core client for 30 sec - exiting 04:13:14 (5360): No heartbeat from core client for 30 sec - exiting 04:13:15 (5360): No heartbeat from core client for 30 sec - exiting 04:13:16 (5360): No heartbeat from core client for 30 sec - exiting 04:13:17 (5360): No heartbeat from core client for 30 sec - exiting 04:13:19 (5360): No heartbeat from core client for 30 sec - exiting 04:13:20 (5360): No heartbeat from core client for 30 sec - exiting 04:13:21 (5360): No heartbeat from core client for 30 sec - exiting 04:13:22 (5360): No heartbeat from core client for 30 sec - exiting 04:13:23 (5360): No heartbeat from core client for 30 sec - exiting 04:13:24 (5360): No heartbeat from core client for 30 sec - exiting 04:13:25 (5360): No heartbeat from core client for 30 sec - exiting 04:13:26 (5360): No heartbeat from core client for 30 sec - exiting 04:13:27 (5360): No heartbeat from core client for 30 sec - exiting 04:13:28 (5360): No heartbeat from core client for 30 sec - exiting 04:13:29 (5360): No heartbeat from core client for 30 sec - exiting 04:13:31 (5360): No heartbeat from core client for 30 sec - exiting 04:13:32 (5360): No heartbeat from core client for 30 sec - exiting 04:13:33 (5360): No heartbeat from core client for 30 sec - exiting 04:13:34 (5360): No heartbeat from core client for 30 sec - exiting 04:13:35 (5360): No heartbeat from core client for 30 sec - exiting 04:13:36 (5360): No heartbeat from core client for 30 sec - exiting 04:13:37 (5360): No heartbeat from core client for 30 sec - exiting 04:13:38 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6396, selfPID=6396, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4616, selfPID=8440, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 19:27:05 (7352): No heartbeat from core client for 30 sec - exiting 19:27:06 (7352): No heartbeat from core client for 30 sec - exiting 19:27:07 (7352): No heartbeat from core client for 30 sec - exiting 19:27:08 (7352): No heartbeat from core client for 30 sec - exiting 19:27:09 (7352): No heartbeat from core client for 30 sec - exiting 19:27:10 (7352): No heartbeat from core client for 30 sec - exiting 19:27:12 (7352): No heartbeat from core client for 30 sec - exiting 19:27:13 (7352): No heartbeat from core client for 30 sec - exiting 19:27:14 (7352): No heartbeat from core client for 30 sec - exiting 19:27:15 (7352): No heartbeat from core client for 30 sec - exiting 19:27:16 (7352): No heartbeat from core client for 30 sec - exiting 19:27:17 (7352): No heartbeat from core client for 30 sec - exiting 19:27:18 (7352): No heartbeat from core client for 30 sec - exiting 19:27:19 (7352): No heartbeat from core client for 30 sec - exiting 19:27:20 (7352): No heartbeat from core client for 30 sec - exiting 19:27:21 (7352): No heartbeat from core client for 30 sec - exiting 19:27:22 (7352): No heartbeat from core client for 30 sec - exiting 19:27:23 (7352): No heartbeat from core client for 30 sec - exiting 19:27:24 (7352): No heartbeat from core client for 30 sec - exiting 19:27:25 (7352): No heartbeat from core client for 30 sec - exiting 19:27:26 (7352): No heartbeat from core client for 30 sec - exiting 19:27:27 (7352): No heartbeat from core client for 30 sec - exiting 19:27:28 (7352): No heartbeat from core client for 30 sec - exiting 19:27:29 (7352): No heartbeat from core client for 30 sec - exiting 19:27:30 (7352): No heartbeat from core client for 30 sec - exiting 19:27:31 (7352): No heartbeat from core client for 30 sec - exiting 19:27:32 (7352): No heartbeat from core client for 30 sec - exiting 19:27:33 (7352): No heartbeat from core client for 30 sec - exiting 19:27:34 (7352): No heartbeat from core client for 30 sec - exiting 19:27:35 (7352): No heartbeat from core client for 30 sec - exiting 19:27:36 (7352): No heartbeat from core client for 30 sec - exiting 19:27:37 (7352): No heartbeat from core client for 30 sec - exiting 19:27:38 (7352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6136, selfPID=6136, iMonCtr=2 07:46:39 (6080): No heartbeat from core client for 30 sec - exiting 07:46:40 (6080): No heartbeat from core client for 30 sec - exiting 07:46:41 (6080): No heartbeat from core client for 30 sec - exiting 07:46:42 (6080): No heartbeat from core client for 30 sec - exiting 07:46:43 (6080): No heartbeat from core client for 30 sec - exiting 07:46:44 (6080): No heartbeat from core client for 30 sec - exiting 07:46:45 (6080): No heartbeat from core client for 30 sec - exiting 07:46:46 (6080): No heartbeat from core client for 30 sec - exiting 07:46:47 (6080): No heartbeat from core client for 30 sec - exiting 07:46:48 (6080): No heartbeat from core client for 30 sec - exiting 07:46:49 (6080): No heartbeat from core client for 30 sec - exiting 07:46:50 (6080): No heartbeat from core client for 30 sec - exiting 07:46:51 (6080): No heartbeat from core client for 30 sec - exiting 07:46:52 (6080): No heartbeat from core client for 30 sec - exiting 07:46:53 (6080): No heartbeat from core client for 30 sec - exiting 07:46:54 (6080): No heartbeat from core client for 30 sec - exiting 07:46:55 (6080): No heartbeat from core client for 30 sec - exiting 07:46:56 (6080): No heartbeat from core client for 30 sec - exiting 07:46:57 (6080): No heartbeat from core client for 30 sec - exiting 07:46:58 (6080): No heartbeat from core client for 30 sec - exiting 07:46:59 (6080): No heartbeat from core client for 30 sec - exiting 07:47:00 (6080): No heartbeat from core client for 30 sec - exiting 07:47:01 (6080): No heartbeat from core client for 30 sec - exiting 07:47:02 (6080): No heartbeat from core client for 30 sec - exiting 07:47:03 (6080): No heartbeat from core client for 30 sec - exiting 07:47:04 (6080): No heartbeat from core client for 30 sec - exiting 07:47:05 (6080): No heartbeat from core client for 30 sec - exiting 07:47:06 (6080): No heartbeat from core client for 30 sec - exiting 07:47:07 (6080): No heartbeat from core client for 30 sec - exiting 07:47:08 (6080): No heartbeat from core client for 30 sec - exiting 07:47:09 (6080): No heartbeat from core client for 30 sec - exiting 07:47:10 (6080): No heartbeat from core client for 30 sec - exiting 07:47:11 (6080): No heartbeat from core client for 30 sec - exiting 07:47:12 (6080): No heartbeat from core client for 30 sec - exiting 07:47:13 (6080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2012 16:17:17	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	80,736	212,588	2.6331
12 May 2012 01:17:04	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	69,216	181,474	2.6219
10 May 2012 23:19:33	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	57,696	151,061	2.6182
09 May 2012 19:21:29	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	46,176	121,199	2.6247
08 May 2012 07:47:11	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	34,656	90,348	2.6070
07 May 2012 11:35:57	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	23,136	60,437	2.6122
05 May 2012 21:38:56	1186467	14625618	hadam3p_pnw_043w_2003_1_006776100_2	11,616	30,623	2.6363