Task 16395697

Name	hadam3p_anz_n5dz_2012_1_008580671_0
Workunit	8727183
Created	25 Mar 2014, 19:02:23 UTC
Sent	26 Mar 2014, 14:17:54 UTC
Report deadline	8 Mar 2015, 19:37:54 UTC
Received	16 Jun 2014, 10:32:15 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1225270
Run time	16 days 10 hours 36 min 20 sec
CPU time	9 days 12 hours 57 min 48 sec
Validate state	Invalid
Credit	4,484.28
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Australia New Zealand v6.10 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3420, selfPID=3496, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5132, selfPID=5368, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2656, selfPID=2656, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:47:10 (6288): No heartbeat from core client for 30 sec - exiting 14:47:11 (6288): No heartbeat from core client for 30 sec - exiting 14:47:12 (6288): No heartbeat from core client for 30 sec - exiting 14:47:13 (6288): No heartbeat from core client for 30 sec - exiting 14:47:15 (6288): No heartbeat from core client for 30 sec - exiting 14:47:16 (6288): No heartbeat from core client for 30 sec - exiting 14:47:17 (6288): No heartbeat from core client for 30 sec - exiting 14:47:18 (6288): No heartbeat from core client for 30 sec - exiting 14:47:19 (6288): No heartbeat from core client for 30 sec - exiting 14:47:20 (6288): No heartbeat from core client for 30 sec - exiting 14:47:21 (6288): No heartbeat from core client for 30 sec - exiting 14:47:22 (6288): No heartbeat from core client for 30 sec - exiting 14:47:23 (6288): No heartbeat from core client for 30 sec - exiting 14:47:24 (6288): No heartbeat from core client for 30 sec - exiting 14:47:25 (6288): No heartbeat from core client for 30 sec - exiting 14:47:26 (6288): No heartbeat from core client for 30 sec - exiting 14:47:27 (6288): No heartbeat from core client for 30 sec - exiting 14:47:28 (6288): No heartbeat from core client for 30 sec - exiting 14:47:29 (6288): No heartbeat from core client for 30 sec - exiting 14:47:30 (6288): No heartbeat from core client for 30 sec - exiting 14:47:31 (6288): No heartbeat from core client for 30 sec - exiting 14:47:32 (6288): No heartbeat from core client for 30 sec - exiting 14:47:33 (6288): No heartbeat from core client for 30 sec - exiting 14:47:34 (6288): No heartbeat from core client for 30 sec - exiting 14:47:35 (6288): No heartbeat from core client for 30 sec - exiting 14:47:36 (6288): No heartbeat from core client for 30 sec - exiting 14:47:37 (6288): No heartbeat from core client for 30 sec - exiting 14:47:38 (6288): No heartbeat from core client for 30 sec - exiting 14:47:39 (6288): No heartbeat from core client for 30 sec - exiting 14:47:40 (6288): No heartbeat from core client for 30 sec - exiting 14:47:41 (6288): No heartbeat from core client for 30 sec - exiting 14:47:42 (6288): No heartbeat from core client for 30 sec - exiting 14:47:43 (6288): No heartbeat from core client for 30 sec - exiting 14:47:44 (6288): No heartbeat from core client for 30 sec - exiting 14:47:45 (6288): No heartbeat from core client for 30 sec - exiting 14:47:46 (6288): No heartbeat from core client for 30 sec - exiting 14:47:47 (6288): No heartbeat from core client for 30 sec - exiting 14:47:48 (6288): No heartbeat from core client for 30 sec - exiting 14:47:49 (6288): No heartbeat from core client for 30 sec - exiting 14:47:50 (6288): No heartbeat from core client for 30 sec - exiting 14:47:51 (6288): No heartbeat from core client for 30 sec - exiting 14:47:52 (6288): No heartbeat from core client for 30 sec - exiting 14:47:53 (6288): No heartbeat from core client for 30 sec - exiting 14:47:54 (6288): No heartbeat from core client for 30 sec - exiting 14:47:55 (6288): No heartbeat from core client for 30 sec - exiting 14:47:56 (6288): No heartbeat from core client for 30 sec - exiting 14:47:57 (6288): No heartbeat from core client for 30 sec - exiting 14:47:58 (6288): No heartbeat from core client for 30 sec - exiting 14:47:59 (6288): No heartbeat from core client for 30 sec - exiting 14:48:00 (6288): No heartbeat from core client for 30 sec - exiting 14:48:01 (6288): No heartbeat from core client for 30 sec - exiting 14:48:02 (6288): No heartbeat from core client for 30 sec - exiting 14:48:03 (6288): No heartbeat from core client for 30 sec - exiting 14:48:04 (6288): No heartbeat from core client for 30 sec - exiting 14:48:05 (6288): No heartbeat from core client for 30 sec - exiting 14:48:06 (6288): No heartbeat from core client for 30 sec - exiting 14:48:07 (6288): No heartbeat from core client for 30 sec - exiting 14:48:08 (6288): No heartbeat from core client for 30 sec - exiting 14:48:09 (6288): No heartbeat from core client for 30 sec - exiting 14:48:10 (6288): No heartbeat from core client for 30 sec - exiting 14:48:11 (6288): No heartbeat from core client for 30 sec - exiting 14:48:12 (6288): No heartbeat from core client for 30 sec - exiting 14:48:13 (6288): No heartbeat from core client for 30 sec - exiting 14:48:14 (6288): No heartbeat from core client for 30 sec - exiting 14:48:15 (6288): No heartbeat from core client for 30 sec - exiting 14:48:16 (6288): No heartbeat from core client for 30 sec - exiting 14:48:17 (6288): No heartbeat from core client for 30 sec - exiting 14:48:18 (6288): No heartbeat from core client for 30 sec - exiting 14:48:19 (6288): No heartbeat from core client for 30 sec - exiting 14:48:20 (6288): No heartbeat from core client for 30 sec - exiting 14:48:21 (6288): No heartbeat from core client for 30 sec - exiting 14:48:22 (6288): No heartbeat from core client for 30 sec - exiting 14:48:23 (6288): No heartbeat from core client for 30 sec - exiting 14:48:24 (6288): No heartbeat from core client for 30 sec - exiting 14:48:25 (6288): No heartbeat from core client for 30 sec - exiting 14:48:26 (6288): No heartbeat from core client for 30 sec - exiting 14:48:27 (6288): No heartbeat from core client for 30 sec - exiting 14:48:28 (6288): No heartbeat from core client for 30 sec - exiting 14:48:29 (6288): No heartbeat from core client for 30 sec - exiting 14:48:30 (6288): No heartbeat from core client for 30 sec - exiting 14:48:31 (6288): No heartbeat from core client for 30 sec - exiting 14:48:32 (6288): No heartbeat from core client for 30 sec - exiting 14:48:33 (6288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7344, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6476, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6604, selfPID=3376, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6740, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1428, selfPID=5640, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3432, iMonCtr=2 09:16:08 (5128): No heartbeat from core client for 30 sec - exiting 09:16:09 (5128): No heartbeat from core client for 30 sec - exiting 09:16:10 (5128): No heartbeat from core client for 30 sec - exiting 09:16:11 (5128): No heartbeat from core client for 30 sec - exiting 09:16:12 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6424, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6856, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2624, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4640, selfPID=5360, iMonCtr=1 Model crash detected, will try to restart... 07:28:33 (6420): No heartbeat from core client for 30 sec - exiting 07:28:35 (6420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3184, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2756, selfPID=3156, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5164, selfPID=6300, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6216, iMonCtr=2 GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=716, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=656, selfPID=5948, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3412, selfPID=3888, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6816, selfPID=6128, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6108, selfPID=7120, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4988, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5124, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5196, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6224, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6272, selfPID=4428, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7420, selfPID=7420, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4728, selfPID=4520, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CSuspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2692, selfPID=4904, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... GlController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5092, selfPID=5444, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4708, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5508, selfPID=3788, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=2 Model crash detected, will try to restart... GGlobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6820, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6044, selfPID=5940, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2752, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2788, selfPID=4992, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1244, selfPID=4136, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4740, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5440, selfPID=4604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=3600, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_anz_n5dz_2012_1_008580671_0_10.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5dz_2012_1_008580671_0_11.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_anz_n5dz_2012_1_008580671_0_12.zip</file_name> <error_code>-161 (not found)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Jun 2014 12:28:19	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	103,979	763,781	7.3455
24 May 2014 11:17:01	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	92,459	679,442	7.3486
15 May 2014 11:50:52	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	80,939	595,830	7.3615
10 May 2014 01:06:41	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	69,419	511,426	7.3672
07 May 2014 14:24:54	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	57,899	426,799	7.3714
27 Apr 2014 11:29:16	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	46,379	340,512	7.3419
18 Apr 2014 13:08:28	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	34,859	255,511	7.3298
10 Apr 2014 12:06:29	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	23,339	170,887	7.3220
01 Apr 2014 14:39:46	1225270	16395697	hadam3p_anz_n5dz_2012_1_008580671_0	11,819	86,298	7.3016