Task 13739904

Name	hadam3p_pnw_78bb_2006_1_007606015_1
Workunit	7784145
Created	6 Dec 2011, 21:35:09 UTC
Sent	7 Dec 2011, 0:38:03 UTC
Report deadline	18 Nov 2012, 5:58:03 UTC
Received	10 Feb 2012, 13:16:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1149156
Run time	8 days 1 hours 30 min 48 sec
CPU time	6 days 2 hours 32 min 26 sec
Validate state	Invalid
Credit	2,755.56
Device peak FLOPS	1.93 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.8.13</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 22:26:04 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:26:06 (4704): No heartbeat from core client for 30 sec - exiting 22:26:07 (4704): No heartbeat from core client for 30 sec - exiting 22:26:08 (4704): No heartbeat from core client for 30 sec - exiting 22:26:09 (4704): No heartbeat from core client for 30 sec - exiting 22:26:10 (4704): No heartbeat from core client for 30 sec - exiting 22:26:11 (4704): No heartbeat from core client for 30 sec - exiting 22:26:12 (4704): No heartbeat from core client for 30 sec - exiting 22:26:13 (4704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:27:31 (4196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=4328, iMonCtr=2 Suspended CPDN Monitor - Suspend request from BOINC... 14:44:51 (6756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:55:23 (5492): Can't acquire lockfile (32) - waiting 35s 13:55:40 (6460): No heartbeat from core client for 30 sec - exiting 13:55:41 (6460): No heartbeat from core client for 30 sec - exiting 13:55:42 (6460): No heartbeat from core client for 30 sec - exiting 13:55:44 (6460): No heartbeat from core client for 30 sec - exiting 13:55:45 (6460): No heartbeat from core client for 30 sec - exiting 13:55:46 (6460): No heartbeat from core client for 30 sec - exiting 13:55:47 (6460): No heartbeat from core client for 30 sec - exiting 13:55:48 (6460): No heartbeat from core client for 30 sec - exiting 13:55:49 (6460): No heartbeat from core client for 30 sec - exiting 13:55:50 (6460): No heartbeat from core client for 30 sec - exiting 13:55:51 (6460): No heartbeat from core client for 30 sec - exiting 13:55:52 (6460): No heartbeat from core client for 30 sec - exiting 13:55:53 (6460): No heartbeat from core client for 30 sec - exiting 13:55:55 (6460): No heartbeat from core client for 30 sec - exiting 13:55:56 (6460): No heartbeat from core client for 30 sec - exiting 13:55:57 (6460): No heartbeat from core client for 30 sec - exiting 13:55:58 (6460): No heartbeat from core client for 30 sec - exiting 13:55:58 (5492): Can't acquire lockfile (32) - exiting 13:55:58 (5492): Error: The process cannot access the file because it is being used by another process. (0x20) 13:55:59 (6460): No heartbeat from core client for 30 sec - exiting 13:56:00 (6460): No heartbeat from core client for 30 sec - exiting 13:56:01 (6460): No heartbeat from core client for 30 sec - exiting 13:56:02 (6460): No heartbeat from core client for 30 sec - exiting 13:56:03 (6460): No heartbeat from core client for 30 sec - exiting 13:56:04 (6460): No heartbeat from core client for 30 sec - exiting 13:56:05 (6460): No heartbeat from core client for 30 sec - exiting 13:56:07 (6460): No heartbeat from core client for 30 sec - exiting 13:56:07 (2332): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:39:45 (5988): No heartbeat from core client for 30 sec - exiting 16:39:46 (5988): No heartbeat from core client for 30 sec - exiting 16:39:48 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:57:44 (3952): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... 21:58:11 (6104): Can't set up shared mem: -1. Will run in standalone mode. 21:58:19 (3952): Can't acquire lockfile (32) - exiting 21:58:19 (3952): Error: The process cannot access the file because it is being used by another process. (0x20) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:43:13 (4116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:02:50 (22440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23148, selfPID=23148, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:37:42 (11968): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:10:16 (18652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11796, selfPID=11796, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:44:55 (6836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:30:25 (13192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3484, selfPID=3484, iMonCtr=2 CPDN Monitor - Quit request from BOINC... 20:36:36 (9724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:15:33 (2324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5156, selfPID=5156, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6124, selfPID=6124, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3512, selfPID=3512, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2288, selfPID=2288, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4432, selfPID=4432, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 13:40:14 (7852): No heartbeat from core client for 30 sec - exiting 13:40:15 (7852): No heartbeat from core client for 30 sec - exiting 13:40:16 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:40:17 (7852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6636, selfPID=6636, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:26:08 (7160): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7028, selfPID=7028, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:51:01 (3804): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=6000, iMonCtr=1 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4104, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 11 Called boinc_finish </stderr_txt> <message> <file_xfer_error> <file_name>hadam3p_pnw_78bb_2006_1_007606015_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Feb 2012 22:17:04	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	126,816	525,222	4.1416
07 Feb 2012 20:43:15	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	115,297	475,694	4.1258
07 Feb 2012 18:54:05	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	115,296	475,209	4.1216
25 Jan 2012 20:39:17	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	103,776	430,653	4.1498
22 Jan 2012 01:39:40	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	92,256	384,354	4.1662
11 Jan 2012 19:18:31	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	80,736	337,735	4.1832
01 Jan 2012 04:51:35	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	69,216	290,432	4.1960
27 Dec 2011 02:56:08	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	57,696	240,914	4.1756
21 Dec 2011 01:56:08	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	46,178	192,409	4.1667
18 Dec 2011 20:24:15	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	46,176	191,802	4.1537
18 Dec 2011 07:17:15	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	34,656	144,866	4.1801
17 Dec 2011 18:41:49	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	23,136	98,305	4.2490
14 Dec 2011 18:27:29	1149156	13739904	hadam3p_pnw_78bb_2006_1_007606015_1	11,616	49,415	4.2540