Task 14452218

Name	hadam3p_pnw_bkqa_1985_1_007913169_0
Workunit	8068281
Created	17 Apr 2012, 20:24:14 UTC
Sent	17 Apr 2012, 21:14:50 UTC
Report deadline	31 Mar 2013, 2:34:50 UTC
Received	18 May 2012, 17:36:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	579650
Run time	11 days 15 hours 22 min 57 sec
CPU time	11 days 11 hours 47 min 13 sec
Validate state	Invalid
Credit	3,008.24
Device peak FLOPS	1.35 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> too many exit(0)s </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 22:42:12 (2772): Can't acquire lockfile (32) - waiting 35s 22:42:36 (204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:54 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Region10:42:36 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:44 (1596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:38 (364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:45 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:47 (2036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:07 (2248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:32:39 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:11 (2632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:19 (1372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:20 (1372): No heartbeat from core client for 30 sec - exiting 11:47:56 (320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:36 (716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:08 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3820, selfPID=3820, iMonCtr=2 12:07:27 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:10:16 (664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:08 (3948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:55 (3376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3916, selfPID=3916, iMonCtr=2 12:34:09 (2968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:20 (972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:54:23 (1824): No heartbeat from core client for 30 sec - exiting 12:54:24 (1824): No heartbeat from core client for 30 sec - exiting 12:54:26 (1824): No heartbeat from core client for 30 sec - exiting 12:54:27 (1824): No heartbeat from core client for 30 sec - exiting 12:54:28 (1824): No heartbeat from core client for 30 sec - exiting 12:54:29 (1824): No heartbeat from core client for 30 sec - exiting 12:54:30 (1824): No heartbeat from core client for 30 sec - exiting 12:54:31 (1824): No heartbeat from core client for 30 sec - exiting 12:54:32 (1824): No heartbeat from core client for 30 sec - exiting 12:54:33 (1824): No heartbeat from core client for 30 sec - exiting 12:54:34 (1824): No heartbeat from core client for 30 sec - exiting 12:54:35 (1824): No heartbeat from core client for 30 sec - exiting 12:54:36 (1824): No heartbeat from core client for 30 sec - exiting 12:54:38 (1824): No heartbeat from core client for 30 sec - exiting 12:54:39 (1824): No heartbeat from core client for 30 sec - exiting 12:54:40 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:41 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:55 (1388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:59 (644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:17:31 (3204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:13 (2296): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:34:14 (2296): No heartbeat from core client for 30 sec - exiting 13:34:15 (2296): No heartbeat from core client for 30 sec - exiting 13:34:16 (2296): No heartbeat from core client for 30 sec - exiting 13:34:17 (2296): No heartbeat from core client for 30 sec - exiting 13:34:18 (2296): No heartbeat from core client for 30 sec - exiting 13:34:19 (2296): No heartbeat from core client for 30 sec - exiting 13:34:20 (2296): No heartbeat from core client for 30 sec - exiting 13:34:21 (2296): No heartbeat from core client for 30 sec - exiting 13:34:22 (2296): No heartbeat from core client for 30 sec - exiting 13:34:24 (2296): No heartbeat from core client for 30 sec - exiting 13:51:53 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:54 (1952): No heartbeat from core client for 30 sec - exiting 13:51:56 (1952): No heartbeat from core client for 30 sec - exiting 13:51:57 (1952): No heartbeat from core client for 30 sec - exiting 13:51:58 (1952): No heartbeat from core client for 30 sec - exiting 13:51:59 (1952): No heartbeat from core client for 30 sec - exiting 13:52:00 (1952): No heartbeat from core client for 30 sec - exiting 13:52:01 (1952): No heartbeat from core client for 30 sec - exiting 13:52:02 (1952): No heartbeat from core client for 30 sec - exiting 13:52:03 (1952): No heartbeat from core client for 30 sec - exiting 13:52:04 (1952): No heartbeat from core client for 30 sec - exiting 14:10:14 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:25 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:29:32 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:03 (3672): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2972, selfPID=2972, iMonCtr=2 14:37:10 (2644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:41:33 (912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:46 (4016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2040, selfPID=2040, iMonCtr=2 14:51:06 (2916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:34:28 (2488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:46:22 (2832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:57:14 (2872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:13:07 (3792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2880, selfPID=2880, iMonCtr=2 16:16:41 (3740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:18:40 (1528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:00 (1300): No heartbeat from core client for 30 sec - exiting 16:51:01 (1300): No heartbeat from core client for 30 sec - exiting 16:51:03 (1300): No heartbeat from core client for 30 sec - exiting 16:51:04 (1300): No heartbeat from core client for 30 sec - exiting 16:51:05 (1300): No heartbeat from core client for 30 sec - exiting 16:51:06 (1300): No heartbeat from core client for 30 sec - exiting 16:51:07 (1300): No heartbeat from core client for 30 sec - exiting 16:51:08 (1300): No heartbeat from core client for 30 sec - exiting 16:51:09 (1300): No heartbeat from core client for 30 sec - exiting 16:51:10 (1300): No heartbeat from core client for 30 sec - exiting 16:51:11 (1300): No heartbeat from core client for 30 sec - exiting 16:51:12 (1300): No heartbeat from core client for 30 sec - exiting 16:51:14 (1300): No heartbeat from core client for 30 sec - exiting 16:51:15 (1300): No heartbeat from core client for 30 sec - exiting 16:51:16 (1300): No heartbeat from core client for 30 sec - exiting 16:51:17 (1300): No heartbeat from core client for 30 sec - exiting 16:51:18 (1300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:11:43 (2152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:58 (3232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:27 (2728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:42:30 (1952): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:46 (252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2596, selfPID=2596, iMonCtr=2 18:03:54 (3120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:49 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:47 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:29 (1940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:26:01 (256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:28:53 (868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3884, selfPID=3884, iMonCtr=2 18:41:27 (3104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3628, selfPID=3628, iMonCtr=2 18:44:52 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:52:03 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:50 (3340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:02:29 (3212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:31 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:32 (4068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:05 (132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:37:38 (2788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3368, selfPID=3368, iMonCtr=2 19:47:14 (1548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:06 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:13:13 (3284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:17:53 (1228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2116, selfPID=2116, iMonCtr=2 20:25:59 (2068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:35:02 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:46:30 (1380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:54:26 (652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:58:00 (1256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3144, selfPID=3144, iMonCtr=2 20:59:30 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:15:42 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:20:53 (668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:05 (2100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:44 (2996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=372, selfPID=372, iMonCtr=2 21:48:25 (1244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:53:08 (2192): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:53 (3268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:06 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:07:27 (2076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:27:34 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:33:54 (720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:39:38 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:48:50 (3712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:47 (4032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:50:48 (4032): No heartbeat from core client for 30 sec - exiting 22:50:49 (4032): No heartbeat from core client for 30 sec - exiting 22:50:50 (4032): No heartbeat from core client for 30 sec - exiting 22:50:52 (4032): No heartbeat from core client for 30 sec - exiting 22:50:53 (4032): No heartbeat from core client for 30 sec - exiting 22:50:54 (4032): No heartbeat from core client for 30 sec - exiting Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2668, selfPID=2668, iMonCtr=2 22:50:55 (4032): No heartbeat from core client for 30 sec - exiting 23:00:50 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:30 (2460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:07:37 (3472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:25:37 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:46:56 (2760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:02:27 (688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:48 (2800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2304, selfPID=2304, iMonCtr=2 00:25:29 (3112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:48:48 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:43 (1440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:06:11 (3656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:21:39 (3700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:24:01 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3248, selfPID=3248, iMonCtr=2 01:27:59 (2448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:32:04 (1000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:37:30 (688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:41:09 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 May 2012 17:37:19	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	138,445	992,701	7.1704
18 May 2012 17:37:19	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	138,397	990,875	7.1597
18 May 2012 17:37:18	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	138,362	989,316	7.1502
18 May 2012 17:37:18	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	138,336	988,468	7.1454
18 May 2012 17:37:18	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	126,826	903,719	7.1257
10 May 2012 08:14:22	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	126,816	902,617	7.1175
10 May 2012 08:14:22	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	115,296	818,829	7.1020
10 May 2012 08:14:22	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	103,776	736,143	7.0936
10 May 2012 08:14:22	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	92,256	654,086	7.0899
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	80,736	572,451	7.0904
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	69,216	490,044	7.0799
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	57,696	407,348	7.0602
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	46,176	324,611	7.0299
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	34,656	241,682	6.9737
30 Apr 2012 10:16:10	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	23,136	163,595	7.0710
24 Apr 2012 20:43:01	579650	14452218	hadam3p_pnw_bkqa_1985_1_007913169_0	11,616	82,926	7.1389