Task 14407659

Name	hadam3p_pnw_aqlz_1990_1_007873562_0
Workunit	8028674
Created	16 Apr 2012, 15:25:56 UTC
Sent	16 Apr 2012, 15:26:12 UTC
Report deadline	29 Mar 2013, 20:46:12 UTC
Received	30 May 2012, 5:59:23 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1115739
Run time	10 days 14 hours 17 min 44 sec
CPU time	9 days 17 hours 18 min 56 sec
Validate state	Workunit error - check skipped
Credit	3,005.88
Device peak FLOPS	1.48 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3336, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=760, selfPID=3836, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5504, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2936, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3572, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3496, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1724, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 08:10:50 (3228): No heartbeat from core client for 30 sec - exiting 08:10:52 (3228): No heartbeat from core client for 30 sec - exiting 08:10:53 (3228): No heartbeat from core client for 30 sec - exiting 08:10:54 (3228): No heartbeat from core client for 30 sec - exiting 08:10:55 (3228): No heartbeat from core client for 30 sec - exiting 08:10:56 (3228): No heartbeat from core client for 30 sec - exiting 08:10:57 (3228): No heartbeat from core client for 30 sec - exiting 08:10:58 (3228): No heartbeat from core client for 30 sec - exiting 08:10:59 (3228): No heartbeat from core client for 30 sec - exiting 08:11:00 (3228): No heartbeat from core client for 30 sec - exiting 08:11:01 (3228): No heartbeat from core client for 30 sec - exiting 08:11:02 (3228): No heartbeat from core client for 30 sec - exiting 08:11:04 (3228): No heartbeat from core client for 30 sec - exiting 08:11:05 (3228): No heartbeat from core client for 30 sec - exiting 08:11:06 (3228): No heartbeat from core client for 30 sec - exiting 08:11:07 (3228): No heartbeat from core client for 30 sec - exiting 08:11:08 (3228): No heartbeat from core client for 30 sec - exiting 08:11:09 (3228): No heartbeat from core client for 30 sec - exiting 08:11:10 (3228): No heartbeat from core client for 30 sec - exiting 08:11:11 (3228): No heartbeat from core client for 30 sec - exiting 08:11:12 (3228): No heartbeat from core client for 30 sec - exiting 08:11:13 (3228): No heartbeat from core client for 30 sec - exiting 08:11:14 (3228): No heartbeat from core client for 30 sec - exiting 08:11:16 (3228): No heartbeat from core client for 30 sec - exiting 08:11:17 (3228): No heartbeat from core client for 30 sec - exiting 08:11:18 (3228): No heartbeat from core client for 30 sec - exiting 08:11:19 (3228): No heartbeat from core client for 30 sec - exiting 08:11:20 (3228): No heartbeat from core client for 30 sec - exiting 08:11:21 (3228): No heartbeat from core client for 30 sec - exiting 08:11:22 (3228): No heartbeat from core client for 30 sec - exiting 08:11:23 (3228): No heartbeat from core client for 30 sec - exiting 08:11:24 (3228): No heartbeat from core client for 30 sec - exiting 08:11:25 (3228): No heartbeat from core client for 30 sec - exiting 08:11:26 (3228): No heartbeat from core client for 30 sec - exiting 08:11:28 (3228): No heartbeat from core client for 30 sec - exiting 08:11:29 (3228): No heartbeat from core client for 30 sec - exiting 08:11:30 (3228): No heartbeat from core client for 30 sec - exiting 08:11:31 (3228): No heartbeat from core client for 30 sec - exiting 08:11:32 (3228): No heartbeat from core client for 30 sec - exiting 08:11:33 (3228): No heartbeat from core client for 30 sec - exiting 08:11:34 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:35 (3228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5368, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=252, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1988, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2804, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4092, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 07:40:04 (3624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1916, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3744, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3876, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3276, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2224, selfPID=2648, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2860, selfPID=1052, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2712, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2460, selfPID=3276, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2668, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2892, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4572, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4996, selfPID=3040, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2572, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3448, iMonCtr=2 Model crash detected, will try to restart... lobal Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2744, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3240, iMonCtr=2 Model crash detected, will try to restart... 09:47:44 (2652): No heartbeat from core client for 30 sec - exiting 09:47:45 (2652): No heartbeat from core client for 30 sec - exiting 09:47:46 (2652): No heartbeat from core client for 30 sec - exiting 09:47:47 (2652): No heartbeat from core client for 30 sec - exiting 09:47:48 (2652): No heartbeat from core client for 30 sec - exiting 09:47:50 (2652): No heartbeat from core client for 30 sec - exiting 09:47:51 (2652): No heartbeat from core client for 30 sec - exiting 09:47:52 (2652): No heartbeat from core client for 30 sec - exiting 09:47:53 (2652): No heartbeat from core client for 30 sec - exiting 09:47:54 (2652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:55 (2652): No heartbeat from core client for 30 sec - exiting 09:47:56 (2652): No heartbeat from core client for 30 sec - exiting 09:47:57 (2652): No heartbeat from core client for 30 sec - exiting 09:47:58 (2652): No heartbeat from core client for 30 sec - exiting 09:47:59 (2652): No heartbeat from core client for 30 sec - exiting 09:48:00 (2652): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3556, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2896, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2420, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2960, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3312, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2508, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=264, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3936, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2384, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3640, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2376, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3896, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3376, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2308, selfPID=2764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1632, selfPID=3520, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 May 2012 20:43:03	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	138,336	838,370	6.0604
25 May 2012 16:24:15	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	126,816	765,626	6.0373
20 May 2012 15:50:58	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	115,296	694,332	6.0222
15 May 2012 20:53:25	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	103,776	626,262	6.0347
09 May 2012 22:02:59	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	92,259	557,447	6.0422
09 May 2012 21:01:45	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	92,256	556,556	6.0327
07 May 2012 13:38:55	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	80,736	487,498	6.0382
05 May 2012 09:18:45	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	69,216	417,695	6.0347
01 May 2012 14:59:29	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	57,696	349,290	6.0540
30 Apr 2012 07:07:33	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	46,178	280,787	6.0805
29 Apr 2012 22:10:58	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	46,176	279,954	6.0628
28 Apr 2012 14:13:57	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	34,656	209,029	6.0315
26 Apr 2012 16:12:10	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	23,139	140,690	6.0802
26 Apr 2012 08:15:38	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	23,136	139,851	6.0447
23 Apr 2012 17:04:43	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	11,618	72,787	6.2650
23 Apr 2012 16:02:54	1115739	14407659	hadam3p_pnw_aqlz_1990_1_007873562_0	11,616	71,913	6.1909