Task 16548419

Name	hadam3p_eu_o2kj_2013_1_008690341_1
Workunit	8824815
Created	18 Apr 2014, 12:27:04 UTC
Sent	18 Apr 2014, 12:53:14 UTC
Report deadline	31 Mar 2015, 18:13:14 UTC
Received	19 Nov 2014, 17:15:11 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1290561
Run time	7 days 23 hours 9 min 48 sec
CPU time	6 days 1 hours 50 min 25 sec
Validate state	Workunit error - check skipped
Credit	2,386.53
Device peak FLOPS	2.06 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3312, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3856, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4328, selfPID=4004, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4360, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4028, selfPID=3408, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2768, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3920, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4460, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4296, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5804, selfPID=5772, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2272, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3576, selfPID=3728, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3316, selfPID=4056, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4668, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3948, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3924, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3484, selfPID=3484, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3908, selfPID=3496, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3156, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3320, iMonCtr=2 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4280, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4288, selfPID=3432, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4812, selfPID=3252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4608, selfPID=4208, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3788, selfPID=3364, iMonCtr=1 Model crash detected, will try to restart... 23:40:54 (3220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:55 (3220): No heartbeat from core client for 30 sec - exiting 23:40:56 (3220): No heartbeat from core client for 30 sec - exiting 23:40:57 (3220): No heartbeat from core client for 30 sec - exiting 23:40:58 (3220): No heartbeat from core client for 30 sec - exiting 23:40:59 (3220): No heartbeat from core client for 30 sec - exiting 23:41:00 (3220): No heartbeat from core client for 30 sec - exiting 23:41:01 (3220): No heartbeat from core client for 30 sec - exiting 23:41:02 (3220): No heartbeat from core client for 30 sec - exiting 23:41:03 (3220): No heartbeat from core client for 30 sec - exiting 23:41:04 (3220): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4624, selfPID=3476, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... 14:51:12 (3260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:44 (3172): No heartbeat from core client for 30 sec - exiting 14:54:45 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:54:46 (3172): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3508, selfPID=3508, iMonCtr=2 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3256, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3904, selfPID=3652, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4636, selfPID=3376, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4480, selfPID=3452, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4452, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3700, selfPID=3344, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4076, selfPID=3368, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=2 Mode l crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4408, selfPID=4252, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2380, selfPID=3936, iMonCtr=1 Model crash detected, will try to restart... 19:22:01 (3404): No heartbeat from core client for 30 sec - exiting 19:22:02 (3404): No heartbeat from core client for 30 sec - exiting 19:22:03 (3404): No heartbeat from core client for 30 sec - exiting 19:22:04 (3404): No heartbeat from core client for 30 sec - exiting 19:22:05 (3404): No heartbeat from core client for 30 sec - exiting 19:22:06 (3404): No heartbeat from core client for 30 sec - exiting 19:22:07 (3404): No heartbeat from core client for 30 sec - exiting 19:22:08 (3404): No heartbeat from core client for 30 sec - exiting 19:22:09 (3404): No heartbeat from core client for 30 sec - exiting 19:22:10 (3404): No heartbeat from core client for 30 sec - exiting 19:22:11 (3404): No heartbeat from core client for 30 sec - exiting 19:22:12 (3404): No heartbeat from core client for 30 sec - exiting 19:22:13 (3404): No heartbeat from core client for 30 sec - exiting 19:22:14 (3404): No heartbeat from core client for 30 sec - exiting 19:22:15 (3404): No heartbeat from core client for 30 sec - exiting 19:22:16 (3404): No heartbeat from core client for 30 sec - exiting 19:22:17 (3404): No heartbeat from core client for 30 sec - exiting 19:22:18 (3404): No heartbeat from core client for 30 sec - exiting 19:22:19 (3404): No heartbeat from core client for 30 sec - exiting 19:22:20 (3404): No heartbeat from core client for 30 sec - exiting 19:22:21 (3404): No heartbeat from core client for 30 sec - exiting 19:22:22 (3404): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:36 (3648): No heartbeat from core client for 30 sec - exiting 23:35:37 (3648): No heartbeat from core client for 30 sec - exiting 23:35:38 (3648): No heartbeat from core client for 30 sec - exiting 23:35:39 (3648): No heartbeat from core client for 30 sec - exiting 23:35:40 (3648): No heartbeat from core client for 30 sec - exiting 23:35:41 (3648): No heartbeat from core client for 30 sec - exiting 23:35:42 (3648): No heartbeat from core client for 30 sec - exiting 23:35:43 (3648): No heartbeat from core client for 30 sec - exiting 23:35:44 (3648): No heartbeat from core client for 30 sec - exiting 23:35:45 (3648): No heartbeat from core client for 30 sec - exiting 23:35:46 (3648): No heartbeat from core client for 30 sec - exiting 23:35:47 (3648): No heartbeat from core client for 30 sec - exiting 23:35:48 (3648): No heartbeat from core client for 30 sec - exiting 23:35:49 (3648): No heartbeat from core client for 30 sec - exiting 23:35:50 (3648): No heartbeat from core client for 30 sec - exiting 23:35:51 (3648): No heartbeat from core client for 30 sec - exiting 23:35:52 (3648): No heartbeat from core client for 30 sec - exiting 23:35:53 (3648): No heartbeat from core client for 30 sec - exiting 23:35:54 (3648): No heartbeat from core client for 30 sec - exiting 23:35:55 (3648): No heartbeat from core client for 30 sec - exiting 23:35:56 (3648): No heartbeat from core client for 30 sec - exiting 23:35:57 (3648): No heartbeat from core client for 30 sec - exiting 23:35:58 (3648): No heartbeat from core client for 30 sec - exiting 23:35:59 (3648): No heartbeat from core client for 30 sec - exiting 23:36:00 (3648): No heartbeat from core client for 30 sec - exiting 23:36:01 (3648): No heartbeat from core client for 30 sec - exiting 23:36:02 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:03 (3648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3944, selfPID=4060, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4648, selfPID=4648, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4100, selfPID=3712, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4116, selfPID=3604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3340, selfPID=1460, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3624, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=952, selfPID=3544, iMonCtr=1 Model crash detected, will try to restart... GCobal Woroert:oller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonC tr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3780, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4080, selfPID=4080, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3088, selfPID=3004, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3284, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... 20:58:22 (3324): No heartbeat from core client for 30 sec - exiting 20:58:23 (3324): No heartbeat from core client for 30 sec - exiting 20:58:24 (3324): No heartbeat from core client for 30 sec - exiting 20:58:25 (3324): No heartbeat from core client for 30 sec - exiting 20:58:26 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4404, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5016, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3916, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3468, selfPID=3220, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4600, selfPID=4600, iMonCtr=2 CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4720, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4868, selfPID=3780, iMonCtr=1 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3264, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2384, selfPID=3368, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5048, selfPID=4020, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 15:10:15 (4992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3048, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4820, selfPID=3944, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Nov 2014 13:08:37	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	138,344	524,128	3.7886
15 Nov 2014 17:47:43	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	138,336	523,455	3.7839
09 Nov 2014 16:27:25	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	126,816	478,035	3.7695
02 Nov 2014 16:41:08	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	115,296	433,353	3.7586
18 Oct 2014 09:14:09	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	103,781	388,490	3.7434
17 Oct 2014 16:31:24	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	103,776	387,844	3.7373
26 Sep 2014 20:17:45	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	92,260	342,702	3.7145
26 Sep 2014 19:01:31	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	92,256	342,043	3.7075
06 Sep 2014 10:49:41	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	80,736	295,748	3.6631
27 Jul 2014 17:26:14	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	69,216	249,980	3.6116
08 Jul 2014 17:08:50	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	57,696	203,871	3.5335
10 Jun 2014 09:03:36	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	46,184	157,959	3.4202
10 Jun 2014 01:11:32	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	46,176	157,294	3.4064
30 May 2014 16:46:35	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	34,656	111,005	3.2031
15 May 2014 17:30:50	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	23,136	64,881	2.8043
01 May 2014 08:57:32	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	11,618	19,516	1.6798
28 Apr 2014 19:48:05	1290561	16548419	hadam3p_eu_o2kj_2013_1_008690341_1	11,616	18,868	1.6243