Task 15488381

Name	hadcm3n_3m1z_1940_40_008260420_0
Workunit	8415544
Created	20 Dec 2012, 18:14:30 UTC
Sent	20 Dec 2012, 18:14:44 UTC
Report deadline	22 Mar 2013, 1:41:55 UTC
Received	13 Feb 2013, 13:17:40 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	977738
Run time	49 days 17 hours 32 min 15 sec
CPU time	48 days 7 hours 46 min 49 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.61 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on 3m1zko.dae44s0 Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on 3m1zko.dae96a0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3852, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:25:00 (3468): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3136, iMonCtr=1 Model crash detected, will try to restart... 19:58:06 (3760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1556, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 20:16:22 (1436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1540, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=1 Model crash detected, will try to restart... 19:48:20 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=1 Model crash detected, will try to restart... 20:00:05 (3004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:00:47 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:01 (3076): No heartbeat from core client for 30 sec - exiting 00:01:02 (3076): No heartbeat from core client for 30 sec - exiting 00:01:03 (3076): No heartbeat from core client for 30 sec - exiting 00:01:04 (3076): No heartbeat from core client for 30 sec - exiting 00:01:05 (3076): No heartbeat from core client for 30 sec - exiting 00:01:06 (3076): No heartbeat from core client for 30 sec - exiting 00:01:07 (3076): No heartbeat from core client for 30 sec - exiting 00:01:09 (3076): No heartbeat from core client for 30 sec - exiting 00:01:10 (3076): No heartbeat from core client for 30 sec - exiting 00:01:11 (3076): No heartbeat from core client for 30 sec - exiting 00:01:12 (3076): No heartbeat from core client for 30 sec - exiting 00:01:13 (3076): No heartbeat from core client for 30 sec - exiting 00:01:14 (3076): No heartbeat from core client for 30 sec - exiting 00:01:15 (3076): No heartbeat from core client for 30 sec - exiting 00:01:16 (3076): No heartbeat from core client for 30 sec - exiting 00:01:17 (3076): No heartbeat from core client for 30 sec - exiting 00:01:18 (3076): No heartbeat from core client for 30 sec - exiting 00:01:19 (3076): No heartbeat from core client for 30 sec - exiting 00:01:21 (3076): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=660, iMonCtr=1 Model crash detected, will try to restart... 21:27:35 (572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2328, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1900, iMonCtr=1 Model crash detected, will try to restart... 19:47:09 (708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:54:15 (2772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:54:19 (2772): No heartbeat from core client for 30 sec - exiting 04:54:20 (2772): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3716, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3680, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1728, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1728, iMonCtr=1 Model crash detected, will try to restart... 19:16:45 (2604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Feb 2013 13:20:13	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	1,036,800	4,173,647	4.0255
12 Feb 2013 02:18:08	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	1,010,880	4,060,113	4.0164
10 Feb 2013 14:05:30	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	984,960	3,943,823	4.0040
09 Feb 2013 01:55:08	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	959,040	3,828,445	3.9920
07 Feb 2013 17:52:53	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	933,120	3,714,105	3.9803
06 Feb 2013 08:53:11	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	907,200	3,598,224	3.9663
04 Feb 2013 23:49:55	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	881,280	3,481,966	3.9510
03 Feb 2013 14:50:44	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	855,360	3,365,893	3.9351
02 Feb 2013 06:50:10	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	829,440	3,252,027	3.9208
31 Jan 2013 22:49:34	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	803,520	3,138,873	3.9064
30 Jan 2013 09:38:16	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	777,600	3,035,214	3.9033
29 Jan 2013 02:38:33	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	751,680	2,925,945	3.8925
27 Jan 2013 15:02:16	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	725,760	2,818,585	3.8836
26 Jan 2013 05:59:28	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	699,840	2,715,338	3.8799
24 Jan 2013 23:48:31	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	673,920	2,613,816	3.8785
23 Jan 2013 17:05:55	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	648,000	2,517,130	3.8845
22 Jan 2013 16:05:50	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	622,080	2,427,264	3.9019
21 Jan 2013 15:05:42	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	596,160	2,338,017	3.9218
20 Jan 2013 09:09:42	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	570,240	2,243,523	3.9343
18 Jan 2013 23:23:06	977738	15488381	hadcm3n_3m1z_1940_40_008260420_0	544,320	2,140,409	3.9323