Task 13555265

Name	hadcm3n_yje0_1900_40_007524770_0
Workunit	7722245
Created	28 Oct 2011, 13:33:31 UTC
Sent	30 Oct 2011, 17:22:51 UTC
Report deadline	30 Jan 2012, 0:50:02 UTC
Received	2 Dec 2011, 11:14:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1154122
Run time	13 days 6 hours 50 min 1 sec
CPU time	12 days 5 hours 6 min 57 sec
Validate state	Invalid
Credit	4,043.52
Device peak FLOPS	1.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:02:26 (5348): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:29 (5348): No heartbeat from core client for 30 sec - exiting 02:02:30 (5348): No heartbeat from core client for 30 sec - exiting 02:02:31 (5348): No heartbeat from core client for 30 sec - exiting 02:02:33 (5348): No heartbeat from core client for 30 sec - exiting 02:02:35 (5348): No heartbeat from core client for 30 sec - exiting 02:02:36 (5348): No heartbeat from core client for 30 sec - exiting 02:02:37 (5348): No heartbeat from core client for 30 sec - exiting 02:02:38 (5348): No heartbeat from core client for 30 sec - exiting 02:02:39 (5348): No heartbeat from core client for 30 sec - exiting 02:02:40 (5348): No heartbeat from core client for 30 sec - exiting 02:31:26 (2096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:46 (5480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:53:47 (5480): No heartbeat from core client for 30 sec - exiting 14:53:48 (5480): No heartbeat from core client for 30 sec - exiting 14:53:49 (5480): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:59:04 (5652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 07:59:06 (5652): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:09:20 (5988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:09:21 (5988): No heartbeat from core client for 30 sec - exiting 20:09:22 (5988): No heartbeat from core client for 30 sec - exiting 12:16:45 (4476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:16:46 (4476): No heartbeat from core client for 30 sec - exiting 12:16:47 (4476): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:47:15 (692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 21:47:16 (692): No heartbeat from core client for 30 sec - exiting 21:47:18 (692): No heartbeat from core client for 30 sec - exiting 21:47:19 (692): No heartbeat from core client for 30 sec - exiting 21:47:20 (692): No heartbeat from core client for 30 sec - exiting 21:47:21 (692): No heartbeat from core client for 30 sec - exiting 21:47:22 (692): No heartbeat from core client for 30 sec - exiting 21:47:23 (692): No heartbeat from core client for 30 sec - exiting 21:47:24 (692): No heartbeat from core client for 30 sec - exiting 21:47:26 (692): No heartbeat from core client for 30 sec - exiting 21:47:27 (692): No heartbeat from core client for 30 sec - exiting 21:47:28 (692): No heartbeat from core client for 30 sec - exiting 21:47:29 (692): No heartbeat from core client for 30 sec - exiting 21:47:30 (692): No heartbeat from core client for 30 sec - exiting 21:47:31 (692): No heartbeat from core client for 30 sec - exiting 21:47:32 (692): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:45:27 (5848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:28 (5848): No heartbeat from core client for 30 sec - exiting 21:45:29 (5848): No heartbeat from core client for 30 sec - exiting 21:45:31 (5848): No heartbeat from core client for 30 sec - exiting 06:49:54 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:07:27 (4168): No heartbeat from core client for 30 sec - exiting 11:07:28 (4168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:07:29 (4168): No heartbeat from core client for 30 sec - exiting 11:35:51 (3592): No heartbeat from core client for 30 sec - exiting 11:35:52 (3592): No heartbeat from core client for 30 sec - exiting 11:35:54 (3592): No heartbeat from core client for 30 sec - exiting 11:35:55 (3592): No heartbeat from core client for 30 sec - exiting 11:35:56 (3592): No heartbeat from core client for 30 sec - exiting 11:35:57 (3592): No heartbeat from core client for 30 sec - exiting 11:35:58 (3592): No heartbeat from core client for 30 sec - exiting 11:35:59 (3592): No heartbeat from core client for 30 sec - exiting 11:36:00 (3592): No heartbeat from core client for 30 sec - exiting 11:36:01 (3592): No heartbeat from core client for 30 sec - exiting 11:36:02 (3592): No heartbeat from core client for 30 sec - exiting 11:36:03 (3592): No heartbeat from core client for 30 sec - exiting 11:36:04 (3592): No heartbeat from core client for 30 sec - exiting 11:36:06 (3592): No heartbeat from core client for 30 sec - exiting 11:36:07 (3592): No heartbeat from core client for 30 sec - exiting 11:36:08 (3592): No heartbeat from core client for 30 sec - exiting 11:36:09 (3592): No heartbeat from core client for 30 sec - exiting 11:36:10 (3592): No heartbeat from core client for 30 sec - exiting 11:36:11 (3592): No heartbeat from core client for 30 sec - exiting 11:36:12 (3592): No heartbeat from core client for 30 sec - exiting 11:36:13 (3592): No heartbeat from core client for 30 sec - exiting 11:36:14 (3592): No heartbeat from core client for 30 sec - exiting 11:36:16 (3592): No heartbeat from core client for 30 sec - exiting 11:36:17 (3592): No heartbeat from core client for 30 sec - exiting 11:36:18 (3592): No heartbeat from core client for 30 sec - exiting 11:36:19 (3592): No heartbeat from core client for 30 sec - exiting 11:36:20 (3592): No heartbeat from core client for 30 sec - exiting 11:36:21 (3592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:36:22 (3592): No heartbeat from core client for 30 sec - exiting 11:36:23 (3592): No heartbeat from core client for 30 sec - exiting 12:09:33 (1156): No heartbeat from core client for 30 sec - exiting 12:09:34 (1156): No heartbeat from core client for 30 sec - exiting 12:09:35 (1156): No heartbeat from core client for 30 sec - exiting 12:09:36 (1156): No heartbeat from core client for 30 sec - exiting 12:09:37 (1156): No heartbeat from core client for 30 sec - exiting 12:09:38 (1156): No heartbeat from core client for 30 sec - exiting 12:09:39 (1156): No heartbeat from core client for 30 sec - exiting 12:09:41 (1156): No heartbeat from core client for 30 sec - exiting 12:09:42 (1156): No heartbeat from core client for 30 sec - exiting 12:09:43 (1156): No heartbeat from core client for 30 sec - exiting 12:09:44 (1156): No heartbeat from core client for 30 sec - exiting 12:09:45 (1156): No heartbeat from core client for 30 sec - exiting 12:09:46 (1156): No heartbeat from core client for 30 sec - exiting 12:09:47 (1156): No heartbeat from core client for 30 sec - exiting 12:09:48 (1156): No heartbeat from core client for 30 sec - exiting 12:09:49 (1156): No heartbeat from core client for 30 sec - exiting 12:09:50 (1156): No heartbeat from core client for 30 sec - exiting 12:09:52 (1156): No heartbeat from core client for 30 sec - exiting 12:09:53 (1156): No heartbeat from core client for 30 sec - exiting 12:09:54 (1156): No heartbeat from core client for 30 sec - exiting 12:09:55 (1156): No heartbeat from core client for 30 sec - exiting 12:09:56 (1156): No heartbeat from core client for 30 sec - exiting 12:09:57 (1156): No heartbeat from core client for 30 sec - exiting 12:09:58 (1156): No heartbeat from core client for 30 sec - exiting 12:09:59 (1156): No heartbeat from core client for 30 sec - exiting 12:10:00 (1156): No heartbeat from core client for 30 sec - exiting 12:10:01 (1156): No heartbeat from core client for 30 sec - exiting 12:10:03 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:36 (4352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:23:39 (2388): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:39:17 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:45:19 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:45:21 (4544): No heartbeat from core client for 30 sec - exiting 19:45:22 (4544): No heartbeat from core client for 30 sec - exiting 19:45:23 (4544): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 19:59:26 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:59:28 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=576, iMonCtr=1 Model crash detected, will try to restart... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Dec 2011 07:40:26	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	336,960	1,012,410	3.0045
25 Nov 2011 22:06:35	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	311,040	931,726	2.9955
24 Nov 2011 14:43:13	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	285,120	852,978	2.9916
09 Nov 2011 17:14:38	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	259,200	773,615	2.9846
08 Nov 2011 18:08:57	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	233,280	695,307	2.9806
07 Nov 2011 19:13:25	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	207,360	619,305	2.9866
06 Nov 2011 15:14:10	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	181,440	540,973	2.9816
05 Nov 2011 14:16:02	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	155,520	462,536	2.9741
04 Nov 2011 15:16:37	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	129,600	386,108	2.9792
03 Nov 2011 16:12:07	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	103,680	309,621	2.9863
02 Nov 2011 17:16:00	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	77,760	232,893	2.9950
01 Nov 2011 18:36:40	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	51,840	155,582	3.0012
31 Oct 2011 20:05:57	1154122	13555265	hadcm3n_yje0_1900_40_007524770_0	25,920	78,905	3.0442