Task 14099310

Name	hadcm3n_yc1z_1980_40_007752402_0
Workunit	7907511
Created	15 Feb 2012, 20:03:15 UTC
Sent	15 Feb 2012, 20:03:35 UTC
Report deadline	17 May 2012, 3:30:46 UTC
Received	24 Feb 2012, 14:24:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1181465
Run time	4 days 19 hours 34 min 20 sec
CPU time	4 days 15 hours 14 min 39 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.60</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2504, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:00:36 (4752): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:02:09 (1028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:02:10 (1028): No heartbeat from core client for 30 sec - exiting 06:02:11 (1028): No heartbeat from core client for 30 sec - exiting 06:02:12 (1028): No heartbeat from core client for 30 sec - exiting 06:02:13 (1028): No heartbeat from core client for 30 sec - exiting 06:13:05 (4564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:48:21 (4432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:18:18 (5360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:58 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:59 (4796): No heartbeat from core client for 30 sec - exiting 07:39:00 (4796): No heartbeat from core client for 30 sec - exiting 07:39:01 (4796): No heartbeat from core client for 30 sec - exiting 07:39:02 (4796): No heartbeat from core client for 30 sec - exiting 07:39:03 (4796): No heartbeat from core client for 30 sec - exiting 07:39:04 (4796): No heartbeat from core client for 30 sec - exiting 07:47:17 (2748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:12 (3872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:04 (5648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:05:30 (4680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:49 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:50 (1132): No heartbeat from core client for 30 sec - exiting 09:59:51 (1132): No heartbeat from core client for 30 sec - exiting 09:59:52 (1132): No heartbeat from core client for 30 sec - exiting 09:59:53 (1132): No heartbeat from core client for 30 sec - exiting 09:59:54 (1132): No heartbeat from core client for 30 sec - exiting 09:59:55 (1132): No heartbeat from core client for 30 sec - exiting 09:59:56 (1132): No heartbeat from core client for 30 sec - exiting 09:59:57 (1132): No heartbeat from core client for 30 sec - exiting 09:59:58 (1132): No heartbeat from core client for 30 sec - exiting 09:59:59 (1132): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 10:01:48 (5564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 10:26:54 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:55 (3720): No heartbeat from core client for 30 sec - exiting 10:26:56 (3720): No heartbeat from core client for 30 sec - exiting 10:26:57 (3720): No heartbeat from core client for 30 sec - exiting 10:26:58 (3720): No heartbeat from core client for 30 sec - exiting 10:26:59 (3720): No heartbeat from core client for 30 sec - exiting 10:27:00 (3720): No heartbeat from core client for 30 sec - exiting 10:27:01 (3720): No heartbeat from core client for 30 sec - exiting 10:27:02 (3720): No heartbeat from core client for 30 sec - exiting 10:27:03 (3720): No heartbeat from core client for 30 sec - exiting 10:27:04 (3720): No heartbeat from core client for 30 sec - exiting 10:36:01 (1224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:04 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:05 (4424): No heartbeat from core client for 30 sec - exiting 11:19:06 (4424): No heartbeat from core client for 30 sec - exiting 11:19:07 (4424): No heartbeat from core client for 30 sec - exiting 11:19:08 (4424): No heartbeat from core client for 30 sec - exiting 11:19:09 (4424): No heartbeat from core client for 30 sec - exiting 11:19:10 (4424): No heartbeat from core client for 30 sec - exiting 11:19:11 (4424): No heartbeat from core client for 30 sec - exiting 11:19:12 (4424): No heartbeat from core client for 30 sec - exiting 11:19:13 (4424): No heartbeat from core client for 30 sec - exiting 11:19:14 (4424): No heartbeat from core client for 30 sec - exiting 12:01:35 (4332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:44:11 (4860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:04:01 (2832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:34 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:18:35 (4948): No heartbeat from core client for 30 sec - exiting 13:18:36 (4948): No heartbeat from core client for 30 sec - exiting 13:18:37 (4948): No heartbeat from core client for 30 sec - exiting 13:18:38 (4948): No heartbeat from core client for 30 sec - exiting 13:18:39 (4948): No heartbeat from core client for 30 sec - exiting 13:18:40 (4948): No heartbeat from core client for 30 sec - exiting 14:38:04 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:16 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:17 (3868): No heartbeat from core client for 30 sec - exiting 16:47:18 (3868): No heartbeat from core client for 30 sec - exiting 16:47:19 (3868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Feb 2012 14:25:06	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	259,200	400,476	1.5450
24 Feb 2012 02:16:25	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	233,280	360,989	1.5474
23 Feb 2012 12:39:18	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	207,360	321,337	1.5497
22 Feb 2012 22:57:52	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	181,440	281,472	1.5513
22 Feb 2012 09:43:58	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	155,520	242,029	1.5563
21 Feb 2012 19:53:42	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	129,600	207,018	1.5974
21 Feb 2012 00:42:35	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	103,680	166,249	1.6035
20 Feb 2012 06:49:31	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	77,760	125,082	1.6086
19 Feb 2012 08:53:19	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	51,840	82,973	1.6006
18 Feb 2012 16:14:01	1181465	14099310	hadcm3n_yc1z_1980_40_007752402_0	25,920	41,607	1.6052