Task 13673254

Name	hadcm3n_u09l_1980_40_007547600_1
Workunit	7744832
Created	29 Nov 2011, 16:18:14 UTC
Sent	29 Nov 2011, 16:29:40 UTC
Report deadline	28 Feb 2012, 23:56:51 UTC
Received	14 Dec 2011, 15:32:29 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	898291
Run time	14 days 3 hours 36 min 31 sec
CPU time	11 days 22 hours 47 min 40 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	1.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.9</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 09:59:12 (5148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:16:08 (13104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:25:10 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:03:05 (176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:55 (7148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:17:56 (7148): No heartbeat from core client for 30 sec - exiting 16:17:57 (7148): No heartbeat from core client for 30 sec - exiting 16:17:58 (7148): No heartbeat from core client for 30 sec - exiting 16:17:59 (7148): No heartbeat from core client for 30 sec - exiting 16:47:25 (4312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:16 (7384): No heartbeat from core client for 30 sec - exiting 16:50:50 (7384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:19 (2716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:01:20 (2716): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold Ocean Restart file copy failed on u09lko.dai13q0 Ocean Restart file copy failed on u09lko.dai13t0 23:31:59 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:00 (4956): No heartbeat from core client for 30 sec - exiting 09:54:53 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Skipping gmts_generator due to netcdf error 13 - Permission denied Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on u09lko.dai21n0 Ocean Restart file copy failed on u09lko.dai22n0 Ocean Restart file copy failed on u09lko.dai23m0 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 09:39:44 (11160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:39:46 (11160): No heartbeat from core client for 30 sec - exiting 09:39:47 (11160): No heartbeat from core client for 30 sec - exiting 09:39:48 (11160): No heartbeat from core client for 30 sec - exiting 09:39:49 (11160): No heartbeat from core client for 30 sec - exiting 09:39:50 (11160): No heartbeat from core client for 30 sec - exiting 09:39:51 (11160): No heartbeat from core client for 30 sec - exiting 09:39:52 (11160): No heartbeat from core client for 30 sec - exiting 09:39:53 (11160): No heartbeat from core client for 30 sec - exiting 09:39:54 (11160): No heartbeat from core client for 30 sec - exiting 09:39:55 (11160): No heartbeat from core client for 30 sec - exiting 09:39:56 (11160): No heartbeat from core client for 30 sec - exiting 11:05:25 (13232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:12 (6636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:55 (14772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:57 (14772): No heartbeat from core client for 30 sec - exiting 19:28:58 (14772): No heartbeat from core client for 30 sec - exiting 19:28:59 (14772): No heartbeat from core client for 30 sec - exiting 20:06:13 (2744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on u09lko.dai4b90 08:18:11 (11776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:53 (13656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:12 (14280): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:52:53 (14468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:53 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:04:10 (13532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:39 (14528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:02 (14680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:15:05 (14680): No heartbeat from core client for 30 sec - exiting 12:25:22 (8764): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:25:23 (8764): No heartbeat from core client for 30 sec - exiting 12:25:24 (8764): No heartbeat from core client for 30 sec - exiting 12:25:25 (8764): No heartbeat from core client for 30 sec - exiting 12:25:26 (8764): No heartbeat from core client for 30 sec - exiting 12:25:27 (8764): No heartbeat from core client for 30 sec - exiting 12:25:28 (8764): No heartbeat from core client for 30 sec - exiting 12:25:29 (8764): No heartbeat from core client for 30 sec - exiting 12:25:30 (8764): No heartbeat from core client for 30 sec - exiting 12:25:31 (8764): No heartbeat from core client for 30 sec - exiting 12:25:32 (8764): No heartbeat from core client for 30 sec - exiting 12:34:38 (9792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:30 (9440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:48:49 (13124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:13 (9228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:10 (13572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:12 (13572): No heartbeat from core client for 30 sec - exiting 13:45:12 (13412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:14 (13412): No heartbeat from core client for 30 sec - exiting 13:46:22 (6492): No heartbeat from core client for 30 sec - exiting 13:46:23 (6492): No heartbeat from core client for 30 sec - exiting 13:46:24 (6492): No heartbeat from core client for 30 sec - exiting 13:46:25 (6492): No heartbeat from core client for 30 sec - exiting 13:46:26 (6492): No heartbeat from core client for 30 sec - exiting 13:46:27 (6492): No heartbeat from core client for 30 sec - exiting 13:46:28 (6492): No heartbeat from core client for 30 sec - exiting 13:46:29 (6492): No heartbeat from core client for 30 sec - exiting 13:46:30 (6492): No heartbeat from core client for 30 sec - exiting 13:46:31 (6492): No heartbeat from core client for 30 sec - exiting 13:46:32 (6492): No heartbeat from core client for 30 sec - exiting 13:46:34 (6492): No heartbeat from core client for 30 sec - exiting 13:46:35 (6492): No heartbeat from core client for 30 sec - exiting 13:46:36 (6492): No heartbeat from core client for 30 sec - exiting 13:46:37 (6492): No heartbeat from core client for 30 sec - exiting 13:46:38 (6492): No heartbeat from core client for 30 sec - exiting 13:46:39 (6492): No heartbeat from core client for 30 sec - exiting 13:46:40 (6492): No heartbeat from core client for 30 sec - exiting 13:46:41 (6492): No heartbeat from core client for 30 sec - exiting 13:46:42 (6492): No heartbeat from core client for 30 sec - exiting 13:46:43 (6492): No heartbeat from core client for 30 sec - exiting 13:46:44 (6492): No heartbeat from core client for 30 sec - exiting 13:46:45 (6492): No heartbeat from core client for 30 sec - exiting 13:46:46 (6492): No heartbeat from core client for 30 sec - exiting 13:46:47 (6492): No heartbeat from core client for 30 sec - exiting 13:46:48 (6492): No heartbeat from core client for 30 sec - exiting 13:46:49 (6492): No heartbeat from core client for 30 sec - exiting 13:46:50 (6492): No heartbeat from core client for 30 sec - exiting 13:46:51 (6492): No heartbeat from core client for 30 sec - exiting 13:46:52 (6492): No heartbeat from core client for 30 sec - exiting 13:46:53 (6492): No heartbeat from core client for 30 sec - exiting 13:46:54 (6492): No heartbeat from core client for 30 sec - exiting 13:46:55 (6492): No heartbeat from core client for 30 sec - exiting 13:46:56 (6492): No heartbeat from core client for 30 sec - exiting 13:46:57 (6492): No heartbeat from core client for 30 sec - exiting 13:46:58 (6492): No heartbeat from core client for 30 sec - exiting 13:46:59 (6492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:18:51 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:28:12 (10892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:12 (716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:13 (716): No heartbeat from core client for 30 sec - exiting 23:29:31 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:29:33 (4844): No heartbeat from core client for 30 sec - exiting 23:29:34 (4844): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 23:30:14 (11352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:30:15 (11352): No heartbeat from core client for 30 sec - exiting 23:30:16 (11352): No heartbeat from core client for 30 sec - exiting 23:30:17 (11352): No heartbeat from core client for 30 sec - exiting 23:30:18 (11352): No heartbeat from core client for 30 sec - exiting 23:30:19 (11352): No heartbeat from core client for 30 sec - exiting 23:30:20 (11352): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on u09lko.dai6430 Ocean Restart file copy failed on u09lko.dai6480 03:49:47 (8436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:48 (8436): No heartbeat from core client for 30 sec - exiting 03:49:49 (8436): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on u09lko.dai64u0 05:10:53 (8336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:07:28 (8864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on u09lko.dai66n0 10:27:05 (11264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:27:07 (11264): No heartbeat from core client for 30 sec - exiting 14:44:20 (9728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:22 (9728): No heartbeat from core client for 30 sec - exiting 14:44:23 (9728): No heartbeat from core client for 30 sec - exiting 03:33:33 (3452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:06 (200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:19:07 (200): No heartbeat from core client for 30 sec - exiting 11:21:16 (5068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:30 (7040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:02 (9872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:35:13 (9012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:37:28 (9248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:35 (10420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:40:36 (10420): No heartbeat from core client for 30 sec - exiting 11:40:37 (10420): No heartbeat from core client for 30 sec - exiting 11:40:38 (10420): No heartbeat from core client for 30 sec - exiting 11:40:39 (10420): No heartbeat from core client for 30 sec - exiting 11:40:40 (10420): No heartbeat from core client for 30 sec - exiting 11:40:41 (10420): No heartbeat from core client for 30 sec - exiting 11:40:42 (10420): No heartbeat from core client for 30 sec - exiting 11:40:43 (10420): No heartbeat from core client for 30 sec - exiting 11:40:44 (10420): No heartbeat from core client for 30 sec - exiting 11:41:47 (6732): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:54:39 (6472): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:46 (312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:27:47 (312): No heartbeat from core client for 30 sec - exiting 12:29:14 (14196): No heartbeat from core client for 30 sec - exiting 12:29:15 (14196): No heartbeat from core client for 30 sec - exiting 12:29:16 (14196): No heartbeat from core client for 30 sec - exiting 12:29:17 (14196): No heartbeat from core client for 30 sec - exiting 12:29:18 (14196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Ocean Restart file copy failed on u09lko.dai77b0 Ocean Restart file copy failed on u09lko.dai78s0 Ocean Restart file copy failed on u09lko.dai8810 CPDN Monitor - Quit request from BOINC... 14:19:28 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:19:30 (3516): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 15:31:26 (5612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:27 (5612): No heartbeat from core client for 30 sec - exiting 15:31:28 (5612): No heartbeat from core client for 30 sec - exiting 08:06:22 (6696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:24 (6696): No heartbeat from core client for 30 sec - exiting 08:08:03 (12252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:04 (12252): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on u09lko.dai94c0 Atmos Hold Restart file rename failed on atmos_restart.hold 11:23:52 (10264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:23:53 (10264): No heartbeat from core client for 30 sec - exiting 11:23:54 (10264): No heartbeat from core client for 30 sec - exiting 11:56:21 (6024): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:56:23 (6024): No heartbeat from core client for 30 sec - exiting 12:10:15 (4228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:51 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:19:53 (7800): No heartbeat from core client for 30 sec - exiting 12:24:44 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:45 (6092): No heartbeat from core client for 30 sec - exiting 12:24:46 (6092): No heartbeat from core client for 30 sec - exiting 12:24:47 (6092): No heartbeat from core client for 30 sec - exiting 12:24:48 (6092): No heartbeat from core client for 30 sec - exiting 12:37:10 (9636): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... OPEN: Unable to Open File dataout/u09lko.pjj0c10 for Read/Write Model crashed: PPCTL : Error opening preassigned PPfile tmp/pipe_dummy 2048 12:46:34 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:56:04 (11200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:56 (1044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:05:41 (12384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:49:55 (8332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:54:44 (9384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:30 (10720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:04:31 (10720): No heartbeat from core client for 30 sec - exiting 14:04:32 (10720): No heartbeat from core client for 30 sec - exiting 14:04:33 (10720): No heartbeat from core client for 30 sec - exiting 14:04:34 (10720): No heartbeat from core client for 30 sec - exiting 14:04:35 (10720): No heartbeat from core client for 30 sec - exiting 14:04:36 (10720): No heartbeat from core client for 30 sec - exiting 14:04:37 (10720): No heartbeat from core client for 30 sec - exiting 14:04:38 (10720): No heartbeat from core client for 30 sec - exiting 14:04:39 (10720): No heartbeat from core client for 30 sec - exiting 14:04:40 (10720): No heartbeat from core client for 30 sec - exiting 14:09:30 (5980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:22:02 (11572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:32:18 (12064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:51:35 (9468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:52:47 (8212): No heartbeat from core client for 30 sec - exiting 14:52:48 (8212): No heartbeat from core client for 30 sec - exiting 14:52:49 (8212): No heartbeat from core client for 30 sec - exiting 14:52:50 (8212): No heartbeat from core client for 30 sec - exiting 14:52:51 (8212): No heartbeat from core client for 30 sec - exiting 14:52:52 (8212): No heartbeat from core client for 30 sec - exiting 14:52:53 (8212): No heartbeat from core client for 30 sec - exiting 14:52:54 (8212): No heartbeat from core client for 30 sec - exiting 14:52:55 (8212): No heartbeat from core client for 30 sec - exiting 14:52:56 (8212): No heartbeat from core client for 30 sec - exiting 14:52:57 (8212): No heartbeat from core client for 30 sec - exiting 14:52:58 (8212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:57:44 (9692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:25 (4956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:08:22 (9100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:13:29 (6408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:42 (996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:36:44 (996): No heartbeat from core client for 30 sec - exiting 15:38:01 (13176): No heartbeat from core client for 30 sec - exiting 15:38:50 (13176): No heartbeat from core client for 30 sec - exiting 15:38:51 (13176): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:47 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:48 (4708): No heartbeat from core client for 30 sec - exiting 16:39:18 (4200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:39:20 (4200): No heartbeat from core client for 30 sec - exiting 16:39:23 (4200): No heartbeat from core client for 30 sec - exiting 16:40:53 (10812): No heartbeat from core client for 30 sec - exiting 16:40:55 (10812): No heartbeat from core client for 30 sec - exiting 16:40:56 (10812): No heartbeat from core client for 30 sec - exiting 16:40:57 (10812): No heartbeat from core client for 30 sec - exiting 16:41:30 (10812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:04 (11988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:08:32 (14332): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:48 (7208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:57:49 (7208): No heartbeat from core client for 30 sec - exiting 18:53:42 (7256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:53:43 (7256): No heartbeat from core client for 30 sec - exiting 19:13:32 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:18:32 (8528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:32 (12272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:22 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:28:23 (2856): No heartbeat from core client for 30 sec - exiting 19:33:14 (3008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:06 (9432): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:20 (6388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:11:58 (5128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:12:47 (14120): No heartbeat from core client for 30 sec - exiting 20:12:48 (14120): No heartbeat from core client for 30 sec - exiting 20:12:49 (14120): No heartbeat from core client for 30 sec - exiting 20:12:50 (14120): No heartbeat from core client for 30 sec - exiting 20:12:51 (14120): No heartbeat from core client for 30 sec - exiting 20:12:52 (14120): No heartbeat from core client for 30 sec - exiting 20:12:53 (14120): No heartbeat from core client for 30 sec - exiting 20:12:54 (14120): No heartbeat from core client for 30 sec - exiting 20:12:55 (14120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:40 (9816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:29:41 (9816): No heartbeat from core client for 30 sec - exiting 20:35:03 (10944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:53 (9136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:50:36 (10144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:29 (9256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:29 (12308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:32 (8892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:34 (8892): No heartbeat from core client for 30 sec - exiting 08:12:30 (6092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:48 (3168): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:19:50 (3168): No heartbeat from core client for 30 sec - exiting 08:24:20 (12136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:25:17 (9696): No heartbeat from core client for 30 sec - exiting 08:25:30 (9696): No heartbeat from core client for 30 sec - exiting 08:25:31 (9696): No heartbeat from core client for 30 sec - exiting 08:25:32 (9696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:11 (7096): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:58:21 (10028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:24 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:25 (4648): No heartbeat from core client for 30 sec - exiting 15:31:29 (2516): No heartbeat from core client for 30 sec - exiting 15:31:30 (2516): No heartbeat from core client for 30 sec - exiting 15:31:31 (2516): No heartbeat from core client for 30 sec - exiting 15:31:32 (2516): No heartbeat from core client for 30 sec - exiting 15:31:33 (2516): No heartbeat from core client for 30 sec - exiting 15:31:34 (2516): No heartbeat from core client for 30 sec - exiting 15:31:35 (2516): No heartbeat from core client for 30 sec - exiting 15:31:36 (2516): No heartbeat from core client for 30 sec - exiting 15:31:37 (2516): No heartbeat from core client for 30 sec - exiting 15:31:38 (2516): No heartbeat from core client for 30 sec - exiting 15:31:39 (2516): No heartbeat from core client for 30 sec - exiting 15:31:40 (2516): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on u09lko.daj0c40 Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Dec 2011 14:34:32	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	259,200	1,032,366	3.9829
13 Dec 2011 01:33:27	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	233,280	934,605	4.0064
11 Dec 2011 18:14:57	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	207,360	831,010	4.0076
10 Dec 2011 08:05:56	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	181,440	719,571	3.9659
09 Dec 2011 10:58:10	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	155,520	609,462	3.9189
07 Dec 2011 13:18:22	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	129,600	507,337	3.9146
05 Dec 2011 23:46:44	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	103,680	392,983	3.7903
04 Dec 2011 11:05:30	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	77,760	270,394	3.4773
02 Dec 2011 22:13:25	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	51,840	142,996	2.7584
01 Dec 2011 12:27:21	898291	13673254	hadcm3n_u09l_1980_40_007547600_1	25,920	91,109	3.5150