Task 15743238

Name	hadcm3n_u4bb_2020_40_008337925_1
Workunit	8488786
Created	20 Apr 2013, 13:25:08 UTC
Sent	20 Apr 2013, 13:34:38 UTC
Report deadline	20 Jul 2013, 21:01:49 UTC
Received	30 May 2013, 22:47:16 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1267124
Run time	17 days 1 hours 37 min 20 sec
CPU time	15 days 19 hours 37 min 22 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.03 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:34:03 (5056): No heartbeat from core client for 30 sec - exiting 07:34:04 (5056): No heartbeat from core client for 30 sec - exiting 07:34:05 (5056): No heartbeat from core client for 30 sec - exiting 07:34:06 (5056): No heartbeat from core client for 30 sec - exiting 07:34:07 (5056): No heartbeat from core client for 30 sec - exiting 07:34:08 (5056): No heartbeat from core client for 30 sec - exiting 07:34:09 (5056): No heartbeat from core client for 30 sec - exiting 07:34:10 (5056): No heartbeat from core client for 30 sec - exiting 07:34:11 (5056): No heartbeat from core client for 30 sec - exiting 07:34:12 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:45:36 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:39:27 (5132): No heartbeat from core client for 30 sec - exiting 07:39:28 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:29 (5132): No heartbeat from core client for 30 sec - exiting 07:39:30 (5132): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:14:30 (4276): No heartbeat from core client for 30 sec - exiting 09:14:31 (4276): No heartbeat from core client for 30 sec - exiting 09:14:32 (4276): No heartbeat from core client for 30 sec - exiting 09:14:33 (4276): No heartbeat from core client for 30 sec - exiting 09:14:34 (4276): No heartbeat from core client for 30 sec - exiting 09:14:35 (4276): No heartbeat from core client for 30 sec - exiting 09:14:36 (4276): No heartbeat from core client for 30 sec - exiting 09:14:37 (4276): No heartbeat from core client for 30 sec - exiting 09:14:38 (4276): No heartbeat from core client for 30 sec - exiting 09:14:39 (4276): No heartbeat from core client for 30 sec - exiting 09:14:40 (4276): No heartbeat from core client for 30 sec - exiting 09:14:41 (4276): No heartbeat from core client for 30 sec - exiting 09:14:42 (4276): No heartbeat from core client for 30 sec - exiting 09:14:43 (4276): No heartbeat from core client for 30 sec - exiting 09:14:44 (4276): No heartbeat from core client for 30 sec - exiting 09:14:45 (4276): No heartbeat from core client for 30 sec - exiting 09:14:46 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:50 (1836): No heartbeat from core client for 30 sec - exiting 08:07:52 (1836): No heartbeat from core client for 30 sec - exiting 08:07:53 (1836): No heartbeat from core client for 30 sec - exiting 08:07:54 (1836): No heartbeat from core client for 30 sec - exiting 08:07:55 (1836): No heartbeat from core client for 30 sec - exiting 08:07:56 (1836): No heartbeat from core client for 30 sec - exiting 08:07:57 (1836): No heartbeat from core client for 30 sec - exiting 08:07:58 (1836): No heartbeat from core client for 30 sec - exiting 08:07:59 (1836): No heartbeat from core client for 30 sec - exiting 08:08:00 (1836): No heartbeat from core client for 30 sec - exiting 08:08:01 (1836): No heartbeat from core client for 30 sec - exiting 08:08:02 (1836): No heartbeat from core client for 30 sec - exiting 08:08:03 (1836): No heartbeat from core client for 30 sec - exiting 08:08:04 (1836): No heartbeat from core client for 30 sec - exiting 08:08:05 (1836): No heartbeat from core client for 30 sec - exiting 08:08:06 (1836): No heartbeat from core client for 30 sec - exiting 08:08:07 (1836): No heartbeat from core client for 30 sec - exiting 08:08:08 (1836): No heartbeat from core client for 30 sec - exiting 08:08:09 (1836): No heartbeat from core client for 30 sec - exiting 08:08:10 (1836): No heartbeat from core client for 30 sec - exiting 08:08:11 (1836): No heartbeat from core client for 30 sec - exiting 08:08:12 (1836): No heartbeat from core client for 30 sec - exiting 08:08:13 (1836): No heartbeat from core client for 30 sec - exiting 08:08:14 (1836): No heartbeat from core client for 30 sec - exiting 08:08:15 (1836): No heartbeat from core client for 30 sec - exiting 08:08:16 (1836): No heartbeat from core client for 30 sec - exiting 08:08:17 (1836): No heartbeat from core client for 30 sec - exiting 08:08:18 (1836): No heartbeat from core client for 30 sec - exiting 08:08:19 (1836): No heartbeat from core client for 30 sec - exiting 08:08:20 (1836): No heartbeat from core client for 30 sec - exiting 08:08:21 (1836): No heartbeat from core client for 30 sec - exiting 08:08:22 (1836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:23 (1836): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:37:50 (5832): No heartbeat from core client for 30 sec - exiting 08:37:52 (5832): No heartbeat from core client for 30 sec - exiting 08:37:53 (5832): No heartbeat from core client for 30 sec - exiting 08:37:54 (5832): No heartbeat from core client for 30 sec - exiting 08:37:55 (5832): No heartbeat from core client for 30 sec - exiting 08:37:56 (5832): No heartbeat from core client for 30 sec - exiting 08:37:57 (5832): No heartbeat from core client for 30 sec - exiting 08:37:58 (5832): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:51 (3356): No heartbeat from core client for 30 sec - exiting 09:20:52 (3356): No heartbeat from core client for 30 sec - exiting 09:20:53 (3356): No heartbeat from core client for 30 sec - exiting 09:20:54 (3356): No heartbeat from core client for 30 sec - exiting 09:20:55 (3356): No heartbeat from core client for 30 sec - exiting 09:20:56 (3356): No heartbeat from core client for 30 sec - exiting 09:20:57 (3356): No heartbeat from core client for 30 sec - exiting 09:20:58 (3356): No heartbeat from core client for 30 sec - exiting 09:20:59 (3356): No heartbeat from core client for 30 sec - exiting 09:21:00 (3356): No heartbeat from core client for 30 sec - exiting 09:21:01 (3356): No heartbeat from core client for 30 sec - exiting 09:21:02 (3356): No heartbeat from core client for 30 sec - exiting 09:21:03 (3356): No heartbeat from core client for 30 sec - exiting 09:21:04 (3356): No heartbeat from core client for 30 sec - exiting 09:21:05 (3356): No heartbeat from core client for 30 sec - exiting 09:21:06 (3356): No heartbeat from core client for 30 sec - exiting 09:21:07 (3356): No heartbeat from core client for 30 sec - exiting 09:21:08 (3356): No heartbeat from core client for 30 sec - exiting 09:21:09 (3356): No heartbeat from core client for 30 sec - exiting 09:21:10 (3356): No heartbeat from core client for 30 sec - exiting 09:21:11 (3356): No heartbeat from core client for 30 sec - exiting 09:21:12 (3356): No heartbeat from core client for 30 sec - exiting 09:21:13 (3356): No heartbeat from core client for 30 sec - exiting 09:21:14 (3356): No heartbeat from core client for 30 sec - exiting 09:21:15 (3356): No heartbeat from core client for 30 sec - exiting 09:21:16 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Ocean Restart file copy failed on u4bbko.dan33q0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:34:48 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:08:42 (5864): No heartbeat from core client for 30 sec - exiting 08:08:43 (5864): No heartbeat from core client for 30 sec - exiting 08:08:44 (5864): No heartbeat from core client for 30 sec - exiting 08:08:45 (5864): No heartbeat from core client for 30 sec - exiting 08:08:47 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:48 (5864): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5396, iMonCtr=1 Model crash detected, will try to 07:56:08 (5160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/u4bbko.pjn9c10 Error converting file to netcdf: dataout/u4bbko.pin9c10 Error converting file to netcdf: dataout/u4bbko.pfn9c10 Error converting file to netcdf: dataout/u4bbka.phn9c10 Error converting file to netcdf: dataout/u4bbka.pgn9c10 Error converting file to netcdf: dataout/u4bbka.pen9c10 Error converting file to netcdf: dataout/u4bbka.pdn9c10 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:29:29 (5112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:29:31 (5112): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=10208, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7428, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:43:20 (5884): No heartbeat from core client for 30 sec - exiting 08:43:21 (5884): No heartbeat from core client for 30 sec - exiting 08:43:22 (5884): No heartbeat from core client for 30 sec - exiting 08:43:23 (5884): No heartbeat from core client for 30 sec - exiting 08:43:24 (5884): No heartbeat from core client for 30 sec - exiting 08:43:25 (5884): No heartbeat from core client for 30 sec - exiting 08:43:26 (5884): No heartbeat from core client for 30 sec - exiting 08:43:27 (5884): No heartbeat from core client for 30 sec - exiting 08:43:28 (5884): No heartbeat from core client for 30 sec - exiting 08:43:29 (5884): No heartbeat from core client for 30 sec - exiting 08:43:30 (5884): No heartbeat from core client for 30 sec - exiting 08:43:32 (5884): No heartbeat from core client for 30 sec - exiting 08:43:33 (5884): No heartbeat from core client for 30 sec - exiting 08:43:34 (5884): No heartbeat from core client for 30 sec - exiting 08:43:35 (5884): No heartbeat from core client for 30 sec - exiting 08:43:36 (5884): No heartbeat from core client for 30 sec - exiting 08:43:37 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:38 (5884): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:27:57 (5528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:44:38 (4876): No heartbeat from core client for 30 sec - exiting 07:44:39 (4876): No heartbeat from core client for 30 sec - exiting 07:44:42 (4876): No heartbeat from core client for 30 sec - exiting 07:44:43 (4876): No heartbeat from core client for 30 sec - exiting 07:44:44 (4876): No heartbeat from core client for 30 sec - exiting 07:44:45 (4876): No heartbeat from core client for 30 sec - exiting 07:44:46 (4876): No heartbeat from core client for 30 sec - exiting 07:44:47 (4876): No heartbeat from core client for 30 sec - exiting 07:44:48 (4876): No heartbeat from core client for 30 sec - exiting 07:44:49 (4876): No heartbeat from core client for 30 sec - exiting 07:44:50 (4876): No heartbeat from core client for 30 sec - exiting 07:44:51 (4876): No heartbeat from core client for 30 sec - exiting 07:44:52 (4876): No heartbeat from core client for 30 sec - exiting 07:44:53 (4876): No heartbeat from core client for 30 sec - exiting 07:44:54 (4876): No heartbeat from core client for 30 sec - exiting 07:44:55 (4876): No heartbeat from core client for 30 sec - exiting 07:44:56 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:44:57 (4876): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model c07:37:13 (4740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:44:41 (5288): No heartbeat from core client for 30 sec - exiting 07:44:42 (5288): No heartbeat from core client for 30 sec - exiting 07:44:43 (5288): No heartbeat from core client for 30 sec - exiting 07:44:44 (5288): No heartbeat from core client for 30 sec - exiting 07:44:45 (5288): No heartbeat from core client for 30 sec - exiting 07:44:46 (5288): No heartbeat from core client for 30 sec - exiting 07:44:47 (5288): No heartbeat from core client for 30 sec - exiting 07:44:48 (5288): No heartbeat from core client for 30 sec - exiting 07:44:49 (5288): No heartbeat from core client for 30 sec - exiting 07:44:50 (5288): No heartbeat from core client for 30 sec - exiting 07:44:51 (5288): No heartbeat from core client for 30 sec - exiting 07:44:52 (5288): No heartbeat from core client for 30 sec - exiting 07:44:53 (5288): No heartbeat from core client for 30 sec - exiting 07:44:55 (5288): No heartbeat from core client for 30 sec - exiting 07:44:56 (5288): No heartbeat from core client for 30 sec - exiting 07:44:57 (5288): No heartbeat from core client for 30 sec - exiting 07:44:58 (5288): No heartbeat from core client for 30 sec - exiting 07:44:59 (5288): No heartbeat from core client for 30 sec - exiting 07:45:00 (5288): No heartbeat from core client for 30 sec - exiting 07:45:01 (5288): No heartbeat from core client for 30 sec - exiting 07:45:02 (5288): No heartbeat from core client for 30 sec - exiting 07:45:03 (5288): No heartbeat from core client for 30 sec - exiting 07:45:04 (5288): No heartbeat from core client for 30 sec - exiting 07:45:05 (5288): No heartbeat from core client for 30 sec - exiting 07:45:06 (5288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:21:17 (5180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:45:18 (5572): No heartbeat from core client for 30 sec - exiting 08:45:19 (5572): No heartbeat from core client for 30 sec - exiting 08:45:20 (5572): No heartbeat from core client for 30 sec - exiting 08:45:21 (5572): No heartbeat from core client for 30 sec - exiting 08:45:22 (5572): No heartbeat from core client for 30 sec - exiting 08:45:23 (5572): No heartbeat from core client for 30 sec - exiting 08:45:24 (5572): No heartbeat from core client for 30 sec - exiting 08:45:25 (5572): No heartbeat from core client for 30 sec - exiting 08:45:26 (5572): No heartbeat from core client for 30 sec - exiting 08:45:27 (5572): No heartbeat from core client for 30 sec - exiting 08:45:28 (5572): No heartbeat from core client for 30 sec - exiting 08:45:29 (5572): No heartbeat from core client for 30 sec - exiting 08:45:30 (5572): No heartbeat from core client for 30 sec - exiting 08:45:31 (5572): No heartbeat from core client for 30 sec - exiting 08:45:32 (5572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3304, iMonCtr=1 Model crash detected, will try to restart... 08:50:36 (5724): No heartbeat from core client for 30 sec - exiting 08:50:37 (5724): No heartbeat from core client for 30 sec - exiting 08:50:38 (5724): No heartbeat from core client for 30 sec - exiting 08:50:39 (5724): No heartbeat from core client for 30 sec - exiting 08:50:40 (5724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5108, iMonCtr=1 Model crash detected, will try to restart... 07:39:21 (5720): No heartbeat from core client for 30 sec - exiting 07:39:22 (5720): No heartbeat from core client for 30 sec - exiting 07:39:23 (5720): No heartbeat from core client for 30 sec - exiting 07:39:24 (5720): No heartbeat from core client for 30 sec - exiting 07:39:25 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:42:39 (5916): No heartbeat from core client for 30 sec - exiting 07:42:40 (5916): No heartbeat from core client for 30 sec - exiting 07:42:41 (5916): No heartbeat from core client for 30 sec - exiting 07:42:42 (5916): No heartbeat from core client for 30 sec - exiting 07:42:43 (5916): No heartbeat from core client for 30 sec - exiting 07:42:44 (5916): No heartbeat from core client for 30 sec - exiting 07:42:45 (5916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:46 (5916): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 07:35:50 (5852): No heartbeat from core client for 30 sec - exiting 07:35:51 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:52 (5852): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 May 2013 22:52:06	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	1,036,800	1,366,224	1.3177
30 May 2013 11:50:42	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	1,010,880	1,332,543	1.3182
29 May 2013 12:44:18	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	984,960	1,298,418	1.3182
28 May 2013 13:15:25	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	959,040	1,263,876	1.3179
27 May 2013 16:37:03	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	933,120	1,230,131	1.3183
26 May 2013 18:45:50	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	907,200	1,197,677	1.3202
26 May 2013 09:55:30	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	881,280	1,166,134	1.3232
25 May 2013 10:52:46	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	855,360	1,132,409	1.3239
24 May 2013 11:23:44	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	829,440	1,098,389	1.3243
23 May 2013 09:53:27	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	803,520	1,064,673	1.3250
22 May 2013 10:44:04	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	777,600	1,030,433	1.3251
21 May 2013 12:54:32	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	751,680	996,335	1.3255
20 May 2013 12:37:11	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	725,760	961,495	1.3248
19 May 2013 16:55:24	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	699,840	927,381	1.3251
18 May 2013 18:07:21	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	673,920	893,538	1.3259
18 May 2013 08:48:36	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	648,000	859,798	1.3268
17 May 2013 11:51:31	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	622,080	824,724	1.3258
16 May 2013 11:28:17	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	596,160	790,709	1.3263
15 May 2013 14:57:41	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	570,240	756,737	1.3271
14 May 2013 15:56:23	1267124	15743238	hadcm3n_u4bb_2020_40_008337925_1	544,320	722,100	1.3266