climateprediction.net home page
Task 15457887

Task 15457887

Name hadcm3n_zf6r_1880_40_008252763_0
Workunit 8407887
Created 23 Nov 2012, 15:47:47 UTC
Sent 23 Nov 2012, 15:58:06 UTC
Report deadline 22 Feb 2013, 23:25:17 UTC
Received 3 Jun 2013, 8:45:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1227579
Run time 17 days 18 hours 31 min 13 sec
CPU time 17 days 1 hours 47 min 20 sec
Validate state Invalid
Credit 8,709.12
Device peak FLOPS 2.17 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.64</core_client_version>
<![CDATA[
<message>
The device does not recognize the command.
 (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4856, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3760, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1
Model crash detected, will try to restart...
13:37:37 (4524): No heartbeat from core client for 30 sec - exiting
13:37:38 (4524): No heartbeat from core client for 30 sec - exiting
13:37:39 (4524): No heartbeat from core client for 30 sec - exiting
13:37:40 (4524): No heartbeat from core client for 30 sec - exiting
13:37:41 (4524): No heartbeat from core client for 30 sec - exiting
13:37:42 (4524): No heartbeat from core client for 30 sec - exiting
13:37:43 (4524): No heartbeat from core client for 30 sec - exiting
13:37:44 (4524): No heartbeat from core client for 30 sec - exiting
13:37:45 (4524): No heartbeat from core client for 30 sec - exiting
13:37:46 (4524): No heartbeat from core client for 30 sec - exiting
13:37:47 (4524): No heartbeat from core client for 30 sec - exiting
13:37:48 (4524): No heartbeat from core client for 30 sec - exiting
13:37:49 (4524): No heartbeat from core client for 30 sec - exiting
13:37:50 (4524): No heartbeat from core client for 30 sec - exiting
13:37:51 (4524): No heartbeat from core client for 30 sec - exiting
13:37:52 (4524): No heartbeat from core client for 30 sec - exiting
13:37:53 (4524): No heartbeat from core client for 30 sec - exiting
13:37:54 (4524): No heartbeat from core client for 30 sec - exiting
13:37:55 (4524): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:36:58 (4280): No heartbeat from core client for 30 sec - exiting
13:36:59 (4280): No heartbeat from core client for 30 sec - exiting
13:37:00 (4280): No heartbeat from core client for 30 sec - exiting
13:37:01 (4280): No heartbeat from core client for 30 sec - exiting
13:37:02 (4280): No heartbeat from core client for 30 sec - exiting
13:37:03 (4280): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:37:05 (4280): No heartbeat from core client for 30 sec - exiting
14:03:23 (4472): No heartbeat from core client for 30 sec - exiting
14:03:24 (4472): No heartbeat from core client for 30 sec - exiting
14:03:25 (4472): No heartbeat from core client for 30 sec - exiting
14:03:26 (4472): No heartbeat from core client for 30 sec - exiting
14:03:27 (4472): No heartbeat from core client for 30 sec - exiting
14:03:28 (4472): No heartbeat from core client for 30 sec - exiting
14:03:29 (4472): No heartbeat from core client for 30 sec - exiting
14:03:30 (4472): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5492, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
13:36:47 (4468): No heartbeat from core client for 30 sec - exiting
13:36:48 (4468): No heartbeat from core client for 30 sec - exiting
13:36:49 (4468): No heartbeat from core client for 30 sec - exiting
13:36:50 (4468): No heartbeat from core client for 30 sec - exiting
13:36:51 (4468): No heartbeat from core client for 30 sec - exiting
13:36:52 (4468): No heartbeat from core client for 30 sec - exiting
13:36:53 (4468): No heartbeat from core client for 30 sec - exiting
13:36:54 (4468): No heartbeat from core client for 30 sec - exiting
13:36:55 (4468): No heartbeat from core client for 30 sec - exiting
13:36:56 (4468): No heartbeat from core client for 30 sec - exiting
13:36:57 (4468): No heartbeat from core client for 30 sec - exiting
13:36:58 (4468): No heartbeat from core client for 30 sec - exiting
13:36:59 (4468): No heartbeat from core client for 30 sec - exiting
13:37:00 (4468): No heartbeat from core client for 30 sec - exiting
13:37:01 (4468): No heartbeat from core client for 30 sec - exiting
13:37:02 (4468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4384, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4476, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5092, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4784, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4464, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4276, iMonCtr=1
Model crash detected, will try to restart...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/zf6rko.pj86c10
Error converting file to netcdf: dataout/zf6rko.pi86c10
Error converting file to netcdf: dataout/zf6rko.pf86c10
Error converting file to netcdf: dataout/zf6rka.ph86c10
Error converting file to netcdf: dataout/zf6rka.pg86c10
Error converting file to netcdf: dataout/zf6rka.pe86c10
Error converting file to netcdf: dataout/zf6rka.pd86c10
09:39:42 (4204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:10 (4408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4416, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3688, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3604, iMonCtr=1
Model crash detected, will try to restart...
Atmos Hold Restart file rename failed on atmos_restart.hold
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6120, iMonCtr=1
Model crash detected, will try to restart...
14:20:39 (4680): No heartbeat from core client for 30 sec - exiting
14:20:40 (4680): No heartbeat from core client for 30 sec - exiting
14:20:41 (4680): No heartbeat from core client for 30 sec - exiting
14:20:42 (4680): No heartbeat from core client for 30 sec - exiting
14:20:43 (4680): No heartbeat from core client for 30 sec - exiting
14:20:44 (4680): No heartbeat from core client for 30 sec - exiting
14:20:45 (4680): No heartbeat from core client for 30 sec - exiting
14:20:46 (4680): No heartbeat from core client for 30 sec - exiting
14:20:47 (4680): No heartbeat from core client for 30 sec - exiting
14:20:48 (4680): No heartbeat from core client for 30 sec - exiting
14:20:49 (4680): No heartbeat from core client for 30 sec - exiting
14:20:51 (4680): No heartbeat from core client for 30 sec - exiting
14:20:52 (4680): No heartbeat from core client for 30 sec - exiting
14:20:53 (4680): No heartbeat from core client for 30 sec - exiting
14:20:54 (4680): No heartbeat from core client for 30 sec - exiting
14:20:55 (4680): No heartbeat from core client for 30 sec - exiting
14:20:56 (4680): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3796, iMonCtr=1
Model crash detected, will try to restart...
13:48:51 (5616): No heartbeat from core client for 30 sec - exiting
13:48:52 (5616): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:30:17 (5060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:01:18 (4544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:18:29 (3892): No heartbeat from core client for 30 sec - exiting
13:18:30 (3892): No heartbeat from core client for 30 sec - exiting
13:18:31 (3892): No heartbeat from core client for 30 sec - exiting
13:18:32 (3892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4080, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4080, iMonCtr=1
Model crash detected, will try to restart...
10:30:29 (4848): No heartbeat from core client for 30 sec - exiting
10:30:30 (4848): No heartbeat from core client for 30 sec - exiting
10:30:31 (4848): No heartbeat from core client for 30 sec - exiting
10:30:32 (4848): No heartbeat from core client for 30 sec - exiting
10:30:33 (4848): No heartbeat from core client for 30 sec - exiting
10:30:34 (4848): No heartbeat from core client for 30 sec - exiting
10:30:35 (4848): No heartbeat from core client for 30 sec - exiting
10:30:36 (4848): No heartbeat from core client for 30 sec - exiting
10:30:37 (4848): No heartbeat from core client for 30 sec - exiting
10:30:38 (4848): No heartbeat from core client for 30 sec - exiting
10:30:39 (4848): No heartbeat from core client for 30 sec - exiting
10:30:40 (4848): No heartbeat from core client for 30 sec - exiting
10:30:41 (4848): No heartbeat from core client for 30 sec - exiting
10:30:42 (4848): No heartbeat from core client for 30 sec - exiting
10:30:43 (4848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3644, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4196, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4976, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3952, iMonCtr=1
Model crash detected, will try to restart...
13:37:25 (4468): No heartbeat from core client for 30 sec - exiting
13:37:26 (4468): No heartbeat from core client for 30 sec - exiting
13:37:27 (4468): No heartbeat from core client for 30 sec - exiting
13:37:28 (4468): No heartbeat from core client for 30 sec - exiting
13:37:29 (4468): No heartbeat from core client for 30 sec - exiting
13:37:30 (4468): No heartbeat from core client for 30 sec - exiting
13:37:31 (4468): No heartbeat from core client for 30 sec - exiting
13:37:32 (4468): No heartbeat from core client for 30 sec - exiting
13:37:33 (4468): No heartbeat from core client for 30 sec - exiting
13:37:34 (4468): No heartbeat from core client for 30 sec - exiting
13:37:35 (4468): No heartbeat from core client for 30 sec - exiting
13:37:36 (4468): No heartbeat from core client for 30 sec - exiting
13:37:37 (4468): No heartbeat from core client for 30 sec - exiting
13:37:39 (4468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4272, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4248, iMonCtr=1
Model crash detected, will try to restart...
16:06:02 (4588): No heartbeat from core client for 30 sec - exiting
16:06:03 (4588): No heartbeat from core client for 30 sec - exiting
16:06:04 (4588): No heartbeat from core client for 30 sec - exiting
16:06:05 (4588): No heartbeat from core client for 30 sec - exiting
16:06:06 (4588): No heartbeat from core client for 30 sec - exiting
16:06:07 (4588): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4432, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4560, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4324, iMonCtr=1
Model crash detected, will try to restart...
11:58:40 (4800): No heartbeat from core client for 30 sec - exiting
11:58:41 (4800): No heartbeat from core client for 30 sec - exiting
11:58:42 (4800): No heartbeat from core client for 30 sec - exiting
11:58:43 (4800): No heartbeat from core client for 30 sec - exiting
11:58:44 (4800): No heartbeat from core client for 30 sec - exiting
11:58:45 (4800): No heartbeat from core client for 30 sec - exiting
11:58:47 (4800): No heartbeat from core client for 30 sec - exiting
11:58:48 (4800): No heartbeat from core client for 30 sec - exiting
11:58:49 (4800): No heartbeat from core client for 30 sec - exiting
11:58:50 (4800): No heartbeat from core client for 30 sec - exiting
11:58:51 (4800): No heartbeat from core client for 30 sec - exiting
11:58:52 (4800): No heartbeat from core client for 30 sec - exiting
11:58:53 (4800): No heartbeat from core client for 30 sec - exiting
11:58:54 (4800): No heartbeat from core client for 30 sec - exiting
11:58:55 (4800): No heartbeat from core client for 30 sec - exiting
11:58:56 (4800): No heartbeat from core client for 30 sec - exiting
11:58:57 (4800): No heartbeat from core client for 30 sec - exiting
11:58:58 (4800): No heartbeat from core client for 30 sec - exiting
11:58:59 (4800): No heartbeat from core client for 30 sec - exiting
11:59:00 (4800): No heartbeat from core client for 30 sec - exiting
11:59:01 (4800): No heartbeat from core client for 30 sec - exiting
11:59:02 (4800): No heartbeat from core client for 30 sec - exiting
11:59:03 (4800): No heartbeat from core client for 30 sec - exiting
11:59:04 (4800): No heartbeat from core client for 30 sec - exiting
11:59:05 (4800): No heartbeat from core client for 30 sec - exiting
11:59:06 (4800): No heartbeat from core client for 30 sec - exiting
11:59:07 (4800): No heartbeat from core client for 30 sec - exiting
11:59:08 (4800): No heartbeat from core client for 30 sec - exiting
11:59:09 (4800): No heartbeat from core client for 30 sec - exiting
11:59:10 (4800): No heartbeat from core client for 30 sec - exiting
11:59:11 (4800): No heartbeat from core client for 30 sec - exiting
11:59:12 (4800): No heartbeat from core client for 30 sec - exiting
11:59:13 (4800): No heartbeat from core client for 30 sec - exiting
11:59:15 (4800): No heartbeat from core client for 30 sec - exiting
11:59:16 (4800): No heartbeat from core client for 30 sec - exiting
11:59:17 (4800): No heartbeat from core client for 30 sec - exiting
11:59:18 (4800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:07:00 (1712): No heartbeat from core client for 30 sec - exiting
09:07:02 (1712): No heartbeat from core client for 30 sec - exiting
09:07:03 (1712): No heartbeat from core client for 30 sec - exiting
09:07:04 (1712): No heartbeat from core client for 30 sec - exiting
09:07:05 (1712): No heartbeat from core client for 30 sec - exiting
09:07:06 (1712): No heartbeat from core client for 30 sec - exiting
09:07:07 (1712): No heartbeat from core client for 30 sec - exiting
09:07:08 (1712): No heartbeat from core client for 30 sec - exiting
09:07:09 (1712): No heartbeat from core client for 30 sec - exiting
09:07:10 (1712): No heartbeat from core client for 30 sec - exiting
09:07:11 (1712): No heartbeat from core client for 30 sec - exiting
09:07:12 (1712): No heartbeat from core client for 30 sec - exiting
09:07:13 (1712): No heartbeat from core client for 30 sec - exiting
09:07:14 (1712): No heartbeat from core client for 30 sec - exiting
09:07:15 (1712): No heartbeat from core client for 30 sec - exiting
09:07:16 (1712): No heartbeat from core client for 30 sec - exiting
09:07:17 (1712): No heartbeat from core client for 30 sec - exiting
09:07:18 (1712): No heartbeat from core client for 30 sec - exiting
09:07:19 (1712): No heartbeat from core client for 30 sec - exiting
09:07:20 (1712): No heartbeat from core client for 30 sec - exiting
09:07:21 (1712): No heartbeat from core client for 30 sec - exiting
09:07:22 (1712): No heartbeat from core client for 30 sec - exiting
09:07:23 (1712): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:43:14 (4416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:47:06 (4608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:06:38 (3564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:38:39 (4504): No heartbeat from core client for 30 sec - exiting
14:38:40 (4504): No heartbeat from core client for 30 sec - exiting
14:38:41 (4504): No heartbeat from core client for 30 sec - exiting
14:38:42 (4504): No heartbeat from core client for 30 sec - exiting
14:38:43 (4504): No heartbeat from core client for 30 sec - exiting
14:38:44 (4504): No heartbeat from core client for 30 sec - exiting
14:38:46 (4504): No heartbeat from core client for 30 sec - exiting
14:38:47 (4504): No heartbeat from core client for 30 sec - exiting
14:38:48 (4504): No heartbeat from core client for 30 sec - exiting
14:38:49 (4504): No heartbeat from core client for 30 sec - exiting
14:38:50 (4504): No heartbeat from core client for 30 sec - exiting
14:38:51 (4504): No heartbeat from core client for 30 sec - exiting
14:38:52 (4504): No heartbeat from core client for 30 sec - exiting
14:38:53 (4504): No heartbeat from core client for 30 sec - exiting
14:38:54 (4504): No heartbeat from core client for 30 sec - exiting
14:38:55 (4504): No heartbeat from core client for 30 sec - exiting
14:38:56 (4504): No heartbeat from core client for 30 sec - exiting
14:38:57 (4504): No heartbeat from core client for 30 sec - exiting
14:38:58 (4504): No heartbeat from core client for 30 sec - exiting
14:38:59 (4504): No heartbeat from core client for 30 sec - exiting
14:39:00 (4504): No heartbeat from core client for 30 sec - exiting
14:39:01 (4504): No heartbeat from core client for 30 sec - exiting
14:39:02 (4504): No heartbeat from core client for 30 sec - exiting
14:39:03 (4504): No heartbeat from core client for 30 sec - exiting
14:39:04 (4504): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:50:27 (4956): No heartbeat from core client for 30 sec - exiting
13:50:28 (4956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:04:34 (5000): No heartbeat from core client for 30 sec - exiting
10:04:35 (5000): No heartbeat from core client for 30 sec - exiting
10:04:36 (5000): No heartbeat from core client for 30 sec - exiting
10:04:37 (5000): No heartbeat from core client for 30 sec - exiting
10:04:38 (5000): No heartbeat from core client for 30 sec - exiting
10:04:39 (5000): No heartbeat from core client for 30 sec - exiting
10:04:40 (5000): No heartbeat from core client for 30 sec - exiting
10:04:41 (5000): No heartbeat from core client for 30 sec - exiting
10:04:42 (5000): No heartbeat from core client for 30 sec - exiting
10:04:43 (5000): No heartbeat from core client for 30 sec - exiting
10:04:44 (5000): No heartbeat from core client for 30 sec - exiting
10:04:45 (5000): No heartbeat from core client for 30 sec - exiting
10:04:46 (5000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:04:47 (5000): No heartbeat from core client for 30 sec - exiting
13:43:51 (3860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5676, iMonCtr=1
Model crash detected, will try to restart...
09:51:02 (4408): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:39 (4544): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:04:31 (3584): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4848, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4632, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4004, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5564, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5564, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5072, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4816, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3804, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5552, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4160, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
18:31:32 (4256): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:50:11 (5040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:25:38 (4868): No heartbeat from core client for 30 sec - exiting
14:25:39 (4868): No heartbeat from core client for 30 sec - exiting
14:25:40 (4868): No heartbeat from core client for 30 sec - exiting
14:25:41 (4868): No heartbeat from core client for 30 sec - exiting
14:25:42 (4868): No heartbeat from core client for 30 sec - exiting
14:25:43 (4868): No heartbeat from core client for 30 sec - exiting
14:25:44 (4868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1
Model crash detected, will try to restart...
18:06:25 (4928): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
C09:56:09 (2780): No heartbeat from core client for 30 sec - exiting
09:56:10 (2780): No heartbeat from core client for 30 sec - exiting
09:56:11 (2780): No heartbeat from core client for 30 sec - exiting
09:56:12 (2780): No heartbeat from core client for 30 sec - exiting
09:56:13 (2780): No heartbeat from core client for 30 sec - exiting
09:56:14 (2780): No heartbeat from core client for 30 sec - exiting
09:56:15 (2780): No heartbeat from core client for 30 sec - exiting
09:56:16 (2780): No heartbeat from core client for 30 sec - exiting
09:56:18 (2780): No heartbeat from core client for 30 sec - exiting
09:56:19 (2780): No heartbeat from core client for 30 sec - exiting
09:56:20 (2780): No heartbeat from core client for 30 sec - exiting
09:56:21 (2780): No heartbeat from core client for 30 sec - exiting
09:56:22 (2780): No heartbeat from core client for 30 sec - exiting
09:56:23 (2780): No heartbeat from core client for 30 sec - exiting
09:56:24 (2780): No heartbeat from core client for 30 sec - exiting
09:56:25 (2780): No heartbeat from core client for 30 sec - exiting
09:56:26 (2780): No heartbeat from core client for 30 sec - exiting
09:56:27 (2780): No heartbeat from core client for 30 sec - exiting
09:56:28 (2780): No heartbeat from core client for 30 sec - exiting
09:56:29 (2780): No heartbeat from core client for 30 sec - exiting
09:56:30 (2780): No heartbeat from core client for 30 sec - exiting
09:56:31 (2780): No heartbeat from core client for 30 sec - exiting
09:56:32 (2780): No heartbeat from core client for 30 sec - exiting
09:56:33 (2780): No heartbeat from core client for 30 sec - exiting
09:56:34 (2780): No heartbeat from core client for 30 sec - exiting
09:56:35 (2780): No heartbeat from core client for 30 sec - exiting
09:56:36 (2780): No heartbeat from core client for 30 sec - exiting
09:56:37 (2780): No heartbeat from core client for 30 sec - exiting
09:56:38 (2780): No heartbeat from core client for 30 sec - exiting
09:56:39 (2780): No heartbeat from core client for 30 sec - exiting
09:56:40 (2780): No heartbeat from core client for 30 sec - exiting
09:56:41 (2780): No heartbeat from core client for 30 sec - exiting
09:56:42 (2780): No heartbeat from core client for 30 sec - exiting
09:56:43 (2780): No heartbeat from core client for 30 sec - exiting
09:56:44 (2780): No heartbeat from core client for 30 sec - exiting
09:56:45 (2780): No heartbeat from core client for 30 sec - exiting
09:56:46 (2780): No heartbeat from core client for 30 sec - exiting
09:56:47 (2780): No heartbeat from core client for 30 sec - exiting
09:56:48 (2780): No heartbeat from core client for 30 sec - exiting
09:56:49 (2780): No heartbeat from core client for 30 sec - exiting
09:56:50 (2780): No heartbeat from core client for 30 sec - exiting
09:56:51 (2780): No heartbeat from core client for 30 sec - exiting
09:56:52 (2780): No heartbeat from core client for 30 sec - exiting
09:56:53 (2780): No heartbeat from core client for 30 sec - exiting
09:56:55 (2780): No heartbeat from core client for 30 sec - exiting
09:56:56 (2780): No heartbeat from core client for 30 sec - exiting
09:56:57 (2780): No heartbeat from core client for 30 sec - exiting
09:56:58 (2780): No heartbeat from core client for 30 sec - exiting
09:56:59 (2780): No heartbeat from core client for 30 sec - exiting
09:57:00 (2780): No heartbeat from core client for 30 sec - exiting
09:57:01 (2780): No heartbeat from core client for 30 sec - exiting
09:57:02 (2780): No heartbeat from core client for 30 sec - exiting
09:57:03 (2780): No heartbeat from core client for 30 sec - exiting
09:57:04 (2780): No heartbeat from core client for 30 sec - exiting
09:57:05 (2780): No heartbeat from core client for 30 sec - exiting
09:57:06 (2780): No heartbeat from core client for 30 sec - exiting
09:57:07 (2780): No heartbeat from core client for 30 sec - exiting
09:57:08 (2780): No heartbeat from core client for 30 sec - exiting
09:57:09 (2780): No heartbeat from core client for 30 sec - exiting
09:57:10 (2780): No heartbeat from core client for 30 sec - exiting
09:57:11 (2780): No heartbeat from core client for 30 sec - exiting
09:57:12 (2780): No heartbeat from core client for 30 sec - exiting
09:57:13 (2780): No heartbeat from core client for 30 sec - exiting
09:57:14 (2780): No heartbeat from core client for 30 sec - exiting
09:57:15 (2780): No heartbeat from core client for 30 sec - exiting
09:57:16 (2780): No heartbeat from core client for 30 sec - exiting
09:57:17 (2780): No heartbeat from core client for 30 sec - exiting
09:57:18 (2780): No heartbeat from core client for 30 sec - exiting
09:57:19 (2780): No heartbeat from core client for 30 sec - exiting
09:57:20 (2780): No heartbeat from core client for 30 sec - exiting
09:57:21 (2780): No heartbeat from core client for 30 sec - exiting
09:57:22 (2780): No heartbeat from core client for 30 sec - exiting
09:57:23 (2780): No heartbeat from core client for 30 sec - exiting
09:57:24 (2780): No heartbeat from core client for 30 sec - exiting
09:57:25 (2780): No heartbeat from core client for 30 sec - exiting
09:57:26 (2780): No heartbeat from core client for 30 sec - exiting
09:57:27 (2780): No heartbeat from core client for 30 sec - exiting
09:57:28 (2780): No heartbeat from core client for 30 sec - exiting
09:57:29 (2780): No heartbeat from core client for 30 sec - exiting
09:57:30 (2780): No heartbeat from core client for 30 sec - exiting
09:57:31 (2780): No heartbeat from core client for 30 sec - exiting
09:57:32 (2780): No heartbeat from core client for 30 sec - exiting
09:57:33 (2780): No heartbeat from core client for 30 sec - exiting
09:57:34 (2780): No heartbeat from core client for 30 sec - exiting
09:57:35 (2780): No heartbeat from core client for 30 sec - exiting
09:57:36 (2780): No heartbeat from core client for 30 sec - exiting
09:57:37 (2780): No heartbeat from core client for 30 sec - exiting
09:57:38 (2780): No heartbeat from core client for 30 sec - exiting
09:57:39 (2780): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:26:23 (5112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
14:35:50 (4556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:57 (2856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:05:41 (4916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:38 (5428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:08:39 (5308): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4644, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4684, iMonCtr=1
Model crash detected, will try to restart...
14:10:35 (4816): No heartbeat from core client for 30 sec - exiting
14:10:36 (4816): No heartbeat from core client for 30 sec - exiting
14:10:38 (4816): No heartbeat from core client for 30 sec - exiting
14:10:39 (4816): No heartbeat from core client for 30 sec - exiting
14:10:40 (4816): No heartbeat from core client for 30 sec - exiting
14:10:41 (4816): No heartbeat from core client for 30 sec - exiting
14:10:42 (4816): No heartbeat from core client for 30 sec - exiting
14:10:43 (4816): No heartbeat from core client for 30 sec - exiting
14:10:44 (4816): No heartbeat from core client for 30 sec - exiting
14:10:45 (4816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4316, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3628, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 May 2013 14:55:01 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 725,760 1,440,090 1.9843
23 May 2013 15:45:36 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 699,840 1,393,571 1.9913
16 May 2013 13:39:08 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 673,920 1,341,505 1.9906
12 May 2013 14:05:08 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 648,000 1,290,034 1.9908
03 May 2013 14:50:28 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 622,080 1,240,251 1.9937
26 Apr 2013 20:02:37 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 596,160 1,185,769 1.9890
23 Apr 2013 08:54:06 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 570,240 1,133,219 1.9873
12 Apr 2013 14:45:38 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 544,320 1,081,455 1.9868
10 Apr 2013 10:58:57 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 518,400 1,029,829 1.9866
03 Apr 2013 15:40:46 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 492,480 979,433 1.9888
27 Mar 2013 09:42:41 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 466,560 930,887 1.9952
21 Mar 2013 10:29:39 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 440,640 880,878 1.9991
12 Mar 2013 18:11:34 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 414,720 831,357 2.0046
05 Mar 2013 16:45:50 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 388,800 780,251 2.0068
25 Feb 2013 15:41:57 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 362,880 722,677 1.9915
22 Feb 2013 15:20:33 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 336,960 662,649 1.9666
15 Feb 2013 16:20:50 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 311,040 609,883 1.9608
09 Feb 2013 15:50:45 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 285,120 558,975 1.9605
04 Feb 2013 14:05:31 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 259,200 511,375 1.9729
25 Jan 2013 11:45:51 1227579 15457887 hadcm3n_zf6r_1880_40_008252763_0 233,280 455,665 1.9533


©2024 climateprediction.net