climateprediction.net home page
Task 15808445

Task 15808445

Name hadcm3n_n6sb_1960_40_008378593_0
Workunit 8529452
Created 30 May 2013, 21:13:19 UTC
Sent 30 May 2013, 22:19:48 UTC
Report deadline 30 Aug 2013, 5:46:59 UTC
Received 1 Jun 2013, 5:26:01 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1282401
Run time 1 days 1 hours 25 min 45 sec
CPU time 1 days 0 hours 49 min 49 sec
Validate state Invalid
Credit 311.04
Device peak FLOPS 1.99 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.27</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
03:14:02 (52260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:18:13 (54409): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
03:24:29 (54601): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:24:30 (54601): No heartbeat from core client for 30 sec - exiting
03:24:31 (54601): No heartbeat from core client for 30 sec - exiting
03:24:32 (54601): No heartbeat from core client for 30 sec - exiting
03:24:33 (54601): No heartbeat from core client for 30 sec - exiting
03:24:34 (54601): No heartbeat from core client for 30 sec - exiting
03:37:01 (54729): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:29 (54941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:41:30 (54941): No heartbeat from core client for 30 sec - exiting
03:41:31 (54941): No heartbeat from core client for 30 sec - exiting
03:41:32 (54941): No heartbeat from core client for 30 sec - exiting
03:58:24 (55097): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:00 (55384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:03:05 (55384): No heartbeat from core client for 30 sec - exiting
04:07:30 (55571): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:07:39 (55571): No heartbeat from core client for 30 sec - exiting
04:11:41 (55754): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:11:42 (55754): No heartbeat from core client for 30 sec - exiting
04:11:43 (55754): No heartbeat from core client for 30 sec - exiting
04:11:44 (55754): No heartbeat from core client for 30 sec - exiting
04:11:45 (55754): No heartbeat from core client for 30 sec - exiting
04:11:46 (55754): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
06:42:20 (55933): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:45:51 (57397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
06:58:35 (57560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:12:06 (57770): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:24:11 (59338): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:24:12 (59338): No heartbeat from core client for 30 sec - exiting
11:24:13 (59338): No heartbeat from core client for 30 sec - exiting
11:24:14 (59338): No heartbeat from core client for 30 sec - exiting
11:24:15 (59338): No heartbeat from core client for 30 sec - exiting
11:24:16 (59338): No heartbeat from core client for 30 sec - exiting
11:24:17 (59338): No heartbeat from core client for 30 sec - exiting
11:24:18 (59338): No heartbeat from core client for 30 sec - exiting
11:24:19 (59338): No heartbeat from core client for 30 sec - exiting
11:24:20 (59338): No heartbeat from core client for 30 sec - exiting
11:24:21 (59338): No heartbeat from core client for 30 sec - exiting
11:24:22 (59338): No heartbeat from core client for 30 sec - exiting
11:28:48 (60582): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:28:49 (60582): No heartbeat from core client for 30 sec - exiting
11:28:50 (60582): No heartbeat from core client for 30 sec - exiting
11:28:51 (60582): No heartbeat from core client for 30 sec - exiting
11:28:52 (60582): No heartbeat from core client for 30 sec - exiting
11:28:53 (60582): No heartbeat from core client for 30 sec - exiting
11:28:54 (60582): No heartbeat from core client for 30 sec - exiting
11:28:55 (60582): No heartbeat from core client for 30 sec - exiting
11:28:56 (60582): No heartbeat from core client for 30 sec - exiting
11:28:57 (60582): No heartbeat from core client for 30 sec - exiting
11:28:58 (60582): No heartbeat from core client for 30 sec - exiting
11:28:59 (60582): No heartbeat from core client for 30 sec - exiting
11:33:44 (60737): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:45 (60737): No heartbeat from core client for 30 sec - exiting
11:33:46 (60737): No heartbeat from core client for 30 sec - exiting
11:33:47 (60737): No heartbeat from core client for 30 sec - exiting
11:33:48 (60737): No heartbeat from core client for 30 sec - exiting
11:33:49 (60737): No heartbeat from core client for 30 sec - exiting
11:33:50 (60737): No heartbeat from core client for 30 sec - exiting
11:33:51 (60737): No heartbeat from core client for 30 sec - exiting
11:33:52 (60737): No heartbeat from core client for 30 sec - exiting
11:33:53 (60737): No heartbeat from core client for 30 sec - exiting
11:33:54 (60737): No heartbeat from core client for 30 sec - exiting
11:38:10 (60903): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:38:11 (60903): No heartbeat from core client for 30 sec - exiting
11:38:12 (60903): No heartbeat from core client for 30 sec - exiting
11:38:13 (60903): No heartbeat from core client for 30 sec - exiting
11:38:14 (60903): No heartbeat from core client for 30 sec - exiting
11:38:15 (60903): No heartbeat from core client for 30 sec - exiting
11:38:16 (60903): No heartbeat from core client for 30 sec - exiting
11:38:17 (60903): No heartbeat from core client for 30 sec - exiting
11:38:18 (60903): No heartbeat from core client for 30 sec - exiting
11:38:19 (60903): No heartbeat from core client for 30 sec - exiting
11:38:20 (60903): No heartbeat from core client for 30 sec - exiting
11:38:21 (60903): No heartbeat from core client for 30 sec - exiting
11:38:22 (60903): No heartbeat from core client for 30 sec - exiting
11:38:23 (60903): No heartbeat from core client for 30 sec - exiting
11:38:24 (60903): No heartbeat from core client for 30 sec - exiting
11:38:25 (60903): No heartbeat from core client for 30 sec - exiting
11:38:26 (60903): No heartbeat from core client for 30 sec - exiting
13:10:59 (61081): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:11:00 (61081): No heartbeat from core client for 30 sec - exiting
13:11:01 (61081): No heartbeat from core client for 30 sec - exiting
13:11:02 (61081): No heartbeat from core client for 30 sec - exiting
13:11:03 (61081): No heartbeat from core client for 30 sec - exiting
13:11:04 (61081): No heartbeat from core client for 30 sec - exiting
13:11:05 (61081): No heartbeat from core client for 30 sec - exiting
13:11:06 (61081): No heartbeat from core client for 30 sec - exiting
13:11:07 (61081): No heartbeat from core client for 30 sec - exiting
13:11:08 (61081): No heartbeat from core client for 30 sec - exiting
13:11:09 (61081): No heartbeat from core client for 30 sec - exiting
13:11:10 (61081): No heartbeat from core client for 30 sec - exiting
13:14:42 (61965): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:14:43 (61965): No heartbeat from core client for 30 sec - exiting
15:37:05 (62072): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
17:16:06 (63430): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:28 (64378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:20:29 (64378): No heartbeat from core client for 30 sec - exiting
17:20:30 (64378): No heartbeat from core client for 30 sec - exiting
17:20:31 (64378): No heartbeat from core client for 30 sec - exiting
17:20:32 (64378): No heartbeat from core client for 30 sec - exiting
17:20:33 (64378): No heartbeat from core client for 30 sec - exiting
17:20:34 (64378): No heartbeat from core client for 30 sec - exiting
17:20:35 (64378): No heartbeat from core client for 30 sec - exiting
17:20:36 (64378): No heartbeat from core client for 30 sec - exiting
17:24:54 (64570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:04:59 (64722): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:00 (64722): No heartbeat from core client for 30 sec - exiting
20:05:01 (64722): No heartbeat from core client for 30 sec - exiting
20:09:33 (1012): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:34 (1012): No heartbeat from core client for 30 sec - exiting
20:09:35 (1012): No heartbeat from core client for 30 sec - exiting
20:09:36 (1012): No heartbeat from core client for 30 sec - exiting
20:09:37 (1012): No heartbeat from core client for 30 sec - exiting
20:09:38 (1012): No heartbeat from core client for 30 sec - exiting
20:09:39 (1012): No heartbeat from core client for 30 sec - exiting
20:09:40 (1012): No heartbeat from core client for 30 sec - exiting
20:09:41 (1012): No heartbeat from core client for 30 sec - exiting
20:09:42 (1012): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
20:14:05 (1194): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:06 (1194): No heartbeat from core client for 30 sec - exiting
20:14:07 (1194): No heartbeat from core client for 30 sec - exiting
20:14:08 (1194): No heartbeat from core client for 30 sec - exiting
20:14:09 (1194): No heartbeat from core client for 30 sec - exiting
20:14:10 (1194): No heartbeat from core client for 30 sec - exiting
20:14:11 (1194): No heartbeat from core client for 30 sec - exiting
20:14:12 (1194): No heartbeat from core client for 30 sec - exiting
20:31:18 (1381): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:21 (1669): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:34 (1669): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
20:41:52 (1849): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:10:08 (2058): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:12:56 (2519): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:12:57 (2519): No heartbeat from core client for 30 sec - exiting
22:12:58 (2519): No heartbeat from core client for 30 sec - exiting
22:12:59 (2519): No heartbeat from core client for 30 sec - exiting
22:13:00 (2519): No heartbeat from core client for 30 sec - exiting
22:13:01 (2519): No heartbeat from core client for 30 sec - exiting
00:23:39 (3216): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:04 (4455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:46 (5097): No heartbeat from core client for 30 sec - exiting
03:11:47 (5097): No heartbeat from core client for 30 sec - exiting
03:11:48 (5097): No heartbeat from core client for 30 sec - exiting
03:11:49 (5097): No heartbeat from core client for 30 sec - exiting
03:11:50 (5097): No heartbeat from core client for 30 sec - exiting
03:11:51 (5097): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:08 (6164): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:07 (7432): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:16:08 (7432): No heartbeat from core client for 30 sec - exiting
05:16:09 (7432): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7762400]
[0xf7762425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf757f1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7582825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf756a4d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf771d400]
[0xf771d425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf753a1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf753d825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75254d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7738400]
[0xf7738425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75551df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7558825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75404d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf76fc400]
[0xf76fc425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75191df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf751c825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75044d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77cf400]
[0xf77cf425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ec1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75ef825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75d74d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77a0400]
[0xf77a0425]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75bd1df]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75c0825]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75a84d3]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7592, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
31 May 2013 20:05:05 1282401 15808445 hadcm3n_n6sb_1960_40_008378593_0 25,920 63,643 2.4554


©2024 climateprediction.net