climateprediction.net home page
Task 13412446

Task 13412446

Name hadcm3n_u440_1980_40_007460627_0
Workunit 7658130
Created 23 Sep 2011, 0:27:39 UTC
Sent 23 Sep 2011, 23:45:52 UTC
Report deadline 24 Dec 2011, 7:13:03 UTC
Received 28 Sep 2011, 22:51:28 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1121860
Run time 2 days 1 hours 38 min 20 sec
CPU time 1 days 13 hours 18 min 41 sec
Validate state Invalid
Credit 622.08
Device peak FLOPS 1.98 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
04:26:07 (15027): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:26:08 (15027): No heartbeat from core client for 30 sec - exiting
04:26:09 (15027): No heartbeat from core client for 30 sec - exiting
04:26:10 (15027): No heartbeat from core client for 30 sec - exiting
04:26:11 (15027): No heartbeat from core client for 30 sec - exiting
04:26:12 (15027): No heartbeat from core client for 30 sec - exiting
04:26:13 (15027): No heartbeat from core client for 30 sec - exiting
04:26:14 (15027): No heartbeat from core client for 30 sec - exiting
07:07:30 (6136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:02:59 (28644): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:11:29 (23767): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:01:10 (26671): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:01:11 (26671): No heartbeat from core client for 30 sec - exiting
11:01:12 (26671): No heartbeat from core client for 30 sec - exiting
11:01:13 (26671): No heartbeat from core client for 30 sec - exiting
11:01:14 (26671): No heartbeat from core client for 30 sec - exiting
11:01:15 (26671): No heartbeat from core client for 30 sec - exiting
11:01:16 (26671): No heartbeat from core client for 30 sec - exiting
11:01:17 (26671): No heartbeat from core client for 30 sec - exiting
11:01:18 (26671): No heartbeat from core client for 30 sec - exiting
11:01:19 (26671): No heartbeat from core client for 30 sec - exiting
11:01:20 (26671): No heartbeat from core client for 30 sec - exiting
11:01:21 (26671): No heartbeat from core client for 30 sec - exiting
11:34:29 (11363): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:54:47 (22626): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:18:44 (28235): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:03:12 (4475): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:07:10 (30284): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:12:12 (31543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:22:16 (777): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:39:55 (25040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:57:40 (31067): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:05:56 (4930): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:15:34 (7994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:17:08 (11103): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:49:04 (20647): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:11:29 (31359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:11:30 (31359): No heartbeat from core client for 30 sec - exiting
10:11:31 (31359): No heartbeat from core client for 30 sec - exiting
10:11:32 (31359): No heartbeat from core client for 30 sec - exiting
10:11:33 (31359): No heartbeat from core client for 30 sec - exiting
10:11:34 (31359): No heartbeat from core client for 30 sec - exiting
10:11:35 (31359): No heartbeat from core client for 30 sec - exiting
10:15:54 (6758): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:24:53 (8327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:29:20 (11387): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:29:21 (11387): No heartbeat from core client for 30 sec - exiting
10:29:22 (11387): No heartbeat from core client for 30 sec - exiting
10:29:23 (11387): No heartbeat from core client for 30 sec - exiting
10:29:24 (11387): No heartbeat from core client for 30 sec - exiting
10:29:25 (11387): No heartbeat from core client for 30 sec - exiting
10:29:26 (11387): No heartbeat from core client for 30 sec - exiting
10:29:27 (11387): No heartbeat from core client for 30 sec - exiting
10:29:28 (11387): No heartbeat from core client for 30 sec - exiting
10:29:29 (11387): No heartbeat from core client for 30 sec - exiting
10:29:30 (11387): No heartbeat from core client for 30 sec - exiting
10:33:52 (12938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:38:19 (14495): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:38:20 (14495): No heartbeat from core client for 30 sec - exiting
10:38:21 (14495): No heartbeat from core client for 30 sec - exiting
10:38:22 (14495): No heartbeat from core client for 30 sec - exiting
10:38:23 (14495): No heartbeat from core client for 30 sec - exiting
10:38:24 (14495): No heartbeat from core client for 30 sec - exiting
10:38:25 (14495): No heartbeat from core client for 30 sec - exiting
10:38:26 (14495): No heartbeat from core client for 30 sec - exiting
10:38:27 (14495): No heartbeat from core client for 30 sec - exiting
10:38:28 (14495): No heartbeat from core client for 30 sec - exiting
10:38:29 (14495): No heartbeat from core client for 30 sec - exiting
11:07:54 (16036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:24:40 (26168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:34:11 (31898): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:46:53 (2940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:17:40 (7244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:39:19 (17870): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:18:28 (25177): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:49:18 (6413): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:07:37 (16860): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:07:38 (16860): No heartbeat from core client for 30 sec - exiting
14:07:39 (16860): No heartbeat from core client for 30 sec - exiting
14:07:40 (16860): No heartbeat from core client for 30 sec - exiting
14:07:41 (16860): No heartbeat from core client for 30 sec - exiting
14:07:42 (16860): No heartbeat from core client for 30 sec - exiting
14:07:43 (16860): No heartbeat from core client for 30 sec - exiting
14:07:44 (16860): No heartbeat from core client for 30 sec - exiting
14:07:45 (16860): No heartbeat from core client for 30 sec - exiting
14:07:46 (16860): No heartbeat from core client for 30 sec - exiting
14:07:47 (16860): No heartbeat from core client for 30 sec - exiting
14:56:37 (23187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:35:17 (7691): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:48:53 (20901): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:29:39 (25555): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:13:34 (7318): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:19:04 (22534): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:40:59 (24439): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
00:57:13 (20410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
21:38:12 (7605): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:47:20 (13678): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:15:01 (16842): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:15:02 (16842): No heartbeat from core client for 30 sec - exiting
22:15:03 (16842): No heartbeat from core client for 30 sec - exiting
22:15:04 (16842): No heartbeat from core client for 30 sec - exiting
22:15:05 (16842): No heartbeat from core client for 30 sec - exiting
22:15:06 (16842): No heartbeat from core client for 30 sec - exiting
22:15:07 (16842): No heartbeat from core client for 30 sec - exiting
22:15:08 (16842): No heartbeat from core client for 30 sec - exiting
22:15:09 (16842): No heartbeat from core client for 30 sec - exiting
22:15:10 (16842): No heartbeat from core client for 30 sec - exiting
22:15:11 (16842): No heartbeat from core client for 30 sec - exiting
22:15:12 (16842): No heartbeat from core client for 30 sec - exiting
22:28:47 (26461): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:53:59 (31131): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:12:59 (7436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:15:56 (1940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
19:19:27 (4579): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:37:39 (17378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:47:27 (11619): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:43:26 (14961): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:06:32 (1599): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:12:31 (9601): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:35:39 (32133): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:17:24 (8043): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:02:26 (22036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:16:06 (5279): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:16:07 (5279): No heartbeat from core client for 30 sec - exiting
01:16:08 (5279): No heartbeat from core client for 30 sec - exiting
01:16:09 (5279): No heartbeat from core client for 30 sec - exiting
01:16:10 (5279): No heartbeat from core client for 30 sec - exiting
01:16:11 (5279): No heartbeat from core client for 30 sec - exiting
01:16:12 (5279): No heartbeat from core client for 30 sec - exiting
01:16:13 (5279): No heartbeat from core client for 30 sec - exiting
01:16:14 (5279): No heartbeat from core client for 30 sec - exiting
01:16:15 (5279): No heartbeat from core client for 30 sec - exiting
01:16:16 (5279): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
00:45:20 (6399): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:45:21 (6399): No heartbeat from core client for 30 sec - exiting
00:45:22 (6399): No heartbeat from core client for 30 sec - exiting
00:45:23 (6399): No heartbeat from core client for 30 sec - exiting
00:45:24 (6399): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf77d6400]
[0xf77d6430]
/lib32/libc.so.6(gsignal+0x51)[0xf7636ea1]
/lib32/libc.so.6(abort+0x17e)[0xf763a2ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7622e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf777b400]
[0xf777b430]
/lib32/libc.so.6(gsignal+0x51)[0xf75dbea1]
/lib32/libc.so.6(abort+0x17e)[0xf75df2ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf75c7e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf775d400]
[0xf775d430]
/lib32/libc.so.6(gsignal+0x51)[0xf75bdea1]
/lib32/libc.so.6(abort+0x17e)[0xf75c12ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf75a9e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7718400]
[0xf7718430]
/lib32/libc.so.6(gsignal+0x51)[0xf7578ea1]
/lib32/libc.so.6(abort+0x17e)[0xf757c2ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7564e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf7754400]
[0xf7754430]
/lib32/libc.so.6(gsignal+0x51)[0xf75b4ea1]
/lib32/libc.so.6(abort+0x17e)[0xf75b82ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf75a0e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (10 frames):
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
[0xf776c400]
[0xf776c430]
/lib32/libc.so.6(gsignal+0x51)[0xf75ccea1]
/lib32/libc.so.6(abort+0x17e)[0xf75d02ce]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf75b8e37]
/data/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x804cb11]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=16892, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
28 Sep 2011 20:47:53 1121860 13412446 hadcm3n_u440_1980_40_007460627_0 51,840 131,862 2.5436
25 Sep 2011 02:11:14 1121860 13412446 hadcm3n_u440_1980_40_007460627_0 25,920 68,732 2.6517


©2024 cpdn.org