climateprediction.net home page
Task 15941856

Task 15941856

Name hadcm3n_n19x_1880_40_008409761_1
Workunit 8560617
Created 28 Aug 2013, 1:18:00 UTC
Sent 28 Aug 2013, 1:18:48 UTC
Report deadline 27 Nov 2013, 8:45:59 UTC
Received 31 Aug 2013, 6:34:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1266912
Run time 2 days 8 hours 5 min 50 sec
CPU time 2 days 4 hours 36 min 53 sec
Validate state Invalid
Credit 933.12
Device peak FLOPS 2.98 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.12.43</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
03:50:58 (31826): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:02:32 (32663): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:02:32 (639): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:51:50 (2974): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:44:28 (4819): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:12:55 (5790): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:12:56 (5790): No heartbeat from core client for 30 sec - exiting
09:49:25 (7259): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:24:34 (9074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:24:35 (9074): No heartbeat from core client for 30 sec - exiting
14:24:36 (9074): No heartbeat from core client for 30 sec - exiting
14:24:37 (9074): No heartbeat from core client for 30 sec - exiting
14:24:38 (9074): No heartbeat from core client for 30 sec - exiting
14:24:39 (9074): No heartbeat from core client for 30 sec - exiting
14:24:40 (9074): No heartbeat from core client for 30 sec - exiting
14:24:41 (9074): No heartbeat from core client for 30 sec - exiting
14:24:42 (9074): No heartbeat from core client for 30 sec - exiting
16:02:36 (14029): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:02:37 (14029): No heartbeat from core client for 30 sec - exiting
16:20:20 (15797): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:33:09 (16083): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:45:13 (17233): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:28:15 (19049): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:29:41 (20731): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:43:58 (25946): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:43:59 (25946): No heartbeat from core client for 30 sec - exiting
22:00:34 (26573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:02:48 (27314): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:42:00 (27468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:33 (31332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:34 (31332): No heartbeat from core client for 30 sec - exiting
02:30:21 (31554): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:04:04 (11682): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:30:04 (18851): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:23:03 (19863): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:03:05 (13163): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
22:24:15 (17377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:13:33 (20336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:08:43 (22220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:11:08 (29168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:11:10 (29168): No heartbeat from core client for 30 sec - exiting
02:11:11 (29168): No heartbeat from core client for 30 sec - exiting
03:04:56 (30053): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:47:44 (21045): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:47:45 (21045): No heartbeat from core client for 30 sec - exiting
12:47:46 (21045): No heartbeat from core client for 30 sec - exiting
12:47:47 (21045): No heartbeat from core client for 30 sec - exiting
12:47:48 (21045): No heartbeat from core client for 30 sec - exiting
12:47:49 (21045): No heartbeat from core client for 30 sec - exiting
12:47:50 (21045): No heartbeat from core client for 30 sec - exiting
12:47:51 (21045): No heartbeat from core client for 30 sec - exiting
12:47:52 (21045): No heartbeat from core client for 30 sec - exiting
12:47:53 (21045): No heartbeat from core client for 30 sec - exiting
12:47:54 (21045): No heartbeat from core client for 30 sec - exiting
12:47:55 (21045): No heartbeat from core client for 30 sec - exiting
12:47:56 (21045): No heartbeat from core client for 30 sec - exiting
12:47:57 (21045): No heartbeat from core client for 30 sec - exiting
12:47:58 (21045): No heartbeat from core client for 30 sec - exiting
12:47:59 (21045): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:40:35 (28833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:32:18 (2725): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:03:59 (10992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
00:24:53 (14733): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
02:34:59 (22155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:35:00 (22155): No heartbeat from core client for 30 sec - exiting
03:43:10 (22526): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:55:11 (25123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:55:12 (25123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
07:01:10 (32344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:01:11 (32344): No heartbeat from core client for 30 sec - exiting
07:01:12 (32344): No heartbeat from core client for 30 sec - exiting
07:01:13 (32344): No heartbeat from core client for 30 sec - exiting
07:01:14 (32344): No heartbeat from core client for 30 sec - exiting
07:01:15 (32344): No heartbeat from core client for 30 sec - exiting
07:01:16 (32344): No heartbeat from core client for 30 sec - exiting
07:07:02 (321): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:35:31 (3784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:35:32 (3784): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77bf400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77bf430]
/lib/libc.so.6(gsignal+0x4f)[0xf75f931f]
/lib/libc.so.6(abort+0x143)[0xf75fac03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75e43d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772d400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf772d430]
/lib/libc.so.6(gsignal+0x4f)[0xf756731f]
/lib/libc.so.6(abort+0x143)[0xf7568c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75523d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7752400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7752430]
/lib/libc.so.6(gsignal+0x4f)[0xf758c31f]
/lib/libc.so.6(abort+0x143)[0xf758dc03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75773d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7705400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7705430]
/lib/libc.so.6(gsignal+0x4f)[0xf753f31f]
/lib/libc.so.6(abort+0x143)[0xf7540c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf752a3d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772b400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf772b430]
/lib/libc.so.6(gsignal+0x4f)[0xf756531f]
/lib/libc.so.6(abort+0x143)[0xf7566c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75503d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called
Stack trace (9 frames):
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf771d400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf771d430]
/lib/libc.so.6(gsignal+0x4f)[0xf755731f]
/lib/libc.so.6(abort+0x143)[0xf7558c03]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395]
/var/lib/boinc/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf75423d5]

Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4008, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
30 Aug 2013 13:42:50 1266912 15941856 hadcm3n_n19x_1880_40_008409761_1 77,760 152,730 1.9641
29 Aug 2013 14:37:35 1266912 15941856 hadcm3n_n19x_1880_40_008409761_1 51,840 101,389 1.9558
28 Aug 2013 19:01:09 1266912 15941856 hadcm3n_n19x_1880_40_008409761_1 25,920 50,859 1.9622


©2024 climateprediction.net