climateprediction.net home page
Task 13147184

Task 13147184

Name hadcm3n_t352_1940_40_007312064_2
Workunit 7509494
Created 19 Jul 2011, 23:56:07 UTC
Sent 20 Jul 2011, 0:03:37 UTC
Report deadline 19 Oct 2011, 7:30:48 UTC
Received 17 Aug 2011, 20:18:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1103925
Run time 5 days 18 hours 23 min 4 sec
CPU time 5 days 7 hours 54 min 41 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
09:49:56 (18108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    
09:41:37 (1701): No heartbeat from core client for 30 sec - exiting
09:41:38 (1701): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:41:39 (1701): No heartbeat from core client for 30 sec - exiting
09:41:40 (1701): No heartbeat from core client for 30 sec - exiting
09:41:41 (1701): No heartbeat from core client for 30 sec - exiting
09:41:42 (1701): No heartbeat from core client for 30 sec - exiting
16:27:11 (6869): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:51:05 (8201): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:51:19 (8201): No heartbeat from core client for 30 sec - exiting
10:51:20 (8201): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
18:04:15 (11378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:04:23 (11378): No heartbeat from core client for 30 sec - exiting
18:04:24 (11378): No heartbeat from core client for 30 sec - exiting
18:04:25 (11378): No heartbeat from core client for 30 sec - exiting
18:04:26 (11378): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
09:04:16 (1589): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:54:58 (6331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:55:17 (6331): No heartbeat from core client for 30 sec - exiting
08:55:18 (6331): No heartbeat from core client for 30 sec - exiting
08:55:19 (6331): No heartbeat from core client for 30 sec - exiting
08:55:20 (6331): No heartbeat from core client for 30 sec - exiting
08:55:21 (6331): No heartbeat from core client for 30 sec - exiting
08:55:24 (6331): No heartbeat from core client for 30 sec - exiting
08:55:25 (6331): No heartbeat from core client for 30 sec - exiting
08:55:26 (6331): No heartbeat from core client for 30 sec - exiting
10:26:41 (9884): No heartbeat from core client for 30 sec - exiting
10:26:45 (9884): No heartbeat from core client for 30 sec - exiting
10:26:46 (9884): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:26:51 (9884): No heartbeat from core client for 30 sec - exiting
19:42:52 (11770): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:27:34 (12654): No heartbeat from core client for 30 sec - exiting
08:27:41 (12654): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
08:16:59 (1771): No heartbeat from core client for 30 sec - exiting
08:17:09 (1771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:17:10 (1771): No heartbeat from core client for 30 sec - exiting
10:42:26 (5233): No heartbeat from core client for 30 sec - exiting
10:42:31 (5233): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:42:32 (5233): No heartbeat from core client for 30 sec - exiting
10:42:33 (5233): No heartbeat from core client for 30 sec - exiting
09:59:33 (8766): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:45:56 (12933): No heartbeat from core client for 30 sec - exiting
08:45:57 (12933): No heartbeat from core client for 30 sec - exiting
08:45:58 (12933): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:06:16 (14332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:06:31 (14332): No heartbeat from core client for 30 sec - exiting
16:06:32 (14332): No heartbeat from core client for 30 sec - exiting
16:06:33 (14332): No heartbeat from core client for 30 sec - exiting
22:35:54 (17739): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:35:56 (17739): No heartbeat from core client for 30 sec - exiting
08:54:19 (19735): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:17:16 (22055): No heartbeat from core client for 30 sec - exiting
12:17:28 (22055): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:17:29 (22055): No heartbeat from core client for 30 sec - exiting
12:17:30 (22055): No heartbeat from core client for 30 sec - exiting
12:17:31 (22055): No heartbeat from core client for 30 sec - exiting
12:17:32 (22055): No heartbeat from core client for 30 sec - exiting
16:57:01 (23025): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:57:03 (23025): No heartbeat from core client for 30 sec - exiting
16:57:04 (23025): No heartbeat from core client for 30 sec - exiting
16:57:05 (23025): No heartbeat from core client for 30 sec - exiting
16:57:06 (23025): No heartbeat from core client for 30 sec - exiting
16:57:07 (23025): No heartbeat from core client for 30 sec - exiting
09:51:35 (24265): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:51:50 (24265): No heartbeat from core client for 30 sec - exiting
09:51:54 (24265): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    
08:41:02 (1704): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:52:31 (4170): No heartbeat from core client for 30 sec - exiting
13:52:36 (4170): No heartbeat from core client for 30 sec - exiting
13:52:37 (4170): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
21:45:41 (1758): No heartbeat from core client for 30 sec - exiting
21:45:56 (1758): No heartbeat from core client for 30 sec - exiting
21:45:57 (1758): No heartbeat from core client for 30 sec - exiting
21:45:58 (1758): No heartbeat from core client for 30 sec - exiting
21:45:59 (1758): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:46:00 (1758): No heartbeat from core client for 30 sec - exiting
21:46:01 (1758): No heartbeat from core client for 30 sec - exiting
21:46:02 (1758): No heartbeat from core client for 30 sec - exiting
21:46:03 (1758): No heartbeat from core client for 30 sec - exiting
21:46:04 (1758): No heartbeat from core client for 30 sec - exiting
21:46:05 (1758): No heartbeat from core client for 30 sec - exiting
21:46:06 (1758): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
07:18:15 (1565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:18:23 (1565): No heartbeat from core client for 30 sec - exiting
07:18:24 (1565): No heartbeat from core client for 30 sec - exiting
07:18:25 (1565): No heartbeat from core client for 30 sec - exiting
07:18:26 (1565): No heartbeat from core client for 30 sec - exiting
07:18:27 (1565): No heartbeat from core client for 30 sec - exiting
07:18:28 (1565): No heartbeat from core client for 30 sec - exiting
07:18:29 (1565): No heartbeat from core client for 30 sec - exiting
18:10:43 (8764): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:10:50 (8764): No heartbeat from core client for 30 sec - exiting
20:45:18 (9671): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:55:46 (14843): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:56:06 (14843): No heartbeat from core client for 30 sec - exiting
09:56:07 (14843): No heartbeat from core client for 30 sec - exiting
09:56:08 (14843): No heartbeat from core client for 30 sec - exiting
09:56:09 (14843): No heartbeat from core client for 30 sec - exiting
09:56:10 (14843): No heartbeat from core client for 30 sec - exiting
09:56:11 (14843): No heartbeat from core client for 30 sec - exiting
09:56:12 (14843): No heartbeat from core client for 30 sec - exiting
09:56:13 (14843): No heartbeat from core client for 30 sec - exiting
18:46:49 (1700): No heartbeat from core client for 30 sec - exiting
18:47:02 (1700): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09f8e0e0 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7670591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7671de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb7674ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb785f741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb785f79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb761bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 36439625   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 36439625   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09f38000-09f9e000 rw-p 00000000 00:00 0          [heap]
b7000000-b7021000 rw-p 00000000 00:00 0 
b7021000-b7100000 ---p 00000000 00:00 0 
b7188000-b7603000 rw-s 00000000 08:01 36831586   /var/lib/boinc-client/slots/6/129785
b7603000-b7605000 rw-p 00000000 00:00 0 
b7605000-b7758000 r-xp 00000000 08:01 22678211   /lib/tls/i686/cmov/libc-2.11.1.so
b7758000-b7759000 ---p 00153000 08:01 22678211   /lib/tls/i686/cmov/libc-2.11.1.so
b7759000-b775b000 r--p 00153000 08:01 22678211   /lib/tls/i686/cmov/libc-2.11.1.so
b775b000-b775c000 rw-p 00155000 08:01 22678211   /lib/tls/i686/cmov/libc-2.11.1.so
b775c000-b775f000 rw-p 00000000 00:00 0 
b775f000-b777c000 r-xp 00000000 08:01 22544467   /lib/libgcc_s.so.1
b777c000-b777d000 r--p 0001c000 08:01 22544467   /lib/libgcc_s.so.1
b777d000-b777e000 rw-p 0001d000 08:01 22544467   /lib/libgcc_s.so.1
b777e000-b77a2000 r-xp 00000000 08:01 22678215   /lib/tls/i686/cmov/libm-2.11.1.so
b77a2000-b77a3000 r--p 00023000 08:01 22678215   /lib/tls/i686/cmov/libm-2.11.1.so
b77a3000-b77a4000 rw-p 00024000 08:01 22678215   /lib/tls/i686/cmov/libm-2.11.1.so
b77a4000-b788d000 r-xp 00000000 08:01 59117235   /usr/lib/libstdc++.so.6.0.13
b788d000-b788e000 ---p 000e9000 08:01 59117235   /usr/lib/libstdc++.so.6.0.13
b788e000-b7892000 r--p 000e9000 08:01 59117235   /usr/lib/libstdc++.so.6.0.13
b7892000-b7893000 rw-p 000ed000 08:01 59117235   /usr/lib/libstdc++.so.6.0.13
b7893000-b789b000 rw-p 00000000 00:00 0 
b789b000-b789d000 r-xp 00000000 08:01 22678214   /lib/tls/i686/cmov/libdl-2.11.1.so
b789d000-b789e000 r--p 00001000 08:01 22678214   /lib/tls/i686/cmov/libdl-2.11.1.so
b789e000-b789f000 rw-p 00002000 08:01 22678214   /lib/tls/i686/cmov/libdl-2.11.1.so
b789f000-b78b4000 r-xp 00000000 08:01 22678227   /lib/tls/i686/cmov/libpthread-2.11.1.so
b78b4000-b78b5000 r--p 00014000 08:01 22678227   /lib/tls/i686/cmov/libpthread-2.11.1.so
b78b5000-b78b6000 rw-p 00015000 08:01 22678227   /lib/tls/i686/cmov/libpthread-2.11.1.so
b78b6000-b78b8000 rw-p 00000000 00:00 0 
b78c7000-b78c8000 rw-p 00000000 00:00 0 
b78c8000-b78c9000 ---p 00000000 00:00 0 
b78c9000-b78cc000 rw-p 00000000 00:00 0 
b78cc000-b78ce000 rw-s 00000000 08:01 36831486   /var/lib/boinc-client/slots/6/boinc_mmap_file
b78ce000-b78d0000 rw-p 00000000 00:00 0 
b78d0000-b78d1000 r-xp 00000000 00:00 0          [vdso]
b78d1000-b78ec000 r-xp 00000000 08:01 22544444   /lib/ld-2.11.1.so
b78ec000-b78ed000 r--p 0001a000 08:01 22544444   /lib/ld-2.11.1.so
b78ed000-b78ee000 rw-p 0001b000 08:01 22544444   /lib/ld-2.11.1.so
bfcf6000-bfd67000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb78d0400]
[0xb78d0430]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0xb762f651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0xb7632a82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0xb766649d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7670591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7671de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb7674ecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb785f741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb785f79d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb761bbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 Aug 2011 22:49:44 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 259,200 460,471 1.7765
14 Aug 2011 23:11:25 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 233,280 412,317 1.7675
11 Aug 2011 21:19:42 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 207,360 364,485 1.7577
08 Aug 2011 22:09:41 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 181,440 315,571 1.7393
06 Aug 2011 13:39:34 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 155,520 267,570 1.7205
01 Aug 2011 11:14:12 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 129,600 219,813 1.6961
30 Jul 2011 14:43:41 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 103,680 171,223 1.6515
27 Jul 2011 21:56:03 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 77,760 123,535 1.5887
26 Jul 2011 07:56:44 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 51,840 75,815 1.4625
25 Jul 2011 22:19:07 1103925 13147184 hadcm3n_t352_1940_40_007312064_2 25,920 27,506 1.0612


©2024 cpdn.org