climateprediction.net home page
Task 15773816

Task 15773816

Name hadcm3n_3krz_1980_40_008364061_1
Workunit 8514920
Created 10 May 2013, 20:06:20 UTC
Sent 10 May 2013, 20:22:33 UTC
Report deadline 10 Aug 2013, 3:49:44 UTC
Received 20 May 2013, 13:08:22 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1179592
Run time 9 days 14 hours 29 min 22 sec
CPU time 8 days 6 hours 41 min 31 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.77 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
20:08:12 (27465): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:16:26 (29902): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:39:57 (30815): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:13:32 (33277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:13:33 (33277): No heartbeat from core client for 30 sec - exiting
22:13:34 (33277): No heartbeat from core client for 30 sec - exiting
22:13:35 (33277): No heartbeat from core client for 30 sec - exiting
22:13:36 (33277): No heartbeat from core client for 30 sec - exiting
22:13:37 (33277): No heartbeat from core client for 30 sec - exiting
22:13:38 (33277): No heartbeat from core client for 30 sec - exiting
22:13:39 (33277): No heartbeat from core client for 30 sec - exiting
22:13:40 (33277): No heartbeat from core client for 30 sec - exiting
22:13:41 (33277): No heartbeat from core client for 30 sec - exiting
22:13:42 (33277): No heartbeat from core client for 30 sec - exiting
22:13:43 (33277): No heartbeat from core client for 30 sec - exiting
22:13:44 (33277): No heartbeat from core client for 30 sec - exiting
22:13:45 (33277): No heartbeat from core client for 30 sec - exiting
22:13:46 (33277): No heartbeat from core client for 30 sec - exiting
22:13:47 (33277): No heartbeat from core client for 30 sec - exiting
22:13:48 (33277): No heartbeat from core client for 30 sec - exiting
22:13:49 (33277): No heartbeat from core client for 30 sec - exiting
22:13:50 (33277): No heartbeat from core client for 30 sec - exiting
22:13:51 (33277): No heartbeat from core client for 30 sec - exiting
22:13:52 (33277): No heartbeat from core client for 30 sec - exiting
22:13:53 (33277): No heartbeat from core client for 30 sec - exiting
22:13:54 (33277): No heartbeat from core client for 30 sec - exiting
22:13:55 (33277): No heartbeat from core client for 30 sec - exiting
22:13:56 (33277): No heartbeat from core client for 30 sec - exiting
22:13:57 (33277): No heartbeat from core client for 30 sec - exiting
22:13:58 (33277): No heartbeat from core client for 30 sec - exiting
22:13:59 (33277): No heartbeat from core client for 30 sec - exiting
22:14:00 (33277): No heartbeat from core client for 30 sec - exiting
22:14:01 (33277): No heartbeat from core client for 30 sec - exiting
22:14:02 (33277): No heartbeat from core client for 30 sec - exiting
22:14:03 (33277): No heartbeat from core client for 30 sec - exiting
22:14:04 (33277): No heartbeat from core client for 30 sec - exiting
22:14:05 (33277): No heartbeat from core client for 30 sec - exiting
22:14:06 (33277): No heartbeat from core client for 30 sec - exiting
23:00:23 (38185): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:57:37 (38437): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:02:27 (38737): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:03:14 (38993): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:03:27 (39244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:06:18 (39603): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:10:56 (39859): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:29 (40344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:11:44 (40556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:11:45 (40556): No heartbeat from core client for 30 sec - exiting
11:11:46 (40556): No heartbeat from core client for 30 sec - exiting
11:11:47 (40556): No heartbeat from core client for 30 sec - exiting
11:11:48 (40556): No heartbeat from core client for 30 sec - exiting
11:11:49 (40556): No heartbeat from core client for 30 sec - exiting
11:11:50 (40556): No heartbeat from core client for 30 sec - exiting
11:11:51 (40556): No heartbeat from core client for 30 sec - exiting
11:11:52 (40556): No heartbeat from core client for 30 sec - exiting
11:11:53 (40556): No heartbeat from core client for 30 sec - exiting
11:11:54 (40556): No heartbeat from core client for 30 sec - exiting
11:11:55 (40556): No heartbeat from core client for 30 sec - exiting
11:11:56 (40556): No heartbeat from core client for 30 sec - exiting
11:11:57 (40556): No heartbeat from core client for 30 sec - exiting
11:11:58 (40556): No heartbeat from core client for 30 sec - exiting
11:11:59 (40556): No heartbeat from core client for 30 sec - exiting
11:12:00 (40556): No heartbeat from core client for 30 sec - exiting
11:12:01 (40556): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x082e59e0 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6bff1)[0xf74a3ff1]
/lib32/libc.so.6(+0x6d880)[0xf74a5880]
/lib32/libc.so.6(cfree+0x6d)[0xf74a892d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf767f7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf767f80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf744ece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08290000-082f5000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fba000-f7435000 rw-s 00000000 08:02 5718129                            /var/lib/boinc-client/slots/26/137580
f7435000-f7438000 rw-p 00000000 00:00 0 
f7438000-f758c000 r-xp 00000000 08:02 9879703                            /lib32/libc-2.12.1.so
f758c000-f758d000 ---p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f758d000-f758f000 r--p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f758f000-f7590000 rw-p 00156000 08:02 9879703                            /lib32/libc-2.12.1.so
f7590000-f7593000 rw-p 00000000 00:00 0 
f7593000-f75ad000 r-xp 00000000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75ad000-f75ae000 r--p 00019000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75ae000-f75af000 rw-p 0001a000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75af000-f75d3000 r-xp 00000000 08:02 9879707                            /lib32/libm-2.12.1.so
f75d3000-f75d4000 r--p 00023000 08:02 9879707                            /lib32/libm-2.12.1.so
f75d4000-f75d5000 rw-p 00024000 08:02 9879707                            /lib32/libm-2.12.1.so
f75d5000-f76b4000 r-xp 00000000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f76b4000-f76b8000 r--p 000de000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f76b8000-f76b9000 rw-p 000e2000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f76b9000-f76c0000 rw-p 00000000 00:00 0 
f76c0000-f76c2000 r-xp 00000000 08:02 9879706                            /lib32/libdl-2.12.1.so
f76c2000-f76c3000 r--p 00001000 08:02 9879706                            /lib32/libdl-2.12.1.so
f76c3000-f76c4000 rw-p 00002000 08:02 9879706                            /lib32/libdl-2.12.1.so
f76c4000-f76c5000 rw-p 00000000 00:00 0 
f76c5000-f76da000 r-xp 00000000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f76da000-f76db000 r--p 00014000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f76db000-f76dc000 rw-p 00015000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f76dc000-f76de000 rw-p 00000000 00:00 0 
f76ef000-f76f0000 rw-p 00000000 00:00 0 
f76f0000-f76f1000 ---p 00000000 00:00 0 
f76f1000-f76f4000 rw-p 00000000 00:00 0 
f76f4000-f76f6000 rw-s 00000000 08:02 5718038                            /var/lib/boinc-client/slots/26/boinc_mmap_file
f76f6000-f76f8000 rw-p 00000000 00:00 0 
f76f8000-f76f9000 r-xp 00000000 00:00 0                                  [vdso]
f76f9000-f7715000 r-xp 00000000 08:02 9879700                            /lib32/ld-2.12.1.so
f7715000-f7716000 r--p 0001b000 08:02 9879700                            /lib32/ld-2.12.1.so
f7716000-f7717000 rw-p 0001c000 08:02 9879700                            /lib32/ld-2.12.1.so
ff82f000-ff89f000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf76f8400]
[0xf76f8425]
/lib32/libc.so.6(gsignal+0x51)[0xf7462a01]
/lib32/libc.so.6(abort+0x182)[0xf7465e42]
/lib32/libc.so.6(+0x61f15)[0xf7499f15]
/lib32/libc.so.6(+0x6bff1)[0xf74a3ff1]
/lib32/libc.so.6(+0x6d880)[0xf74a5880]
/lib32/libc.so.6(cfree+0x6d)[0xf74a892d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf767f7b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf767f80d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf744ece7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 May 2013 13:12:21 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 259,200 715,127 2.7590
19 May 2013 14:39:09 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 233,280 639,866 2.7429
18 May 2013 18:49:50 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 207,360 568,115 2.7398
17 May 2013 22:24:26 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 181,440 495,139 2.7289
17 May 2013 02:42:57 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 155,520 423,449 2.7228
16 May 2013 07:01:40 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 129,600 354,373 2.7344
15 May 2013 12:06:43 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 103,680 285,758 2.7562
14 May 2013 17:17:27 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 77,760 218,865 2.8146
13 May 2013 22:09:14 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 51,840 150,210 2.8976
13 May 2013 00:44:31 1179592 15773816 hadcm3n_3krz_1980_40_008364061_1 25,920 75,122 2.8982


©2024 climateprediction.net