climateprediction.net home page
Task 13740924

Task 13740924

Name hadcm3n_yaw1_1940_40_007607719_2
Workunit 7785849
Created 7 Dec 2011, 1:04:45 UTC
Sent 7 Dec 2011, 1:41:21 UTC
Report deadline 7 Mar 2012, 9:08:32 UTC
Received 17 Dec 2011, 12:14:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1189010
Run time 5 days 1 hours 35 min 7 sec
CPU time 4 days 23 hours 50 min 24 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.03 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
17:10:40 (7501): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:11:49 (20157): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:12:51 (20236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:15:02 (20317): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:42:04 (20401): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:46:49 (8690): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:54:41 (8849): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:57:14 (9131): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:59:38 (9375): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:01:33 (9500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:04:12 (9681): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:06:30 (9825): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:08:22 (9994): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:10:54 (10118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:12:39 (10290): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:14:55 (10446): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:04 (10564): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:41:12 (10713): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:46:23 (22199): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:52:04 (22232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:00:05 (22281): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:15:03 (22677): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:16:53 (28978): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:26:49 (29009): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:40:44 (29047): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:21 (29092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:43:02 (29118): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:54:24 (29145): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=29230, iMonCtr=1
SIGSEGV: segmentation violation
Stack trace (9 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf774b400]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x35b)[0x804cd43]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804ffc5]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050665]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7497e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x089e6a50 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf7528511]
/lib32/libc.so.6(+0x6ce1b)[0xf7529e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf752cf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7706841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf770689d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74d3e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 16647274                           /usr/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 16647274                           /usr/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08991000-089f6000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f703f000-f74ba000 rw-s 00000000 08:01 16647547                           /usr/BOINC/slots/1/137155
f74ba000-f74bd000 rw-p 00000000 00:00 0 
f74bd000-f7613000 r-xp 00000000 08:01 16646149                           /lib32/libc-2.13.so
f7613000-f7614000 ---p 00156000 08:01 16646149                           /lib32/libc-2.13.so
f7614000-f7616000 r--p 00156000 08:01 16646149                           /lib32/libc-2.13.so
f7616000-f7617000 rw-p 00158000 08:01 16646149                           /lib32/libc-2.13.so
f7617000-f761a000 rw-p 00000000 00:00 0 
f761a000-f7634000 r-xp 00000000 08:01 12193083                           /usr/lib32/libgcc_s.so.1
f7634000-f7635000 r--p 00019000 08:01 12193083                           /usr/lib32/libgcc_s.so.1
f7635000-f7636000 rw-p 0001a000 08:01 12193083                           /usr/lib32/libgcc_s.so.1
f7636000-f765a000 r-xp 00000000 08:01 16646153                           /lib32/libm-2.13.so
f765a000-f765b000 r--p 00023000 08:01 16646153                           /lib32/libm-2.13.so
f765b000-f765c000 rw-p 00024000 08:01 16646153                           /lib32/libm-2.13.so
f765c000-f773b000 r-xp 00000000 08:01 12193086                           /usr/lib32/libstdc++.so.6.0.14
f773b000-f773f000 r--p 000de000 08:01 12193086                           /usr/lib32/libstdc++.so.6.0.14
f773f000-f7740000 rw-p 000e2000 08:01 12193086                           /usr/lib32/libstdc++.so.6.0.14
f7740000-f7747000 rw-p 00000000 00:00 0 
f7747000-f7749000 r-xp 00000000 08:01 16646152                           /lib32/libdl-2.13.so
f7749000-f774a000 r--p 00001000 08:01 16646152                           /lib32/libdl-2.13.so
f774a000-f774b000 rw-p 00002000 08:01 16646152                           /lib32/libdl-2.13.so
f774b000-f7760000 r-xp 00000000 08:01 16646163                           /lib32/libpthread-2.13.so
f7760000-f7761000 r--p 00014000 08:01 16646163                           /lib32/libpthread-2.13.so
f7761000-f7762000 rw-p 00015000 08:01 16646163                           /lib32/libpthread-2.13.so
f7762000-f7765000 rw-p 00000000 00:00 0 
f777f000-f7780000 rw-p 00000000 00:00 0 
f7780000-f7781000 ---p 00000000 00:00 0 
f7781000-f7784000 rw-p 00000000 00:00 0 
f7784000-f7786000 rw-s 00000000 08:01 16647652                           /usr/BOINC/slots/1/boinc_mmap_file
f7786000-f7787000 rw-p 00000000 00:00 0 
f7787000-f7788000 r-xp 00000000 00:00 0                                  [vdso]
f7788000-f77a4000 r-xp 00000000 08:01 16646146                           /lib32/ld-2.13.so
f77a4000-f77a5000 r--p 0001b000 08:01 16646146                           /lib32/ld-2.13.so
f77a5000-f77a6000 rw-p 0001c000 08:01 16646146                           /lib32/ld-2.13.so
ffc8b000-ffcfb000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7787400]
[0xf7787430]
/lib32/libc.so.6(gsignal+0x51)[0xf74e7ea1]
/lib32/libc.so.6(abort+0x17e)[0xf74eb2ce]
/lib32/libc.so.6(+0x61277)[0xf751e277]
/lib32/libc.so.6(+0x6b511)[0xf7528511]
/lib32/libc.so.6(+0x6ce1b)[0xf7529e1b]
/lib32/libc.so.6(cfree+0x6d)[0xf752cf8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7706841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf770689d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74d3e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
17 Dec 2011 12:19:38 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 259,200 431,418 1.6644
16 Dec 2011 18:57:04 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 233,280 387,617 1.6616
16 Dec 2011 06:15:51 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 207,360 344,693 1.6623
15 Dec 2011 17:18:25 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 181,440 302,078 1.6649
15 Dec 2011 06:03:37 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 155,520 259,384 1.6678
14 Dec 2011 17:35:47 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 129,600 217,012 1.6745
14 Dec 2011 05:26:41 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 103,680 173,793 1.6762
13 Dec 2011 17:13:44 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 77,760 130,506 1.6783
13 Dec 2011 05:04:35 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 51,840 86,834 1.6750
12 Dec 2011 16:46:05 1180747 13740924 hadcm3n_yaw1_1940_40_007607719_2 25,920 43,490 1.6779


©2024 cpdn.org