climateprediction.net home page
Task 13825818

Task 13825818

Name hadcm3n_o1i2_1940_40_007618767_1
Workunit 7796897
Created 28 Dec 2011, 23:27:38 UTC
Sent 28 Dec 2011, 23:27:43 UTC
Report deadline 29 Mar 2012, 6:54:54 UTC
Received 14 Jan 2012, 4:33:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1183991
Run time 10 days 4 hours 59 min 10 sec
CPU time 7 days 9 hours 4 min 35 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.96 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:10:36 (1909): No heartbeat from core client for 30 sec - exiting
23:10:37 (1909): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
23:10:38 (1909): No heartbeat from core client for 30 sec - exiting
23:10:39 (1909): No heartbeat from core client for 30 sec - exiting
23:10:41 (1909): No heartbeat from core client for 30 sec - exiting
23:10:42 (1909): No heartbeat from core client for 30 sec - exiting
23:10:43 (1909): No heartbeat from core client for 30 sec - exiting
23:10:44 (1909): No heartbeat from core client for 30 sec - exiting
23:10:45 (1909): No heartbeat from core client for 30 sec - exiting
23:10:46 (1909): No heartbeat from core client for 30 sec - exiting
23:10:47 (1909): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:40:43 (3345): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:55:08 (3581): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:03:49 (3592): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:44:22 (2075): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a69ac8 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0x266bc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0x267862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x26a94d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x80780f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x80786b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x211113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
00110000-00138000 r-xp 00000000 08:01 24642499   /lib/i386-linux-gnu/libm-2.13.so
00138000-00139000 r--p 00028000 08:01 24642499   /lib/i386-linux-gnu/libm-2.13.so
00139000-0013a000 rw-p 00029000 08:01 24642499   /lib/i386-linux-gnu/libm-2.13.so
001dd000-001f4000 r-xp 00000000 08:01 24642529   /lib/i386-linux-gnu/libpthread-2.13.so
001f4000-001f5000 r--p 00016000 08:01 24642529   /lib/i386-linux-gnu/libpthread-2.13.so
001f5000-001f6000 rw-p 00017000 08:01 24642529   /lib/i386-linux-gnu/libpthread-2.13.so
001f6000-001f8000 rw-p 00000000 00:00 0 
001f8000-0036e000 r-xp 00000000 08:01 24642469   /lib/i386-linux-gnu/libc-2.13.so
0036e000-00370000 r--p 00176000 08:01 24642469   /lib/i386-linux-gnu/libc-2.13.so
00370000-00371000 rw-p 00178000 08:01 24642469   /lib/i386-linux-gnu/libc-2.13.so
00371000-00374000 rw-p 00000000 00:00 0 
0052a000-0052b000 r-xp 00000000 00:00 0          [vdso]
00557000-00575000 r-xp 00000000 08:01 24642456   /lib/i386-linux-gnu/ld-2.13.so
00575000-00576000 r--p 0001d000 08:01 24642456   /lib/i386-linux-gnu/ld-2.13.so
00576000-00577000 rw-p 0001e000 08:01 24642456   /lib/i386-linux-gnu/ld-2.13.so
0063c000-00658000 r-xp 00000000 08:01 24642490   /lib/i386-linux-gnu/libgcc_s.so.1
00658000-00659000 r--p 0001b000 08:01 24642490   /lib/i386-linux-gnu/libgcc_s.so.1
00659000-0065a000 rw-p 0001c000 08:01 24642490   /lib/i386-linux-gnu/libgcc_s.so.1
0075a000-00838000 r-xp 00000000 08:01 20190587   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
00838000-00839000 ---p 000de000 08:01 20190587   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
00839000-0083d000 r--p 000de000 08:01 20190587   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
0083d000-0083e000 rw-p 000e2000 08:01 20190587   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
0083e000-00845000 rw-p 00000000 00:00 0 
00d31000-00d34000 r-xp 00000000 08:01 24642480   /lib/i386-linux-gnu/libdl-2.13.so
00d34000-00d35000 r--p 00002000 08:01 24642480   /lib/i386-linux-gnu/libdl-2.13.so
00d35000-00d36000 rw-p 00003000 08:01 24642480   /lib/i386-linux-gnu/libdl-2.13.so
08048000-080e3000 r-xp 00000000 08:01 29884595   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 29884595   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08a14000-08a7a000 rw-p 00000000 00:00 0          [heap]
b7100000-b7121000 rw-p 00000000 00:00 0 
b7121000-b7200000 ---p 00000000 00:00 0 
b727b000-b76f6000 rw-s 00000000 08:01 29895852   /var/lib/boinc-client/slots/4/134615
b76f6000-b76fa000 rw-p 00000000 00:00 0 
b7709000-b770a000 rw-p 00000000 00:00 0 
b770a000-b770b000 ---p 00000000 00:00 0 
b770b000-b770e000 rw-p 00000000 00:00 0 
b770e000-b7710000 rw-s 00000000 08:01 29895733   /var/lib/boinc-client/slots/4/boinc_mmap_file
b7710000-b7712000 rw-p 00000000 00:00 0 
bf9a2000-bfa12000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0x52a400]
[0x52a416]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0x225c8f]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0x2292b5]
/lib/i386-linux-gnu/libc.so.6(+0x63dfc)[0x25bdfc]
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0x266bc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0x267862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0x26a94d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0x80780f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0x80786b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x211113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jan 2012 03:36:04 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 259,200 637,465 2.4594
12 Jan 2012 18:53:39 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 233,280 573,795 2.4597
11 Jan 2012 08:13:49 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 207,360 510,375 2.4613
09 Jan 2012 20:34:58 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 181,440 447,201 2.4647
08 Jan 2012 04:14:00 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 155,520 383,145 2.4636
06 Jan 2012 16:09:49 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 129,600 317,960 2.4534
05 Jan 2012 05:38:44 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 103,680 255,398 2.4633
03 Jan 2012 16:13:01 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 77,760 191,834 2.4670
02 Jan 2012 09:09:53 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 51,840 128,873 2.4860
31 Dec 2011 14:07:37 1183991 13825818 hadcm3n_o1i2_1940_40_007618767_1 25,920 64,298 2.4806


©2024 cpdn.org