climateprediction.net home page
Task 13748943

Task 13748943

Name hadcm3n_t0go_1940_40_007614345_0
Workunit 7792475
Created 8 Dec 2011, 0:51:04 UTC
Sent 8 Dec 2011, 0:53:20 UTC
Report deadline 8 Mar 2012, 8:20:31 UTC
Received 5 Jan 2012, 0:08:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1158301
Run time 17 days 13 hours 44 min 53 sec
CPU time 15 days 14 hours 53 min 28 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.86 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:40:27 (3539): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090d9030 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf754eb72]
/lib32/libc.so.6(+0x6f812)[0xf754f812]
/lib32/libc.so.6(cfree+0x6d)[0xf75528cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774fbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774fc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f90f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:11 3415317                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:11 3415317                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09083000-090e9000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7062000-f74dd000 rw-s 00000000 08:11 3437058                            /var/lib/boinc-client/slots/3/136395
f74dd000-f74e0000 rw-p 00000000 00:00 0 
f74e0000-f7653000 r-xp 00000000 08:11 2493387                            /lib32/libc-2.13.so
f7653000-f7654000 ---p 00173000 08:11 2493387                            /lib32/libc-2.13.so
f7654000-f7656000 r--p 00173000 08:11 2493387                            /lib32/libc-2.13.so
f7656000-f7657000 rw-p 00175000 08:11 2493387                            /lib32/libc-2.13.so
f7657000-f765a000 rw-p 00000000 00:00 0 
f765a000-f7676000 r-xp 00000000 08:11 262171                             /usr/lib32/libgcc_s.so.1
f7676000-f7677000 r--p 0001b000 08:11 262171                             /usr/lib32/libgcc_s.so.1
f7677000-f7678000 rw-p 0001c000 08:11 262171                             /usr/lib32/libgcc_s.so.1
f7678000-f76a0000 r-xp 00000000 08:11 2493397                            /lib32/libm-2.13.so
f76a0000-f76a1000 r--p 00028000 08:11 2493397                            /lib32/libm-2.13.so
f76a1000-f76a2000 rw-p 00029000 08:11 2493397                            /lib32/libm-2.13.so
f76a2000-f7780000 r-xp 00000000 08:11 264433                             /usr/lib32/libstdc++.so.6.0.16
f7780000-f7781000 ---p 000de000 08:11 264433                             /usr/lib32/libstdc++.so.6.0.16
f7781000-f7785000 r--p 000de000 08:11 264433                             /usr/lib32/libstdc++.so.6.0.16
f7785000-f7786000 rw-p 000e2000 08:11 264433                             /usr/lib32/libstdc++.so.6.0.16
f7786000-f778e000 rw-p 00000000 00:00 0 
f778e000-f7791000 r-xp 00000000 08:11 2493388                            /lib32/libdl-2.13.so
f7791000-f7792000 r--p 00002000 08:11 2493388                            /lib32/libdl-2.13.so
f7792000-f7793000 rw-p 00003000 08:11 2493388                            /lib32/libdl-2.13.so
f7793000-f77aa000 r-xp 00000000 08:11 2493395                            /lib32/libpthread-2.13.so
f77aa000-f77ab000 r--p 00016000 08:11 2493395                            /lib32/libpthread-2.13.so
f77ab000-f77ac000 rw-p 00017000 08:11 2493395                            /lib32/libpthread-2.13.so
f77ac000-f77ae000 rw-p 00000000 00:00 0 
f77cc000-f77cd000 rw-p 00000000 00:00 0 
f77cd000-f77ce000 ---p 00000000 00:00 0 
f77ce000-f77d1000 rw-p 00000000 00:00 0 
f77d1000-f77d3000 rw-s 00000000 08:11 3436958                            /var/lib/boinc-client/slots/3/boinc_mmap_file
f77d3000-f77d5000 rw-p 00000000 00:00 0 
f77d5000-f77d6000 r-xp 00000000 00:00 0                                  [vdso]
f77d6000-f77f4000 r-xp 00000000 08:11 1703965                            /lib/i386-linux-gnu/ld-2.13.so
f77f4000-f77f5000 r--p 0001d000 08:11 1703965                            /lib/i386-linux-gnu/ld-2.13.so
f77f5000-f77f6000 rw-p 0001e000 08:11 1703965                            /lib/i386-linux-gnu/ld-2.13.so
ffc1a000-ffc8a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77d5400]
[0xf77d5425]
/lib32/libc.so.6(gsignal+0x4f)[0xf750dc4f]
/lib32/libc.so.6(abort+0x175)[0xf7511175]
/lib32/libc.so.6(+0x63e8c)[0xf7543e8c]
/lib32/libc.so.6(+0x6eb72)[0xf754eb72]
/lib32/libc.so.6(+0x6f812)[0xf754f812]
/lib32/libc.so.6(cfree+0x6d)[0xf75528cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774fbaf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774fc0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f90f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Jan 2012 00:12:16 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 518,400 1,349,601 2.6034
04 Jan 2012 01:09:13 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 492,480 1,276,972 2.5929
02 Jan 2012 15:21:22 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 466,560 1,209,562 2.5925
31 Dec 2011 23:30:15 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 440,640 1,141,754 2.5911
30 Dec 2011 07:19:37 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 414,720 1,073,894 2.5894
28 Dec 2011 16:36:37 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 388,800 1,006,096 2.5877
27 Dec 2011 03:11:12 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 362,880 937,760 2.5842
25 Dec 2011 11:59:35 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 336,960 869,868 2.5815
23 Dec 2011 13:07:13 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 311,040 805,343 2.5892
21 Dec 2011 11:58:41 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 285,120 740,681 2.5978
19 Dec 2011 20:09:09 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 259,200 674,428 2.6020
18 Dec 2011 20:59:40 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 233,280 605,608 2.5961
17 Dec 2011 14:30:10 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 207,360 538,285 2.5959
15 Dec 2011 23:14:00 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 181,440 470,687 2.5942
14 Dec 2011 12:33:53 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 155,520 404,068 2.5982
13 Dec 2011 02:28:46 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 129,600 336,884 2.5994
11 Dec 2011 15:53:35 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 103,680 268,736 2.5920
10 Dec 2011 11:56:45 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 77,760 202,155 2.5997
09 Dec 2011 16:04:23 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 51,840 134,907 2.6024
08 Dec 2011 20:24:15 1158301 13748943 hadcm3n_t0go_1940_40_007614345_0 25,920 67,610 2.6084


©2024 climateprediction.net