climateprediction.net home page
Task 13638513

Task 13638513

Name hadcm3n_o7ac_1940_40_007543673_2
Workunit 7740905
Created 16 Nov 2011, 7:00:56 UTC
Sent 16 Nov 2011, 7:03:23 UTC
Report deadline 15 Feb 2012, 14:30:34 UTC
Received 21 Dec 2011, 0:40:29 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1176290
Run time 13 days 18 hours 0 min 43 sec
CPU time 13 days 0 hours 57 min 38 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.22 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
SIGSEGV: segmentation violation
Stack trace (7 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7706400]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805067e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf744fe46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x095e28d8 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b6f1)[0xf75186f1]
/lib32/libc.so.6(+0x6cf78)[0xf7519f78]
/lib32/libc.so.6(cfree+0x6d)[0xf751d02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f6e7f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74c3e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:12 284976726                          /data/spc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:12 284976726                          /data/spc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0958d000-095f2000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f702f000-f74aa000 rw-s 00000000 08:12 538613199                          /data/spc/BOINC/slots/0/136210
f74aa000-f74ad000 rw-p 00000000 00:00 0 
f74ad000-f7600000 r-xp 00000000 08:01 1183211                            /lib32/libc-2.13.so
f7600000-f7602000 r--p 00153000 08:01 1183211                            /lib32/libc-2.13.so
f7602000-f7603000 rw-p 00155000 08:01 1183211                            /lib32/libc-2.13.so
f7603000-f7606000 rw-p 00000000 00:00 0 
f7606000-f7622000 r-xp 00000000 08:01 1311112                            /usr/lib32/libgcc_s.so.1
f7622000-f7623000 rw-p 0001b000 08:01 1311112                            /usr/lib32/libgcc_s.so.1
f7623000-f7647000 r-xp 00000000 08:01 1183226                            /lib32/libm-2.13.so
f7647000-f7648000 r--p 00023000 08:01 1183226                            /lib32/libm-2.13.so
f7648000-f7649000 rw-p 00024000 08:01 1183226                            /lib32/libm-2.13.so
f7649000-f7725000 r-xp 00000000 08:01 1312274                            /usr/lib32/libstdc++.so.6.0.16
f7725000-f7729000 r--p 000dc000 08:01 1312274                            /usr/lib32/libstdc++.so.6.0.16
f7729000-f772a000 rw-p 000e0000 08:01 1312274                            /usr/lib32/libstdc++.so.6.0.16
f772a000-f7731000 rw-p 00000000 00:00 0 
f7731000-f7733000 r-xp 00000000 08:01 1183209                            /lib32/libdl-2.13.so
f7733000-f7734000 r--p 00001000 08:01 1183209                            /lib32/libdl-2.13.so
f7734000-f7735000 rw-p 00002000 08:01 1183209                            /lib32/libdl-2.13.so
f7735000-f774a000 r-xp 00000000 08:01 1183204                            /lib32/libpthread-2.13.so
f774a000-f774b000 r--p 00014000 08:01 1183204                            /lib32/libpthread-2.13.so
f774b000-f774c000 rw-p 00015000 08:01 1183204                            /lib32/libpthread-2.13.so
f774c000-f774f000 rw-p 00000000 00:00 0 
f7773000-f7774000 rw-p 00000000 00:00 0 
f7774000-f7775000 ---p 00000000 00:00 0 
f7775000-f7778000 rw-p 00000000 00:00 0 
f7778000-f777a000 rw-s 00000000 08:12 538613195                          /data/spc/BOINC/slots/0/boinc_mmap_file
f777a000-f777b000 rw-p 00000000 00:00 0 
f777b000-f777c000 r-xp 00000000 00:00 0                                  [vdso]
f777c000-f7798000 r-xp 00000000 08:01 1183212                            /lib32/ld-2.13.so
f7798000-f7799000 r--p 0001b000 08:01 1183212                            /lib32/ld-2.13.so
f7799000-f779a000 rw-p 0001c000 08:01 1183212                            /lib32/ld-2.13.so
ffc71000-ffce0000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf777b400]
[0xf777b430]
/lib32/libc.so.6(gsignal+0x51)[0xf74d7bb1]
/lib32/libc.so.6(abort+0x182)[0xf74dafd2]
/lib32/libc.so.6(+0x61605)[0xf750e605]
/lib32/libc.so.6(+0x6b6f1)[0xf75186f1]
/lib32/libc.so.6(+0x6cf78)[0xf7519f78]
/lib32/libc.so.6(cfree+0x6d)[0xf751d02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76f6e7f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf74c3e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Dec 2011 09:38:00 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 518,400 1,126,654 2.1733
19 Dec 2011 14:08:55 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 492,480 1,069,996 2.1727
18 Dec 2011 21:49:59 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 466,560 1,013,379 2.1720
18 Dec 2011 05:31:57 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 440,640 956,710 2.1712
17 Dec 2011 05:18:06 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 414,720 900,544 2.1715
15 Dec 2011 20:11:24 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 388,800 845,114 2.1736
14 Dec 2011 05:47:00 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 362,880 789,538 2.1758
13 Dec 2011 08:55:53 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 336,960 733,594 2.1771
11 Dec 2011 19:49:14 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 311,040 677,500 2.1782
10 Dec 2011 11:31:40 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 285,120 621,336 2.1792
08 Dec 2011 22:14:58 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 259,200 565,796 2.1829
07 Dec 2011 22:49:44 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 233,280 509,873 2.1857
07 Dec 2011 02:23:46 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 207,360 453,866 2.1888
05 Dec 2011 07:55:43 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 181,440 397,983 2.1935
04 Dec 2011 02:53:32 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 155,520 341,574 2.1963
02 Dec 2011 22:53:38 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 129,600 286,091 2.2075
01 Dec 2011 05:29:38 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 103,680 229,873 2.2171
30 Nov 2011 02:34:37 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 77,760 174,266 2.2411
25 Nov 2011 07:55:46 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 51,840 117,540 2.2674
24 Nov 2011 14:18:07 1176290 13638513 hadcm3n_o7ac_1940_40_007543673_2 25,920 58,716 2.2653


©2024 cpdn.org