climateprediction.net home page
Task 13648747

Task 13648747

Name hadcm3n_y7ut_1900_40_007343039_2
Workunit 7540469
Created 20 Nov 2011, 12:26:27 UTC
Sent 20 Nov 2011, 17:27:24 UTC
Report deadline 20 Feb 2012, 0:54:35 UTC
Received 10 Dec 2011, 1:02:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1105963
Run time 7 days 3 hours 33 min 42 sec
CPU time 6 days 3 hours 22 min 13 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.49 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.12.33</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:01:01 (28211): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:03:26 (28365): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:14:55 (28401): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:38:03 (28481): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:35:15 (25240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:37:17 (26263): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:20:40 (1736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0840dcf8 ***
======= Backtrace: =========
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0xb74ecbc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0xb74ed862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0xb74f094d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb76ef80f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb76ef86b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb7497113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:05 15600379   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:05 15600379   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
083b8000-0841c000 rw-p 00000000 00:00 0          [heap]
b6e00000-b6e21000 rw-p 00000000 00:00 0 
b6e21000-b6f00000 ---p 00000000 00:00 0 
b7000000-b747b000 rw-s 00000000 08:05 15604149   /var/lib/boinc-client/slots/2/137505
b747b000-b747e000 rw-p 00000000 00:00 0 
b747e000-b75f4000 r-xp 00000000 08:05 2622407    /lib/i386-linux-gnu/libc-2.13.so
b75f4000-b75f6000 r--p 00176000 08:05 2622407    /lib/i386-linux-gnu/libc-2.13.so
b75f6000-b75f7000 rw-p 00178000 08:05 2622407    /lib/i386-linux-gnu/libc-2.13.so
b75f7000-b75fa000 rw-p 00000000 00:00 0 
b75fa000-b7616000 r-xp 00000000 08:05 2622403    /lib/i386-linux-gnu/libgcc_s.so.1
b7616000-b7617000 r--p 0001b000 08:05 2622403    /lib/i386-linux-gnu/libgcc_s.so.1
b7617000-b7618000 rw-p 0001c000 08:05 2622403    /lib/i386-linux-gnu/libgcc_s.so.1
b7618000-b7640000 r-xp 00000000 08:05 2622411    /lib/i386-linux-gnu/libm-2.13.so
b7640000-b7641000 r--p 00028000 08:05 2622411    /lib/i386-linux-gnu/libm-2.13.so
b7641000-b7642000 rw-p 00029000 08:05 2622411    /lib/i386-linux-gnu/libm-2.13.so
b7642000-b7720000 r-xp 00000000 08:05 23730824   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7720000-b7721000 ---p 000de000 08:05 23730824   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7721000-b7725000 r--p 000de000 08:05 23730824   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7725000-b7726000 rw-p 000e2000 08:05 23730824   /usr/lib/i386-linux-gnu/libstdc++.so.6.0.16
b7726000-b772e000 rw-p 00000000 00:00 0 
b772e000-b7731000 r-xp 00000000 08:05 2622410    /lib/i386-linux-gnu/libdl-2.13.so
b7731000-b7732000 r--p 00002000 08:05 2622410    /lib/i386-linux-gnu/libdl-2.13.so
b7732000-b7733000 rw-p 00003000 08:05 2622410    /lib/i386-linux-gnu/libdl-2.13.so
b7733000-b774a000 r-xp 00000000 08:05 2622421    /lib/i386-linux-gnu/libpthread-2.13.so
b774a000-b774b000 r--p 00016000 08:05 2622421    /lib/i386-linux-gnu/libpthread-2.13.so
b774b000-b774c000 rw-p 00017000 08:05 2622421    /lib/i386-linux-gnu/libpthread-2.13.so
b774c000-b774e000 rw-p 00000000 00:00 0 
b775e000-b775f000 rw-p 00000000 00:00 0 
b775f000-b7760000 ---p 00000000 00:00 0 
b7760000-b7763000 rw-p 00000000 00:00 0 
b7763000-b7765000 rw-s 00000000 08:05 15604031   /var/lib/boinc-client/slots/2/boinc_mmap_file
b7765000-b7767000 rw-p 00000000 00:00 0 
b7767000-b7768000 r-xp 00000000 00:00 0          [vdso]
b7768000-b7786000 r-xp 00000000 08:05 2622404    /lib/i386-linux-gnu/ld-2.13.so
b7786000-b7787000 r--p 0001d000 08:05 2622404    /lib/i386-linux-gnu/ld-2.13.so
b7787000-b7788000 rw-p 0001e000 08:05 2622404    /lib/i386-linux-gnu/ld-2.13.so
bfad8000-bfb47000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb7767400]
[0xb7767424]
/lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xb74abc8f]
/lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xb74af2b5]
/lib/i386-linux-gnu/libc.so.6(+0x63dfc)[0xb74e1dfc]
/lib/i386-linux-gnu/libc.so.6(+0x6ebc2)[0xb74ecbc2]
/lib/i386-linux-gnu/libc.so.6(+0x6f862)[0xb74ed862]
/lib/i386-linux-gnu/libc.so.6(cfree+0x6d)[0xb74f094d]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdlPv+0x1f)[0xb76ef80f]
/usr/lib/i386-linux-gnu/libstdc++.so.6(_ZdaPv+0x1b)[0xb76ef86b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xb7497113]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Dec 2011 01:04:13 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 259,200 530,530 2.0468
09 Dec 2011 07:07:12 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 233,280 479,911 2.0572
08 Dec 2011 08:48:14 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 207,360 427,511 2.0617
07 Dec 2011 16:19:28 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 181,440 373,716 2.0597
06 Dec 2011 15:16:56 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 155,520 320,318 2.0597
05 Dec 2011 07:00:31 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 129,600 267,583 2.0647
03 Dec 2011 00:39:09 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 103,680 213,732 2.0615
02 Dec 2011 04:25:44 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 77,760 160,524 2.0644
30 Nov 2011 09:51:54 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 51,840 106,780 2.0598
29 Nov 2011 08:01:04 1105963 13648747 hadcm3n_y7ut_1900_40_007343039_2 25,920 53,221 2.0533


©2024 climateprediction.net