climateprediction.net home page
Task 12737751

Task 12737751

Name hadcm3n_o29z_1900_40_007198282_1
Workunit 7396562
Created 28 Mar 2011, 14:03:02 UTC
Sent 1 Apr 2011, 4:29:27 UTC
Report deadline 1 Jul 2011, 11:56:38 UTC
Received 20 Apr 2011, 15:58:50 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1068904
Run time 9 days 14 hours 21 min 49 sec
CPU time 8 days 14 hours 58 min 20 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:31:16 (5139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:31:23 (5139): No heartbeat from core client for 30 sec - exiting

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/o29zko.pja6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zko.pja6c10
Error: Input file: dataout/o29zko.pia6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zko.pia6c10
Error: Input file: dataout/o29zko.pfa6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zko.pfa6c10
Error: Input file: dataout/o29zka.pha6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zka.pha6c10
Error: Input file: dataout/o29zka.pga6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zka.pga6c10
Error: Input file: dataout/o29zka.pea6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zka.pea6c10
Error: Input file: dataout/o29zka.pda6c10 is not a valid UM file.
Error converting file to netcdf: dataout/o29zka.pda6c10
00:12:43 (5296): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:14:36 (28182): No heartbeat from core client for 30 sec - exiting
00:14:37 (28182): No heartbeat from core client for 30 sec - exiting
00:14:38 (28182): No heartbeat from core client for 30 sec - exiting
00:14:39 (28182): No heartbeat from core client for 30 sec - exiting
00:14:40 (28182): No heartbeat from core client for 30 sec - exiting
00:14:41 (28182): No heartbeat from core client for 30 sec - exiting
00:14:42 (28182): No heartbeat from core client for 30 sec - exiting
00:14:43 (28182): No heartbeat from core client for 30 sec - exiting
00:14:44 (28182): No heartbeat from core client for 30 sec - exiting
00:14:45 (28182): No heartbeat from core client for 30 sec - exiting
00:14:46 (28182): No heartbeat from core client for 30 sec - exiting
00:14:47 (28182): No heartbeat from core client for 30 sec - exiting
00:14:48 (28182): No heartbeat from core client for 30 sec - exiting
00:14:49 (28182): No heartbeat from core client for 30 sec - exiting
00:14:50 (28182): No heartbeat from core client for 30 sec - exiting
00:14:51 (28182): No heartbeat from core client for 30 sec - exiting
00:14:52 (28182): No heartbeat from core client for 30 sec - exiting
00:14:53 (28182): No heartbeat from core client for 30 sec - exiting
00:14:54 (28182): No heartbeat from core client for 30 sec - exiting
00:14:55 (28182): No heartbeat from core client for 30 sec - exiting
00:14:56 (28182): No heartbeat from core client for 30 sec - exiting
00:14:57 (28182): No heartbeat from core client for 30 sec - exiting
00:14:58 (28182): No heartbeat from core client for 30 sec - exiting
00:14:59 (28182): No heartbeat from core client for 30 sec - exiting
00:15:00 (28182): No heartbeat from core client for 30 sec - exiting
00:15:01 (28182): No heartbeat from core client for 30 sec - exiting
00:15:02 (28182): No heartbeat from core client for 30 sec - exiting
00:15:03 (28182): No heartbeat from core client for 30 sec - exiting
00:15:04 (28182): No heartbeat from core client for 30 sec - exiting
00:15:05 (28182): No heartbeat from core client for 30 sec - exiting
00:15:06 (28182): No heartbeat from core client for 30 sec - exiting
00:15:07 (28182): No heartbeat from core client for 30 sec - exiting
00:15:08 (28182): No heartbeat from core client for 30 sec - exiting
00:15:13 (28182): No heartbeat from core client for 30 sec - exiting
00:15:14 (28182): No heartbeat from core client for 30 sec - exiting
00:15:15 (28182): No heartbeat from core client for 30 sec - exiting
00:15:16 (28182): No heartbeat from core client for 30 sec - exiting
00:15:17 (28182): No heartbeat from core client for 30 sec - exiting
00:15:18 (28182): No heartbeat from core client for 30 sec - exiting
00:15:19 (28182): No heartbeat from core client for 30 sec - exiting
00:15:20 (28182): No heartbeat from core client for 30 sec - exiting
00:15:21 (28182): No heartbeat from core client for 30 sec - exiting
00:15:22 (28182): No heartbeat from core client for 30 sec - exiting
00:15:23 (28182): No heartbeat from core client for 30 sec - exiting
00:15:24 (28182): No heartbeat from core client for 30 sec - exiting
00:15:25 (28182): No heartbeat from core client for 30 sec - exiting
00:15:26 (28182): No heartbeat from core client for 30 sec - exiting
00:15:27 (28182): No heartbeat from core client for 30 sec - exiting
00:15:28 (28182): No heartbeat from core client for 30 sec - exiting
00:15:29 (28182): No heartbeat from core client for 30 sec - exiting
00:15:30 (28182): No heartbeat from core client for 30 sec - exiting
00:15:31 (28182): No heartbeat from core client for 30 sec - exiting
00:15:32 (28182): No heartbeat from core client for 30 sec - exiting
00:15:33 (28182): No heartbeat from core client for 30 sec - exiting
00:15:34 (28182): No heartbeat from core client for 30 sec - exiting
00:15:35 (28182): No heartbeat from core client for 30 sec - exiting
00:15:36 (28182): No heartbeat from core client for 30 sec - exiting
00:15:37 (28182): No heartbeat from core client for 30 sec - exiting
00:15:38 (28182): No heartbeat from core client for 30 sec - exiting
00:15:39 (28182): No heartbeat from core client for 30 sec - exiting
00:15:40 (28182): No heartbeat from core client for 30 sec - exiting
00:15:41 (28182): No heartbeat from core client for 30 sec - exiting
00:15:42 (28182): No heartbeat from core client for 30 sec - exiting
00:15:43 (28182): No heartbeat from core client for 30 sec - exiting
00:15:44 (28182): No heartbeat from core client for 30 sec - exiting
00:15:45 (28182): No heartbeat from core client for 30 sec - exiting
00:15:46 (28182): No heartbeat from core client for 30 sec - exiting
00:15:47 (28182): No heartbeat from core client for 30 sec - exiting
00:15:48 (28182): No heartbeat from core client for 30 sec - exiting
00:15:49 (28182): No heartbeat from core client for 30 sec - exiting
00:15:50 (28182): No heartbeat from core client for 30 sec - exiting
00:15:51 (28182): No heartbeat from core client for 30 sec - exiting
00:15:53 (28182): No heartbeat from core client for 30 sec - exiting
00:15:54 (28182): No heartbeat from core client for 30 sec - exiting
00:15:55 (28182): No heartbeat from core client for 30 sec - exiting
00:15:56 (28182): No heartbeat from core client for 30 sec - exiting
00:15:57 (28182): No heartbeat from core client for 30 sec - exiting
00:15:58 (28182): No heartbeat from core client for 30 sec - exiting
00:15:59 (28182): No heartbeat from core client for 30 sec - exiting
00:16:00 (28182): No heartbeat from core client for 30 sec - exiting
00:16:01 (28182): No heartbeat from core client for 30 sec - exiting
00:16:02 (28182): No heartbeat from core client for 30 sec - exiting
00:16:03 (28182): No heartbeat from core client for 30 sec - exiting
00:16:04 (28182): No heartbeat from core client for 30 sec - exiting
00:16:05 (28182): No heartbeat from core client for 30 sec - exiting
00:16:06 (28182): No heartbeat from core client for 30 sec - exiting
00:16:07 (28182): No heartbeat from core client for 30 sec - exiting
00:16:08 (28182): No heartbeat from core client for 30 sec - exiting
00:16:09 (28182): No heartbeat from core client for 30 sec - exiting
00:16:10 (28182): No heartbeat from core client for 30 sec - exiting
00:16:11 (28182): No heartbeat from core client for 30 sec - exiting
00:16:12 (28182): No heartbeat from core client for 30 sec - exiting
00:16:13 (28182): No heartbeat from core client for 30 sec - exiting
00:16:14 (28182): No heartbeat from core client for 30 sec - exiting
00:16:15 (28182): No heartbeat from core client for 30 sec - exiting
00:16:16 (28182): No heartbeat from core client for 30 sec - exiting
00:16:17 (28182): No heartbeat from core client for 30 sec - exiting
00:16:18 (28182): No heartbeat from core client for 30 sec - exiting
00:16:19 (28182): No heartbeat from core client for 30 sec - exiting
00:16:20 (28182): No heartbeat from core client for 30 sec - exiting
00:16:21 (28182): No heartbeat from core client for 30 sec - exiting
00:16:22 (28182): No heartbeat from core client for 30 sec - exiting
00:16:23 (28182): No heartbeat from core client for 30 sec - exiting
00:16:24 (28182): No heartbeat from core client for 30 sec - exiting
00:16:25 (28182): No heartbeat from core client for 30 sec - exiting
00:16:26 (28182): No heartbeat from core client for 30 sec - exiting
00:16:27 (28182): No heartbeat from core client for 30 sec - exiting
00:16:28 (28182): No heartbeat from core client for 30 sec - exiting
00:16:29 (28182): No heartbeat from core client for 30 sec - exiting
00:16:30 (28182): No heartbeat from core client for 30 sec - exiting
00:16:31 (28182): No heartbeat from core client for 30 sec - exiting
00:16:32 (28182): No heartbeat from core client for 30 sec - exiting
00:16:33 (28182): No heartbeat from core client for 30 sec - exiting
00:16:34 (28182): No heartbeat from core client for 30 sec - exiting
00:16:35 (28182): No heartbeat from core client for 30 sec - exiting
00:16:36 (28182): No heartbeat from core client for 30 sec - exiting
00:16:37 (28182): No heartbeat from core client for 30 sec - exiting
00:16:38 (28182): No heartbeat from core client for 30 sec - exiting
00:16:39 (28182): No heartbeat from core client for 30 sec - exiting
00:16:40 (28182): No heartbeat from core client for 30 sec - exiting
00:16:41 (28182): No heartbeat from core client for 30 sec - exiting
00:16:48 (28182): No heartbeat from core client for 30 sec - exiting
00:16:49 (28182): No heartbeat from core client for 30 sec - exiting
00:16:50 (28182): No heartbeat from core client for 30 sec - exiting
00:16:51 (28182): No heartbeat from core client for 30 sec - exiting
00:16:52 (28182): No heartbeat from core client for 30 sec - exiting
00:16:53 (28182): No heartbeat from core client for 30 sec - exiting
00:16:54 (28182): No heartbeat from core client for 30 sec - exiting
00:16:55 (28182): No heartbeat from core client for 30 sec - exiting
00:16:56 (28182): No heartbeat from core client for 30 sec - exiting
00:16:57 (28182): No heartbeat from core client for 30 sec - exiting
00:16:58 (28182): No heartbeat from core client for 30 sec - exiting
00:16:59 (28182): No heartbeat from core client for 30 sec - exiting
00:17:00 (28182): No heartbeat from core client for 30 sec - exiting
00:17:01 (28182): No heartbeat from core client for 30 sec - exiting
00:17:02 (28182): No heartbeat from core client for 30 sec - exiting
00:17:03 (28182): No heartbeat from core client for 30 sec - exiting
00:17:04 (28182): No heartbeat from core client for 30 sec - exiting
00:17:05 (28182): No heartbeat from core client for 30 sec - exiting
00:17:06 (28182): No heartbeat from core client for 30 sec - exiting
00:17:07 (28182): No heartbeat from core client for 30 sec - exiting
00:17:08 (28182): No heartbeat from core client for 30 sec - exiting
00:17:09 (28182): No heartbeat from core client for 30 sec - exiting
00:17:10 (28182): No heartbeat from core client for 30 sec - exiting
00:17:11 (28182): No heartbeat from core client for 30 sec - exiting
00:17:12 (28182): No heartbeat from core client for 30 sec - exiting
00:17:13 (28182): No heartbeat from core client for 30 sec - exiting
00:17:14 (28182): No heartbeat from core client for 30 sec - exiting
00:17:15 (28182): No heartbeat from core client for 30 sec - exiting
00:17:16 (28182): No heartbeat from core client for 30 sec - exiting
00:17:17 (28182): No heartbeat from core client for 30 sec - exiting
00:17:18 (28182): No heartbeat from core client for 30 sec - exiting
00:17:19 (28182): No heartbeat from core client for 30 sec - exiting
00:17:20 (28182): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:16:32 (7474): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:36:25 (19336): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x081c3740 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6c231)[0xf749c231]
/lib32/libc.so.6(+0x6dab8)[0xf749dab8]
/lib32/libc.so.6(cfree+0x6d)[0xf74a0b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf768aa91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf768aaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7446bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 fc:02 13238670                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 fc:02 13238670                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0816e000-081d3000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fb3000-f742e000 rw-s 00000000 fc:02 18481240                           /var/lib/boinc-client/slots/1/135200
f742e000-f7430000 rw-p 00000000 00:00 0 
f7430000-f7583000 r-xp 00000000 fc:02 2614                               /lib32/libc-2.11.1.so
f7583000-f7584000 ---p 00153000 fc:02 2614                               /lib32/libc-2.11.1.so
f7584000-f7586000 r--p 00153000 fc:02 2614                               /lib32/libc-2.11.1.so
f7586000-f7587000 rw-p 00155000 fc:02 2614                               /lib32/libc-2.11.1.so
f7587000-f758a000 rw-p 00000000 00:00 0 
f758a000-f75a7000 r-xp 00000000 fc:02 132650                             /usr/lib32/libgcc_s.so.1
f75a7000-f75a8000 r--p 0001c000 fc:02 132650                             /usr/lib32/libgcc_s.so.1
f75a8000-f75a9000 rw-p 0001d000 fc:02 132650                             /usr/lib32/libgcc_s.so.1
f75a9000-f75cd000 r-xp 00000000 fc:02 2642                               /lib32/libm-2.11.1.so
f75cd000-f75ce000 r--p 00023000 fc:02 2642                               /lib32/libm-2.11.1.so
f75ce000-f75cf000 rw-p 00024000 fc:02 2642                               /lib32/libm-2.11.1.so
f75cf000-f76b8000 r-xp 00000000 fc:02 133379                             /usr/lib32/libstdc++.so.6.0.13
f76b8000-f76b9000 ---p 000e9000 fc:02 133379                             /usr/lib32/libstdc++.so.6.0.13
f76b9000-f76bd000 r--p 000e9000 fc:02 133379                             /usr/lib32/libstdc++.so.6.0.13
f76bd000-f76be000 rw-p 000ed000 fc:02 133379                             /usr/lib32/libstdc++.so.6.0.13
f76be000-f76c5000 rw-p 00000000 00:00 0 
f76c5000-f76c7000 r-xp 00000000 fc:02 2633                               /lib32/libdl-2.11.1.so
f76c7000-f76c8000 r--p 00001000 fc:02 2633                               /lib32/libdl-2.11.1.so
f76c8000-f76c9000 rw-p 00002000 fc:02 2633                               /lib32/libdl-2.11.1.so
f76c9000-f76ca000 rw-p 00000000 00:00 0 
f76ca000-f76df000 r-xp 00000000 fc:02 3379                               /lib32/libpthread-2.11.1.so
f76df000-f76e0000 r--p 00014000 fc:02 3379                               /lib32/libpthread-2.11.1.so
f76e0000-f76e1000 rw-p 00015000 fc:02 3379                               /lib32/libpthread-2.11.1.so
f76e1000-f76e3000 rw-p 00000000 00:00 0 
f7701000-f7702000 rw-p 00000000 00:00 0 
f7702000-f7703000 ---p 00000000 00:00 0 
f7703000-f7706000 rw-p 00000000 00:00 0 
f7706000-f7708000 rw-s 00000000 fc:02 18481216                           /var/lib/boinc-client/slots/1/boinc_mmap_file
f7708000-f770a000 rw-p 00000000 00:00 0 
f770a000-f770b000 r-xp 00000000 00:00 0                                  [vdso]
f770b000-f7727000 r-xp 00000000 fc:02 2598                               /lib32/ld-2.11.1.so
f7727000-f7728000 r--p 0001b000 fc:02 2598                               /lib32/ld-2.11.1.so
f7728000-f7729000 rw-p 0001c000 fc:02 2598                               /lib32/ld-2.11.1.so
ff8b0000-ff920000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf770a400]
[0xf770a430]
/lib32/libc.so.6(gsignal+0x51)[0xf745a921]
/lib32/libc.so.6(abort+0x182)[0xf745dd52]
/lib32/libc.so.6(+0x6213d)[0xf749213d]
/lib32/libc.so.6(+0x6c231)[0xf749c231]
/lib32/libc.so.6(+0x6dab8)[0xf749dab8]
/lib32/libc.so.6(cfree+0x6d)[0xf74a0b9d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf768aa91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf768aaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7446bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Apr 2011 16:05:31 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 259,200 745,091 2.8746
20 Apr 2011 16:05:31 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 233,280 668,210 2.8644
13 Apr 2011 03:29:02 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 207,360 593,944 2.8643
11 Apr 2011 02:39:25 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 181,440 520,045 2.8662
10 Apr 2011 04:47:19 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 155,520 445,839 2.8668
09 Apr 2011 06:23:29 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 129,600 371,773 2.8686
07 Apr 2011 04:53:20 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 103,680 297,158 2.8661
05 Apr 2011 01:42:35 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 77,760 222,288 2.8586
03 Apr 2011 14:50:10 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 51,840 148,258 2.8599
02 Apr 2011 18:38:17 1068904 12737751 hadcm3n_o29z_1900_40_007198282_1 25,920 73,993 2.8547


©2024 climateprediction.net