climateprediction.net home page
Task 15550877

Task 15550877

Name hadcm3n_n5uu_1880_40_008285555_2
Workunit 8436690
Created 18 Jan 2013, 10:31:54 UTC
Sent 18 Jan 2013, 10:32:04 UTC
Report deadline 19 Apr 2013, 17:59:15 UTC
Received 21 Feb 2013, 11:34:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1171203
Run time 11 days 9 hours 50 min 1 sec
CPU time 10 days 22 hours 47 min 48 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.15 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
01:48:35 (12425): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:54:48 (12919): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:56:40 (13047): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:58:31 (13096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:09:09 (7892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:09:15 (7892): No heartbeat from core client for 30 sec - exiting
05:09:16 (7892): No heartbeat from core client for 30 sec - exiting
05:09:17 (7892): No heartbeat from core client for 30 sec - exiting
13:15:24 (3684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:15:30 (3684): No heartbeat from core client for 30 sec - exiting
13:15:31 (3684): No heartbeat from core client for 30 sec - exiting
13:15:32 (3684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a11d060 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d494d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c1a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c1aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:01 131312                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:01 131312                             /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0a0c7000-0a12b000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe4000-f745f000 rw-s 00000000 09:01 144455                             /var/lib/boinc-client/slots/1/138690
f745f000-f7461000 rw-p 00000000 00:00 0 
f7461000-f75ba000 r-xp 00000000 09:01 263916                             /lib32/libc-2.11.1.so
f75ba000-f75bb000 ---p 00159000 09:01 263916                             /lib32/libc-2.11.1.so
f75bb000-f75bd000 r--p 00159000 09:01 263916                             /lib32/libc-2.11.1.so
f75bd000-f75be000 rw-p 0015b000 09:01 263916                             /lib32/libc-2.11.1.so
f75be000-f75c1000 rw-p 00000000 00:00 0 
f75c1000-f75de000 r-xp 00000000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75de000-f75df000 r--p 0001c000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75df000-f75e0000 rw-p 0001d000 09:01 821291                             /usr/lib32/libgcc_s.so.1
f75e0000-f7604000 r-xp 00000000 09:01 263895                             /lib32/libm-2.11.1.so
f7604000-f7605000 r--p 00023000 09:01 263895                             /lib32/libm-2.11.1.so
f7605000-f7606000 rw-p 00024000 09:01 263895                             /lib32/libm-2.11.1.so
f7606000-f76ef000 r-xp 00000000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76ef000-f76f3000 r--p 000e9000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76f3000-f76f4000 rw-p 000ed000 09:01 821289                             /usr/lib32/libstdc++.so.6.0.13
f76f4000-f76fb000 rw-p 00000000 00:00 0 
f76fb000-f76fd000 r-xp 00000000 09:01 263913                             /lib32/libdl-2.11.1.so
f76fd000-f76fe000 r--p 00001000 09:01 263913                             /lib32/libdl-2.11.1.so
f76fe000-f76ff000 rw-p 00002000 09:01 263913                             /lib32/libdl-2.11.1.so
f76ff000-f7700000 rw-p 00000000 00:00 0 
f7700000-f7715000 r-xp 00000000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7715000-f7716000 r--p 00014000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7716000-f7717000 rw-p 00015000 09:01 263908                             /lib32/libpthread-2.11.1.so
f7717000-f7719000 rw-p 00000000 00:00 0 
f772d000-f772e000 rw-p 00000000 00:00 0 
f772e000-f772f000 ---p 00000000 00:00 0 
f772f000-f7732000 rw-p 00000000 00:00 0 
f7732000-f7734000 rw-s 00000000 09:01 144364                             /var/lib/boinc-client/slots/1/boinc_mmap_file
f7734000-f7736000 rw-p 00000000 00:00 0 
f7736000-f7737000 r-xp 00000000 00:00 0                                  [vdso]
f7737000-f7753000 r-xp 00000000 09:01 263905                             /lib32/ld-2.11.1.so
f7753000-f7754000 r--p 0001b000 09:01 263905                             /lib32/ld-2.11.1.so
f7754000-f7755000 rw-p 0001c000 09:01 263905                             /lib32/ld-2.11.1.so
ffaba000-ffb2a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7736400]
[0xf7736430]
/lib32/libc.so.6(gsignal+0x51)[0xf748b951]
/lib32/libc.so.6(abort+0x182)[0xf748ed82]
/lib32/libc.so.6(+0x64eed)[0xf74c5eed]
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d494d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c1a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c1aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Feb 2013 11:35:16 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 518,400 946,063 1.8250
20 Feb 2013 16:50:53 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 492,480 912,043 1.8519
20 Feb 2013 07:42:53 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 466,560 878,047 1.8820
19 Feb 2013 11:08:46 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 440,640 844,165 1.9158
18 Feb 2013 17:06:03 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 414,720 810,541 1.9544
18 Feb 2013 06:57:55 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 388,800 775,515 1.9946
17 Feb 2013 11:07:24 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 362,880 731,945 2.0170
16 Feb 2013 19:36:59 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 336,960 682,702 2.0261
16 Feb 2013 04:02:58 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 311,040 632,933 2.0349
15 Feb 2013 05:21:27 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 285,120 585,148 2.0523
13 Feb 2013 15:20:36 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 259,200 537,627 2.0742
12 Feb 2013 14:10:47 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 233,280 487,714 2.0907
11 Feb 2013 13:25:17 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 207,360 439,566 2.1198
10 Feb 2013 23:24:00 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 181,440 390,780 2.1538
10 Feb 2013 09:37:21 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 155,520 343,014 2.2056
09 Feb 2013 11:12:24 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 129,600 294,877 2.2753
03 Feb 2013 18:39:27 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 103,680 243,840 2.3519
02 Feb 2013 19:46:26 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 77,760 182,071 2.3414
01 Feb 2013 15:16:06 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 51,840 120,703 2.3284
31 Jan 2013 07:20:24 1171203 15550877 hadcm3n_n5uu_1880_40_008285555_2 25,920 58,940 2.2739


©2024 climateprediction.net