climateprediction.net home page
Task 14845195

Task 14845195

Name hadcm3n_o4ok_2100_40_008026165_4
Workunit 8181279
Created 27 Jun 2012, 14:51:15 UTC
Sent 27 Jun 2012, 14:51:21 UTC
Report deadline 26 Sep 2012, 22:18:32 UTC
Received 26 Jul 2012, 6:55:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1100148
Run time 6 days 16 hours 23 min 48 sec
CPU time 6 days 10 hours 13 min 21 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.60 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:27:34 (5490): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:16:22 (31436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:00:36 (2137): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:17:22 (12367): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:50:55 (24234): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:56:21 (26294): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:24:10 (26669): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:44:05 (28384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:54:31 (4539): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09578f50 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6be01)[0xf74f1e01]
/lib32/libc.so.6(+0x6d688)[0xf74f3688]
/lib32/libc.so.6(cfree+0x6d)[0xf74f676d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76dfa91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76dfaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf749cbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 1835691                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 1835691                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09523000-09589000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7009000-f7484000 rw-s 00000000 08:01 3155924                            /var/lib/boinc-client/slots/61/135550
f7484000-f7486000 rw-p 00000000 00:00 0 
f7486000-f75d9000 r-xp 00000000 08:01 2359364                            /lib32/libc-2.11.1.so
f75d9000-f75db000 r--p 00153000 08:01 2359364                            /lib32/libc-2.11.1.so
f75db000-f75dc000 rw-p 00155000 08:01 2359364                            /lib32/libc-2.11.1.so
f75dc000-f75df000 rw-p 00000000 00:00 0 
f75df000-f75fc000 r-xp 00000000 08:01 5639359                            /usr/lib32/libgcc_s.so.1
f75fc000-f75fd000 r--p 0001c000 08:01 5639359                            /usr/lib32/libgcc_s.so.1
f75fd000-f75fe000 rw-p 0001d000 08:01 5639359                            /usr/lib32/libgcc_s.so.1
f75fe000-f7622000 r-xp 00000000 08:01 2359299                            /lib32/libm-2.11.1.so
f7622000-f7623000 r--p 00023000 08:01 2359299                            /lib32/libm-2.11.1.so
f7623000-f7624000 rw-p 00024000 08:01 2359299                            /lib32/libm-2.11.1.so
f7624000-f770d000 r-xp 00000000 08:01 5637858                            /usr/lib32/libstdc++.so.6.0.13
f770d000-f7711000 r--p 000e9000 08:01 5637858                            /usr/lib32/libstdc++.so.6.0.13
f7711000-f7712000 rw-p 000ed000 08:01 5637858                            /usr/lib32/libstdc++.so.6.0.13
f7712000-f7719000 rw-p 00000000 00:00 0 
f7719000-f771b000 r-xp 00000000 08:01 2359369                            /lib32/libdl-2.11.1.so
f771b000-f771c000 r--p 00001000 08:01 2359369                            /lib32/libdl-2.11.1.so
f771c000-f771d000 rw-p 00002000 08:01 2359369                            /lib32/libdl-2.11.1.so
f771d000-f771e000 rw-p 00000000 00:00 0 
f771e000-f7733000 r-xp 00000000 08:01 2359362                            /lib32/libpthread-2.11.1.so
f7733000-f7734000 r--p 00014000 08:01 2359362                            /lib32/libpthread-2.11.1.so
f7734000-f7735000 rw-p 00015000 08:01 2359362                            /lib32/libpthread-2.11.1.so
f7735000-f7737000 rw-p 00000000 00:00 0 
f774d000-f774e000 rw-p 00000000 00:00 0 
f774e000-f774f000 ---p 00000000 00:00 0 
f774f000-f7752000 rw-p 00000000 00:00 0 
f7752000-f7754000 rw-s 00000000 08:01 3155855                            /var/lib/boinc-client/slots/61/boinc_mmap_file
f7754000-f7756000 rw-p 00000000 00:00 0 
f7756000-f7757000 r-xp 00000000 00:00 0                                  [vdso]
f7757000-f7773000 r-xp 00000000 08:01 2359347                            /lib32/ld-2.11.1.so
f7773000-f7774000 r--p 0001b000 08:01 2359347                            /lib32/ld-2.11.1.so
f7774000-f7775000 rw-p 0001c000 08:01 2359347                            /lib32/ld-2.11.1.so
ffac8000-ffb39000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7756400]
[0xf7756430]
/lib32/libc.so.6(gsignal+0x51)[0xf74b0921]
/lib32/libc.so.6(abort+0x182)[0xf74b3d52]
/lib32/libc.so.6(+0x61d0d)[0xf74e7d0d]
/lib32/libc.so.6(+0x6be01)[0xf74f1e01]
/lib32/libc.so.6(+0x6d688)[0xf74f3688]
/lib32/libc.so.6(cfree+0x6d)[0xf74f676d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76dfa91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76dfaed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf749cbd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Jul 2012 01:44:00 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 259,200 555,196 2.1420
24 Jul 2012 14:30:29 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 233,280 498,749 2.1380
23 Jul 2012 21:01:02 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 207,360 443,174 2.1372
22 Jul 2012 21:39:58 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 181,440 387,221 2.1342
21 Jul 2012 21:14:23 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 155,520 331,982 2.1347
21 Jul 2012 13:07:05 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 129,600 279,496 2.1566
20 Jul 2012 09:32:12 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 103,680 224,633 2.1666
18 Jul 2012 19:37:21 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 77,760 168,736 2.1700
16 Jul 2012 23:38:10 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 51,840 113,223 2.1841
15 Jul 2012 13:53:14 1100148 14845195 hadcm3n_o4ok_2100_40_008026165_4 25,920 55,918 2.1573


©2024 climateprediction.net