climateprediction.net home page
Task 14651384

Task 14651384

Name hadcm3n_o0x0_2060_40_007958203_2
Workunit 8113315
Created 9 May 2012, 19:12:34 UTC
Sent 9 May 2012, 22:44:52 UTC
Report deadline 9 Aug 2012, 6:12:03 UTC
Received 26 Jun 2012, 12:16:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1179592
Run time 40 days 2 hours 4 min 31 sec
CPU time 39 days 23 hours 23 min 57 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 1.37 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:04:10 (19445): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:04:12 (19445): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
16:24:51 (24103): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:24:57 (24103): No heartbeat from core client for 30 sec - exiting
17:27:19 (26320): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:20:19 (26552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:31 (26792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:17:04 (26984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:22:33 (27245): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:27:55 (27452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:33:58 (27660): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:36:32 (27903): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:39:38 (28277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:17 (28501): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:06:00 (28709): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:47:29 (29092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:53:18 (29455): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:56 (29666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:45:19 (29870): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:32:12 (30169): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:48:22 (30387): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:49:03 (31433): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:03:06 (33388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:35:17 (33638): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:10 (34108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:39:54 (34355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:43:48 (34573): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:50:00 (34813): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:55:39 (35160): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:47 (35435): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:44:04 (35653): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:56:07 (35866): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:57:24 (36111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:17:07 (36333): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:05:56 (36967): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:06:02 (36967): No heartbeat from core client for 30 sec - exiting
13:06:03 (36967): No heartbeat from core client for 30 sec - exiting
14:07:59 (37759): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:16:26 (37997): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:20:59 (38221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:23:16 (38436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:50:02 (41590): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:55:35 (41876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:26:45 (42107): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x084f9b90 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6bff1)[0xf7575ff1]
/lib32/libc.so.6(+0x6d880)[0xf7577880]
/lib32/libc.so.6(cfree+0x6d)[0xf757a92d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77517b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf775180d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7520ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
084a4000-08509000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f708c000-f7507000 rw-s 00000000 08:02 9068568                            /var/lib/boinc-client/slots/30/133560
f7507000-f750a000 rw-p 00000000 00:00 0 
f750a000-f765e000 r-xp 00000000 08:02 9879703                            /lib32/libc-2.12.1.so
f765e000-f765f000 ---p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f765f000-f7661000 r--p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f7661000-f7662000 rw-p 00156000 08:02 9879703                            /lib32/libc-2.12.1.so
f7662000-f7665000 rw-p 00000000 00:00 0 
f7665000-f767f000 r-xp 00000000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f767f000-f7680000 r--p 00019000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f7680000-f7681000 rw-p 0001a000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f7681000-f76a5000 r-xp 00000000 08:02 9879707                            /lib32/libm-2.12.1.so
f76a5000-f76a6000 r--p 00023000 08:02 9879707                            /lib32/libm-2.12.1.so
f76a6000-f76a7000 rw-p 00024000 08:02 9879707                            /lib32/libm-2.12.1.so
f76a7000-f7786000 r-xp 00000000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7786000-f778a000 r--p 000de000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f778a000-f778b000 rw-p 000e2000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f778b000-f7792000 rw-p 00000000 00:00 0 
f7792000-f7794000 r-xp 00000000 08:02 9879706                            /lib32/libdl-2.12.1.so
f7794000-f7795000 r--p 00001000 08:02 9879706                            /lib32/libdl-2.12.1.so
f7795000-f7796000 rw-p 00002000 08:02 9879706                            /lib32/libdl-2.12.1.so
f7796000-f7797000 rw-p 00000000 00:00 0 
f7797000-f77ac000 r-xp 00000000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f77ac000-f77ad000 r--p 00014000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f77ad000-f77ae000 rw-p 00015000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f77ae000-f77b0000 rw-p 00000000 00:00 0 
f77c1000-f77c2000 rw-p 00000000 00:00 0 
f77c2000-f77c3000 ---p 00000000 00:00 0 
f77c3000-f77c6000 rw-p 00000000 00:00 0 
f77c6000-f77c8000 rw-s 00000000 08:02 9068565                            /var/lib/boinc-client/slots/30/boinc_mmap_file
f77c8000-f77ca000 rw-p 00000000 00:00 0 
f77ca000-f77cb000 r-xp 00000000 00:00 0                                  [vdso]
f77cb000-f77e7000 r-xp 00000000 08:02 9879700                            /lib32/ld-2.12.1.so
f77e7000-f77e8000 r--p 0001b000 08:02 9879700                            /lib32/ld-2.12.1.so
f77e8000-f77e9000 rw-p 0001c000 08:02 9879700                            /lib32/ld-2.12.1.so
ff9d9000-ffa4a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77ca400]
[0xf77ca425]
/lib32/libc.so.6(gsignal+0x51)[0xf7534a01]
/lib32/libc.so.6(abort+0x182)[0xf7537e42]
/lib32/libc.so.6(+0x61f15)[0xf756bf15]
/lib32/libc.so.6(+0x6bff1)[0xf7575ff1]
/lib32/libc.so.6(+0x6d880)[0xf7577880]
/lib32/libc.so.6(cfree+0x6d)[0xf757a92d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77517b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf775180d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7520ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Jun 2012 12:19:12 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 1,036,800 3,453,824 3.3312
25 Jun 2012 12:03:51 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 1,010,880 3,367,299 3.3311
24 Jun 2012 12:43:53 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 984,960 3,285,149 3.3353
23 Jun 2012 13:23:35 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 959,040 3,202,412 3.3392
22 Jun 2012 13:01:30 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 933,120 3,112,586 3.3357
21 Jun 2012 11:13:46 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 907,200 3,022,190 3.3313
20 Jun 2012 09:54:41 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 881,280 2,932,004 3.3270
19 Jun 2012 09:37:35 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 855,360 2,842,535 3.3232
18 Jun 2012 08:04:00 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 829,440 2,754,460 3.3209
17 Jun 2012 08:13:49 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 803,520 2,669,045 3.3217
16 Jun 2012 08:55:22 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 777,600 2,585,712 3.3252
15 Jun 2012 08:32:17 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 751,680 2,500,216 3.3262
14 Jun 2012 08:46:59 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 725,760 2,417,193 3.3306
13 Jun 2012 11:23:06 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 699,840 2,338,353 3.3413
12 Jun 2012 13:06:05 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 673,920 2,260,486 3.3542
11 Jun 2012 16:07:59 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 648,000 2,182,628 3.3683
10 Jun 2012 17:49:15 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 622,080 2,104,924 3.3837
09 Jun 2012 20:19:30 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 596,160 2,026,434 3.3991
08 Jun 2012 19:50:15 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 570,240 1,941,146 3.4041
07 Jun 2012 19:09:16 1179592 14651384 hadcm3n_o0x0_2060_40_007958203_2 544,320 1,852,258 3.4029


©2024 cpdn.org