climateprediction.net home page
Task 15794426

Task 15794426

Name hadcm3n_n347_1920_40_008371238_0
Workunit 8522097
Created 23 May 2013, 16:05:44 UTC
Sent 23 May 2013, 16:05:50 UTC
Report deadline 22 Aug 2013, 23:33:01 UTC
Received 1 Jun 2013, 6:18:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1179592
Run time 8 days 10 hours 28 min 38 sec
CPU time 8 days 9 hours 3 min 51 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.01 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
23:16:29 (2081): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:26:21 (2771): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:16:55 (3495): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:42:38 (6409): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:52:43 (6733): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:47:29 (7001): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:52:38 (7368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:47:51 (7572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:01:35 (7802): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:49:15 (8334): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:26 (8565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:02:27 (8772): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:08:22 (8972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:03:05 (9174): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:04:01 (9402): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:38:53 (9636): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:45:29 (9877): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:40:27 (10079): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:21:28 (10312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:45:48 (10608): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:56:09 (10850): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:47:32 (11136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:47:11 (11351): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:47:58 (11565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:52:36 (11797): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:49:23 (12006): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:50:17 (12240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:52:27 (12517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:55:57 (12784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:57:12 (13051): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:32 (13299): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:00:23 (13552): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:01:12 (13758): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:35 (14111): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:25:41 (14315): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:48:43 (14572): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:48:44 (14572): No heartbeat from core client for 30 sec - exiting
13:39:24 (14962): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:51:35 (15255): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:52:42 (15462): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:22:14 (16151): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:22:15 (16151): No heartbeat from core client for 30 sec - exiting
03:22:16 (16151): No heartbeat from core client for 30 sec - exiting
03:22:17 (16151): No heartbeat from core client for 30 sec - exiting
03:22:18 (16151): No heartbeat from core client for 30 sec - exiting
03:22:19 (16151): No heartbeat from core client for 30 sec - exiting
03:22:20 (16151): No heartbeat from core client for 30 sec - exiting
03:22:21 (16151): No heartbeat from core client for 30 sec - exiting
03:22:22 (16151): No heartbeat from core client for 30 sec - exiting
03:22:23 (16151): No heartbeat from core client for 30 sec - exiting
03:22:24 (16151): No heartbeat from core client for 30 sec - exiting
03:22:25 (16151): No heartbeat from core client for 30 sec - exiting
03:22:26 (16151): No heartbeat from core client for 30 sec - exiting
03:22:27 (16151): No heartbeat from core client for 30 sec - exiting
03:22:28 (16151): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09116a10 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6bff1)[0xf74ebff1]
/lib32/libc.so.6(+0x6d880)[0xf74ed880]
/lib32/libc.so.6(cfree+0x6d)[0xf74f092d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c77b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c780d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7496ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 3514599                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
090c1000-09126000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7002000-f747d000 rw-s 00000000 08:02 12386328                           /var/lib/boinc-client/slots/5/130785
f747d000-f7480000 rw-p 00000000 00:00 0 
f7480000-f75d4000 r-xp 00000000 08:02 9879703                            /lib32/libc-2.12.1.so
f75d4000-f75d5000 ---p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f75d5000-f75d7000 r--p 00154000 08:02 9879703                            /lib32/libc-2.12.1.so
f75d7000-f75d8000 rw-p 00156000 08:02 9879703                            /lib32/libc-2.12.1.so
f75d8000-f75db000 rw-p 00000000 00:00 0 
f75db000-f75f5000 r-xp 00000000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75f5000-f75f6000 r--p 00019000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75f6000-f75f7000 rw-p 0001a000 08:02 13436533                           /usr/lib32/libgcc_s.so.1
f75f7000-f761b000 r-xp 00000000 08:02 9879707                            /lib32/libm-2.12.1.so
f761b000-f761c000 r--p 00023000 08:02 9879707                            /lib32/libm-2.12.1.so
f761c000-f761d000 rw-p 00024000 08:02 9879707                            /lib32/libm-2.12.1.so
f761d000-f76fc000 r-xp 00000000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f76fc000-f7700000 r--p 000de000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7700000-f7701000 rw-p 000e2000 08:02 13436540                           /usr/lib32/libstdc++.so.6.0.14
f7701000-f7708000 rw-p 00000000 00:00 0 
f7708000-f770a000 r-xp 00000000 08:02 9879706                            /lib32/libdl-2.12.1.so
f770a000-f770b000 r--p 00001000 08:02 9879706                            /lib32/libdl-2.12.1.so
f770b000-f770c000 rw-p 00002000 08:02 9879706                            /lib32/libdl-2.12.1.so
f770c000-f770d000 rw-p 00000000 00:00 0 
f770d000-f7722000 r-xp 00000000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f7722000-f7723000 r--p 00014000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f7723000-f7724000 rw-p 00015000 08:02 9879717                            /lib32/libpthread-2.12.1.so
f7724000-f7726000 rw-p 00000000 00:00 0 
f7737000-f7738000 rw-p 00000000 00:00 0 
f7738000-f7739000 ---p 00000000 00:00 0 
f7739000-f773c000 rw-p 00000000 00:00 0 
f773c000-f773e000 rw-s 00000000 08:02 12386325                           /var/lib/boinc-client/slots/5/boinc_mmap_file
f773e000-f7740000 rw-p 00000000 00:00 0 
f7740000-f7741000 r-xp 00000000 00:00 0                                  [vdso]
f7741000-f775d000 r-xp 00000000 08:02 9879700                            /lib32/ld-2.12.1.so
f775d000-f775e000 r--p 0001b000 08:02 9879700                            /lib32/ld-2.12.1.so
f775e000-f775f000 rw-p 0001c000 08:02 9879700                            /lib32/ld-2.12.1.so
ffb55000-ffbc6000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7740400]
[0xf7740425]
/lib32/libc.so.6(gsignal+0x51)[0xf74aaa01]
/lib32/libc.so.6(abort+0x182)[0xf74ade42]
/lib32/libc.so.6(+0x61f15)[0xf74e1f15]
/lib32/libc.so.6(+0x6bff1)[0xf74ebff1]
/lib32/libc.so.6(+0x6d880)[0xf74ed880]
/lib32/libc.so.6(cfree+0x6d)[0xf74f092d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c77b1]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c780d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf7496ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jun 2013 06:22:09 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 259,200 723,742 2.7922
31 May 2013 08:46:14 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 233,280 648,258 2.7789
30 May 2013 08:44:09 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 207,360 564,004 2.7199
29 May 2013 10:43:35 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 181,440 487,592 2.6873
28 May 2013 11:54:53 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 155,520 408,924 2.6294
27 May 2013 14:10:51 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 129,600 334,401 2.5803
26 May 2013 19:16:19 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 103,680 267,743 2.5824
26 May 2013 00:42:48 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 77,760 200,955 2.5843
25 May 2013 06:46:25 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 51,840 134,641 2.5972
24 May 2013 11:23:44 1179592 15794426 hadcm3n_n347_1920_40_008371238_0 25,920 68,338 2.6365


©2024 climateprediction.net