climateprediction.net home page
Task 16029962

Task 16029962

Name hadcm3n_7yqm_1980_40_008456305_2
Workunit 8607161
Created 21 Sep 2013, 17:54:19 UTC
Sent 21 Sep 2013, 18:03:19 UTC
Report deadline 22 Dec 2013, 1:30:30 UTC
Received 6 Oct 2013, 19:24:21 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1280554
Run time 6 days 7 hours 9 min 18 sec
CPU time 6 days 3 hours 49 min 9 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.08 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>7.0.36</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
03:58:38 (30497): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:30:22 (16866): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:34:06 (28730): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
20:38:40 (2217): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:53:46 (30738): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:35:00 (29916): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:16:31 (18190): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:32:15 (23915): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:24:24 (18931): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:50:50 (23417): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:50:58 (11876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:03 (1001): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:32 (11041): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:36:11 (25000): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:42:23 (19376): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:13:58 (24681): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:38:26 (6807): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:22:07 (26085): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:28:35 (22108): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:38:36 (30521): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:21 (7656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:04:05 (22405): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:34:02 (32744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:03:32 (18678): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:58:31 (21652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:09:44 (25301): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:05:59 (15127): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:28:07 (13288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
23:32:41 (12027): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
*** Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08aa56a0 ***
======= Backtrace: =========
/lib/libc.so.6(+0x75df2)[0xf748cdf2]
/lib/libstdc++.so.6(_ZdlPv+0x1f)[0xf767285f]
/lib/libstdc++.so.6(_ZdaPv+0x1b)[0xf76728ab]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7430a35]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:05 797493                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:05 797493                             /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08a56000-08adc000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6f99000-f7414000 rw-s 00000000 08:05 789800                             /var/lib/boinc/slots/3/138005
f7414000-f7417000 rw-p 00000000 00:00 0 
f7417000-f75c4000 r-xp 00000000 08:05 111                                /usr/lib/libc-2.17.so
f75c4000-f75c6000 r--p 001ad000 08:05 111                                /usr/lib/libc-2.17.so
f75c6000-f75c7000 rw-p 001af000 08:05 111                                /usr/lib/libc-2.17.so
f75c7000-f75ca000 rw-p 00000000 00:00 0 
f75ca000-f75e4000 r-xp 00000000 08:05 938                                /usr/lib/libgcc_s-4.7.2.so.1
f75e4000-f75e5000 r--p 00019000 08:05 938                                /usr/lib/libgcc_s-4.7.2.so.1
f75e5000-f75e6000 rw-p 0001a000 08:05 938                                /usr/lib/libgcc_s-4.7.2.so.1
f75e6000-f75e7000 rw-p 00000000 00:00 0 
f75e7000-f7628000 r-xp 00000000 08:05 119                                /usr/lib/libm-2.17.so
f7628000-f7629000 r--p 00040000 08:05 119                                /usr/lib/libm-2.17.so
f7629000-f762a000 rw-p 00041000 08:05 119                                /usr/lib/libm-2.17.so
f762a000-f7706000 r-xp 00000000 08:05 802                                /usr/lib/libstdc++.so.6.0.17
f7706000-f770a000 r--p 000db000 08:05 802                                /usr/lib/libstdc++.so.6.0.17
f770a000-f770b000 rw-p 000df000 08:05 802                                /usr/lib/libstdc++.so.6.0.17
f770b000-f7712000 rw-p 00000000 00:00 0 
f7712000-f7715000 r-xp 00000000 08:05 117                                /usr/lib/libdl-2.17.so
f7715000-f7716000 r--p 00002000 08:05 117                                /usr/lib/libdl-2.17.so
f7716000-f7717000 rw-p 00003000 08:05 117                                /usr/lib/libdl-2.17.so
f7717000-f772d000 r-xp 00000000 08:05 137                                /usr/lib/libpthread-2.17.so
f772d000-f772e000 r--p 00015000 08:05 137                                /usr/lib/libpthread-2.17.so
f772e000-f772f000 rw-p 00016000 08:05 137                                /usr/lib/libpthread-2.17.so
f772f000-f7731000 rw-p 00000000 00:00 0 
f774b000-f774d000 rw-p 00000000 00:00 0 
f774d000-f774e000 ---p 00000000 00:00 0 
f774e000-f7751000 rw-p 00000000 00:00 0                                  [stack:15902]
f7751000-f7753000 rw-s 00000000 08:05 789225                             /var/lib/boinc/slots/3/boinc_mmap_file
f7753000-f7754000 rw-p 00000000 00:00 0 
f7754000-f7755000 r-xp 00000000 00:00 0                                  [vdso]
f7755000-f7773000 r-xp 00000000 08:05 104                                /usr/lib/ld-2.17.so
f7773000-f7774000 r--p 0001d000 08:05 104                                /usr/lib/ld-2.17.so
f7774000-f7775000 rw-p 0001e000 08:05 104                                /usr/lib/ld-2.17.so
fff75000-fffe4000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7754400]
linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7754430]
/lib/libc.so.6(gsignal+0x4f)[0xf74448bf]
/lib/libc.so.6(abort+0x143)[0xf74462d3]
/lib/libc.so.6(+0x6e715)[0xf7485715]
/lib/libc.so.6(+0x75df2)[0xf748cdf2]
/lib/libstdc++.so.6(_ZdlPv+0x1f)[0xf767285f]
/lib/libstdc++.so.6(_ZdaPv+0x1b)[0xf76728ab]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xf5)[0xf7430a35]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Oct 2013 19:25:53 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 777,600 532,147 0.6843
06 Oct 2013 14:17:58 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 751,680 514,278 0.6842
06 Oct 2013 09:15:11 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 725,760 496,522 0.6841
05 Oct 2013 21:59:05 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 699,840 478,724 0.6840
29 Sep 2013 21:35:03 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 673,920 461,137 0.6843
29 Sep 2013 16:26:32 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 648,000 443,370 0.6842
29 Sep 2013 11:19:44 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 622,080 425,721 0.6844
29 Sep 2013 06:17:43 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 596,160 408,007 0.6844
29 Sep 2013 01:06:15 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 570,240 390,305 0.6845
28 Sep 2013 19:54:38 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 544,320 372,510 0.6844
28 Sep 2013 14:57:09 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 518,400 354,747 0.6843
28 Sep 2013 09:55:23 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 492,480 336,989 0.6843
28 Sep 2013 04:37:57 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 466,560 319,131 0.6840
27 Sep 2013 23:30:36 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 440,640 301,288 0.6838
27 Sep 2013 18:08:41 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 414,720 283,122 0.6827
27 Sep 2013 13:09:26 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 388,800 265,293 0.6823
27 Sep 2013 08:01:56 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 362,880 247,429 0.6818
27 Sep 2013 02:55:22 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 336,960 229,479 0.6810
26 Sep 2013 21:53:40 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 311,040 211,770 0.6808
25 Sep 2013 09:24:23 1280554 16029962 hadcm3n_7yqm_1980_40_008456305_2 285,120 194,250 0.6813


©2024 climateprediction.net