climateprediction.net home page
Task 14837199

Task 14837199

Name hadcm3n_0016_1940_40_008000670_2
Workunit 8155784
Created 23 Jun 2012, 21:38:06 UTC
Sent 23 Jun 2012, 21:38:13 UTC
Report deadline 23 Sep 2012, 5:05:24 UTC
Received 15 Jul 2012, 19:48:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1164855
Run time 17 days 5 hours 2 min 52 sec
CPU time 16 days 22 hours 39 min 33 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.33 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
17:04:52 (4940): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:11:40 (7045): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:12:58 (7059): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:17:59 (7069): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:22:01 (7096): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:23:26 (7104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:24:52 (7112): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:26:19 (7120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:27:44 (7129): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:29:10 (7138): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:30:36 (7146): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:32:02 (7154): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:33:28 (7162): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:34:54 (7170): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:36:20 (7178): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:37:46 (7186): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:39:12 (7195): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:43:14 (7205): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:44:39 (7213): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:46:05 (7221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:47:31 (7229): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:48:57 (7237): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:50:23 (7245): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:51:49 (7253): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:53:15 (7261): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:54:41 (7269): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:56:07 (7279): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:57:33 (7287): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:58:59 (7295): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:00:25 (7303): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:01:51 (7311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:03:17 (7319): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:04:43 (7327): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:06:09 (7335): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:07:35 (7343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:09:01 (7352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:10:27 (7360): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:11:53 (7368): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:14:39 (7377): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:17:25 (7385): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:20:11 (7397): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:22:58 (7421): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:25:43 (7429): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:28:30 (7437): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:31:15 (7445): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:34:01 (7457): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:26:35 (4306): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:26:37 (4306): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x096c3a28 ***
======= Backtrace: =========
/lib/libc.so.6(+0x6c0c1)[0x27d0c1]
/lib/libc.so.6(+0x6d930)[0x27e930]
/lib/libc.so.6(cfree+0x6d)[0x281a1d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x926441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x92649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0x227ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
001f3000-0020f000 r-xp 00000000 08:02 31711234   /lib/ld-2.12.1.so
0020f000-00210000 r--p 0001b000 08:02 31711234   /lib/ld-2.12.1.so
00210000-00211000 rw-p 0001c000 08:02 31711234   /lib/ld-2.12.1.so
00211000-00368000 r-xp 00000000 08:02 31711250   /lib/libc-2.12.1.so
00368000-0036a000 r--p 00157000 08:02 31711250   /lib/libc-2.12.1.so
0036a000-0036b000 rw-p 00159000 08:02 31711250   /lib/libc-2.12.1.so
0036b000-0036e000 rw-p 00000000 00:00 0 
00392000-00393000 r-xp 00000000 00:00 0          [vdso]
00701000-00703000 r-xp 00000000 08:02 31711239   /lib/libdl-2.12.1.so
00703000-00704000 r--p 00001000 08:02 31711239   /lib/libdl-2.12.1.so
00704000-00705000 rw-p 00002000 08:02 31711239   /lib/libdl-2.12.1.so
007b2000-007c7000 r-xp 00000000 08:02 31711251   /lib/libpthread-2.12.1.so
007c7000-007c8000 ---p 00015000 08:02 31711251   /lib/libpthread-2.12.1.so
007c8000-007c9000 r--p 00015000 08:02 31711251   /lib/libpthread-2.12.1.so
007c9000-007ca000 rw-p 00016000 08:02 31711251   /lib/libpthread-2.12.1.so
007ca000-007cc000 rw-p 00000000 00:00 0 
0087c000-0095b000 r-xp 00000000 08:02 376955     /usr/lib/libstdc++.so.6.0.14
0095b000-0095f000 r--p 000de000 08:02 376955     /usr/lib/libstdc++.so.6.0.14
0095f000-00960000 rw-p 000e2000 08:02 376955     /usr/lib/libstdc++.so.6.0.14
00960000-00967000 rw-p 00000000 00:00 0 
00a2d000-00a51000 r-xp 00000000 08:02 31711248   /lib/libm-2.12.1.so
00a51000-00a52000 r--p 00023000 08:02 31711248   /lib/libm-2.12.1.so
00a52000-00a53000 rw-p 00024000 08:02 31711248   /lib/libm-2.12.1.so
00d5a000-00d74000 r-xp 00000000 08:02 29630492   /lib/libgcc_s.so.1
00d74000-00d75000 r--p 00019000 08:02 29630492   /lib/libgcc_s.so.1
00d75000-00d76000 rw-p 0001a000 08:02 29630492   /lib/libgcc_s.so.1
08048000-080e3000 r-xp 00000000 08:02 16278331   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:02 16278331   /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0966e000-096d3000 rw-p 00000000 00:00 0          [heap]
b7300000-b7321000 rw-p 00000000 00:00 0 
b7321000-b7400000 ---p 00000000 00:00 0 
b7458000-b78d3000 rw-s 00000000 08:02 12263494   /var/lib/boinc-client/slots/1/126690
b78d3000-b78d7000 rw-p 00000000 00:00 0 
b78e6000-b78e7000 rw-p 00000000 00:00 0 
b78e7000-b78e8000 ---p 00000000 00:00 0 
b78e8000-b78eb000 rw-p 00000000 00:00 0 
b78eb000-b78ed000 rw-s 00000000 08:02 12263491   /var/lib/boinc-client/slots/1/boinc_mmap_file
b78ed000-b78ef000 rw-p 00000000 00:00 0 
bff15000-bff84000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0x392400]
[0x392416]
/lib/libc.so.6(gsignal+0x51)[0x23b941]
/lib/libc.so.6(abort+0x182)[0x23ee42]
/lib/libc.so.6(+0x61ec5)[0x272ec5]
/lib/libc.so.6(+0x6c0c1)[0x27d0c1]
/lib/libc.so.6(+0x6d930)[0x27e930]
/lib/libc.so.6(cfree+0x6d)[0x281a1d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0x926441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0x92649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0x227ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jul 2012 16:44:16 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 777,600 1,463,961 1.8827
15 Jul 2012 03:06:16 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 751,680 1,415,637 1.8833
14 Jul 2012 13:35:52 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 725,760 1,367,149 1.8837
14 Jul 2012 00:53:29 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 699,840 1,318,577 1.8841
13 Jul 2012 10:24:48 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 673,920 1,270,230 1.8848
12 Jul 2012 18:25:23 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 648,000 1,221,546 1.8851
12 Jul 2012 04:25:57 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 622,080 1,173,024 1.8856
11 Jul 2012 14:40:02 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 596,160 1,123,888 1.8852
11 Jul 2012 00:57:02 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 570,240 1,075,101 1.8853
10 Jul 2012 11:31:01 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 544,320 1,025,899 1.8847
09 Jul 2012 21:32:58 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 518,400 977,418 1.8855
09 Jul 2012 07:54:39 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 492,480 928,877 1.8861
08 Jul 2012 18:20:05 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 466,560 880,332 1.8869
08 Jul 2012 04:14:10 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 440,640 831,708 1.8875
07 Jul 2012 14:31:17 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 414,720 783,022 1.8881
07 Jul 2012 01:23:56 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 388,800 734,146 1.8882
06 Jul 2012 11:04:36 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 362,880 685,295 1.8885
05 Jul 2012 21:16:58 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 336,960 636,486 1.8889
05 Jul 2012 07:33:15 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 311,040 587,650 1.8893
04 Jul 2012 18:07:12 1164855 14837199 hadcm3n_0016_1940_40_008000670_2 285,120 538,891 1.8900


©2024 cpdn.org