climateprediction.net home page
Task 13645343

Task 13645343

Name hadcm3n_yajf_1900_40_007520779_3
Workunit 7718254
Created 19 Nov 2011, 1:30:58 UTC
Sent 19 Nov 2011, 1:39:05 UTC
Report deadline 18 Feb 2012, 9:06:16 UTC
Received 9 Dec 2011, 10:19:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 923026
Run time 9 days 12 hours 50 min 1 sec
CPU time 9 days 3 hours 8 min 20 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 3.26 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.10.56</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
02:10:34 (12765): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:10:36 (12765): No heartbeat from core client for 30 sec - exiting
02:10:37 (12765): No heartbeat from core client for 30 sec - exiting
02:10:38 (12765): No heartbeat from core client for 30 sec - exiting
02:10:39 (12765): No heartbeat from core client for 30 sec - exiting
02:10:40 (12765): No heartbeat from core client for 30 sec - exiting
02:10:41 (12765): No heartbeat from core client for 30 sec - exiting
02:10:42 (12765): No heartbeat from core client for 30 sec - exiting
02:10:43 (12765): No heartbeat from core client for 30 sec - exiting
02:10:44 (12765): No heartbeat from core client for 30 sec - exiting
02:10:45 (12765): No heartbeat from core client for 30 sec - exiting
02:10:46 (12765): No heartbeat from core client for 30 sec - exiting
02:10:47 (12765): No heartbeat from core client for 30 sec - exiting
02:10:48 (12765): No heartbeat from core client for 30 sec - exiting
02:10:49 (12765): No heartbeat from core client for 30 sec - exiting
02:10:50 (12765): No heartbeat from core client for 30 sec - exiting
02:10:51 (12765): No heartbeat from core client for 30 sec - exiting
02:10:52 (12765): No heartbeat from core client for 30 sec - exiting
02:10:53 (12765): No heartbeat from core client for 30 sec - exiting
02:10:54 (12765): No heartbeat from core client for 30 sec - exiting
02:10:55 (12765): No heartbeat from core client for 30 sec - exiting
02:10:56 (12765): No heartbeat from core client for 30 sec - exiting
02:10:57 (12765): No heartbeat from core client for 30 sec - exiting
02:10:58 (12765): No heartbeat from core client for 30 sec - exiting
02:10:59 (12765): No heartbeat from core client for 30 sec - exiting
02:11:00 (12765): No heartbeat from core client for 30 sec - exiting
02:11:01 (12765): No heartbeat from core client for 30 sec - exiting
02:11:02 (12765): No heartbeat from core client for 30 sec - exiting
02:11:03 (12765): No heartbeat from core client for 30 sec - exiting
02:11:04 (12765): No heartbeat from core client for 30 sec - exiting
02:11:05 (12765): No heartbeat from core client for 30 sec - exiting
02:11:06 (12765): No heartbeat from core client for 30 sec - exiting
02:11:07 (12765): No heartbeat from core client for 30 sec - exiting
02:11:08 (12765): No heartbeat from core client for 30 sec - exiting
02:11:09 (12765): No heartbeat from core client for 30 sec - exiting
02:11:10 (12765): No heartbeat from core client for 30 sec - exiting
02:11:11 (12765): No heartbeat from core client for 30 sec - exiting
02:11:12 (12765): No heartbeat from core client for 30 sec - exiting
02:11:13 (12765): No heartbeat from core client for 30 sec - exiting
02:11:14 (12765): No heartbeat from core client for 30 sec - exiting
02:11:15 (12765): No heartbeat from core client for 30 sec - exiting
02:11:16 (12765): No heartbeat from core client for 30 sec - exiting
02:11:17 (12765): No heartbeat from core client for 30 sec - exiting
02:11:18 (12765): No heartbeat from core client for 30 sec - exiting
02:11:19 (12765): No heartbeat from core client for 30 sec - exiting
02:11:20 (12765): No heartbeat from core client for 30 sec - exiting
02:11:21 (12765): No heartbeat from core client for 30 sec - exiting
02:11:22 (12765): No heartbeat from core client for 30 sec - exiting
02:11:23 (12765): No heartbeat from core client for 30 sec - exiting
02:11:24 (12765): No heartbeat from core client for 30 sec - exiting
02:11:25 (12765): No heartbeat from core client for 30 sec - exiting
02:11:26 (12765): No heartbeat from core client for 30 sec - exiting
02:11:27 (12765): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:01:14 (2189): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x092e8e18 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6eb72)[0xf74a2b72]
/lib32/libc.so.6(+0x6f812)[0xf74a3812]
/lib32/libc.so.6(cfree+0x6d)[0xf74a68cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76a3baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76a3c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf744d0f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:09 66847572                           /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:09 66847572                           /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
09293000-092f7000 rwxp 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rwxp 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fb6000-f7431000 rwxs 00000000 08:09 67371128                           /home/boinc/BOINC/slots/0/139180
f7431000-f7434000 rwxp 00000000 00:00 0 
f7434000-f75a7000 r-xp 00000000 08:06 1083911                            /lib32/libc-2.13.so
f75a7000-f75a8000 ---p 00173000 08:06 1083911                            /lib32/libc-2.13.so
f75a8000-f75aa000 r-xp 00173000 08:06 1083911                            /lib32/libc-2.13.so
f75aa000-f75ab000 rwxp 00175000 08:06 1083911                            /lib32/libc-2.13.so
f75ab000-f75ae000 rwxp 00000000 00:00 0 
f75ae000-f75ca000 r-xp 00000000 08:06 476803                             /usr/lib32/libgcc_s.so.1
f75ca000-f75cb000 r-xp 0001b000 08:06 476803                             /usr/lib32/libgcc_s.so.1
f75cb000-f75cc000 rwxp 0001c000 08:06 476803                             /usr/lib32/libgcc_s.so.1
f75cc000-f75f4000 r-xp 00000000 08:06 1083926                            /lib32/libm-2.13.so
f75f4000-f75f5000 r-xp 00028000 08:06 1083926                            /lib32/libm-2.13.so
f75f5000-f75f6000 rwxp 00029000 08:06 1083926                            /lib32/libm-2.13.so
f75f6000-f76d4000 r-xp 00000000 08:06 476363                             /usr/lib32/libstdc++.so.6.0.16
f76d4000-f76d5000 ---p 000de000 08:06 476363                             /usr/lib32/libstdc++.so.6.0.16
f76d5000-f76d9000 r-xp 000de000 08:06 476363                             /usr/lib32/libstdc++.so.6.0.16
f76d9000-f76da000 rwxp 000e2000 08:06 476363                             /usr/lib32/libstdc++.so.6.0.16
f76da000-f76e2000 rwxp 00000000 00:00 0 
f76e2000-f76e5000 r-xp 00000000 08:06 1083913                            /lib32/libdl-2.13.so
f76e5000-f76e6000 r-xp 00002000 08:06 1083913                            /lib32/libdl-2.13.so
f76e6000-f76e7000 rwxp 00003000 08:06 1083913                            /lib32/libdl-2.13.so
f76e7000-f76fe000 r-xp 00000000 08:06 1083923                            /lib32/libpthread-2.13.so
f76fe000-f76ff000 r-xp 00016000 08:06 1083923                            /lib32/libpthread-2.13.so
f76ff000-f7700000 rwxp 00017000 08:06 1083923                            /lib32/libpthread-2.13.so
f7700000-f7702000 rwxp 00000000 00:00 0 
f7720000-f7721000 rwxp 00000000 00:00 0 
f7721000-f7722000 ---p 00000000 00:00 0 
f7722000-f7725000 rwxp 00000000 00:00 0 
f7725000-f7727000 rwxs 00000000 08:09 67371124                           /home/boinc/BOINC/slots/0/boinc_mmap_file
f7727000-f7729000 rwxp 00000000 00:00 0 
f7729000-f772a000 r-xp 00000000 00:00 0                                  [vdso]
f772a000-f7748000 r-xp 00000000 08:06 427036                             /lib/i386-linux-gnu/ld-2.13.so
f7748000-f7749000 r-xp 0001d000 08:06 427036                             /lib/i386-linux-gnu/ld-2.13.so
f7749000-f774a000 rwxp 0001e000 08:06 427036                             /lib/i386-linux-gnu/ld-2.13.so
ffbf1000-ffc61000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7729400]
[0xf7729430]
/lib32/libc.so.6(gsignal+0x4f)[0xf7461c4f]
/lib32/libc.so.6(abort+0x175)[0xf7465175]
/lib32/libc.so.6(+0x63e8c)[0xf7497e8c]
/lib32/libc.so.6(+0x6eb72)[0xf74a2b72]
/lib32/libc.so.6(+0x6f812)[0xf74a3812]
/lib32/libc.so.6(cfree+0x6d)[0xf74a68cd]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf76a3baf]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf76a3c0b]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xf3)[0xf744d0f3]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Dec 2011 10:23:01 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 518,400 788,886 1.5218
08 Dec 2011 00:50:33 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 492,480 749,610 1.5221
07 Dec 2011 13:28:26 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 466,560 710,415 1.5227
07 Dec 2011 02:13:35 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 440,640 671,279 1.5234
06 Dec 2011 13:36:19 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 414,720 631,191 1.5220
06 Dec 2011 02:07:39 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 388,800 591,159 1.5205
05 Dec 2011 14:32:43 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 362,880 551,115 1.5187
05 Dec 2011 02:54:33 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 336,960 511,160 1.5170
04 Dec 2011 15:16:34 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 311,040 471,210 1.5149
04 Dec 2011 03:43:45 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 285,120 431,247 1.5125
03 Dec 2011 16:13:10 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 259,200 391,247 1.5094
03 Dec 2011 04:45:22 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 233,280 351,447 1.5065
02 Dec 2011 18:09:51 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 207,360 312,393 1.5065
02 Dec 2011 05:30:59 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 181,440 273,210 1.5058
01 Dec 2011 18:14:01 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 155,520 234,170 1.5057
01 Dec 2011 07:00:12 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 129,600 195,121 1.5056
30 Nov 2011 19:45:26 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 103,680 156,083 1.5054
30 Nov 2011 08:31:31 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 77,760 117,061 1.5054
29 Nov 2011 21:17:48 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 51,840 78,055 1.5057
29 Nov 2011 09:57:01 923026 13645343 hadcm3n_yajf_1900_40_007520779_3 25,920 39,059 1.5069


©2024 climateprediction.net