climateprediction.net home page
Task 13468629

Task 13468629

Name hadcm3n_yh2k_1900_40_007354982_2
Workunit 7552412
Created 10 Oct 2011, 4:40:57 UTC
Sent 10 Oct 2011, 4:41:03 UTC
Report deadline 9 Jan 2012, 12:08:14 UTC
Received 3 Nov 2011, 19:53:06 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1366213
Run time 16 days 7 hours 48 min 38 sec
CPU time 16 days 7 hours 48 min 38 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.57 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>6.2.15</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
00:01:03 (4506): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:28:47 (31565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:24:24 (12343): No heartbeat from core client for 30 sec - exiting
04:24:28 (12343): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:00:45 (7672): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:00:47 (7672): No heartbeat from core client for 30 sec - exiting
00:00:48 (7672): No heartbeat from core client for 30 sec - exiting
00:00:46 (17938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:00:48 (17938): No heartbeat from core client for 30 sec - exiting
00:03:03 (12173): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
00:04:44 (2187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:04:45 (2187): No heartbeat from core client for 30 sec - exiting
00:04:46 (2187): No heartbeat from core client for 30 sec - exiting
00:04:47 (2187): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
00:03:02 (12167): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:00:59 (6448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:04:11 (502): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:04:12 (502): No heartbeat from core client for 30 sec - exiting
00:04:13 (502): No heartbeat from core client for 30 sec - exiting
00:04:14 (502): No heartbeat from core client for 30 sec - exiting
00:04:15 (502): No heartbeat from core client for 30 sec - exiting
00:04:16 (502): No heartbeat from core client for 30 sec - exiting
00:04:17 (502): No heartbeat from core client for 30 sec - exiting
00:04:18 (502): No heartbeat from core client for 30 sec - exiting
00:04:19 (502): No heartbeat from core client for 30 sec - exiting
00:04:20 (502): No heartbeat from core client for 30 sec - exiting
00:04:21 (502): No heartbeat from core client for 30 sec - exiting
00:04:22 (502): No heartbeat from core client for 30 sec - exiting
00:04:24 (502): No heartbeat from core client for 30 sec - exiting
00:04:25 (502): No heartbeat from core client for 30 sec - exiting
00:04:26 (502): No heartbeat from core client for 30 sec - exiting
00:04:27 (502): No heartbeat from core client for 30 sec - exiting
00:04:28 (502): No heartbeat from core client for 30 sec - exiting
00:04:29 (502): No heartbeat from core client for 30 sec - exiting
00:04:30 (502): No heartbeat from core client for 30 sec - exiting
00:04:31 (502): No heartbeat from core client for 30 sec - exiting
00:04:32 (502): No heartbeat from core client for 30 sec - exiting
00:04:33 (502): No heartbeat from core client for 30 sec - exiting
00:04:34 (502): No heartbeat from core client for 30 sec - exiting
00:01:32 (585): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:01:33 (585): No heartbeat from core client for 30 sec - exiting
00:01:34 (585): No heartbeat from core client for 30 sec - exiting
00:01:35 (585): No heartbeat from core client for 30 sec - exiting
00:01:36 (585): No heartbeat from core client for 30 sec - exiting
00:01:37 (585): No heartbeat from core client for 30 sec - exiting
00:01:38 (585): No heartbeat from core client for 30 sec - exiting
00:03:53 (27209): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:03:54 (27209): No heartbeat from core client for 30 sec - exiting
00:03:55 (27209): No heartbeat from core client for 30 sec - exiting
00:03:57 (27209): No heartbeat from core client for 30 sec - exiting
00:03:58 (27209): No heartbeat from core client for 30 sec - exiting
00:03:59 (27209): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a138f00 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7616591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7617de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb761aecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7805741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb780579d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb75c1bd6]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 1057101    /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:01 1057101    /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
0a0e3000-0a147000 rwxp 00000000 00:00 0          [heap]
b7000000-b7021000 rwxp 00000000 00:00 0 
b7021000-b7100000 ---p 00000000 00:00 0 
b712e000-b75a9000 rwxs 00000000 08:01 1441818    /home/boinc/BOINC/slots/2/137020
b75a9000-b75ab000 rwxp 00000000 00:00 0 
b75ab000-b76fe000 r-xp 00000000 08:05 1153095    /lib/tls/i686/cmov/libc-2.11.1.so
b76fe000-b76ff000 ---p 00153000 08:05 1153095    /lib/tls/i686/cmov/libc-2.11.1.so
b76ff000-b7701000 r-xp 00153000 08:05 1153095    /lib/tls/i686/cmov/libc-2.11.1.so
b7701000-b7702000 rwxp 00155000 08:05 1153095    /lib/tls/i686/cmov/libc-2.11.1.so
b7702000-b7705000 rwxp 00000000 00:00 0 
b7705000-b7722000 r-xp 00000000 08:05 1153143    /lib/libgcc_s.so.1
b7722000-b7723000 r-xp 0001c000 08:05 1153143    /lib/libgcc_s.so.1
b7723000-b7724000 rwxp 0001d000 08:05 1153143    /lib/libgcc_s.so.1
b7724000-b7748000 r-xp 00000000 08:05 1153106    /lib/tls/i686/cmov/libm-2.11.1.so
b7748000-b7749000 r-xp 00023000 08:05 1153106    /lib/tls/i686/cmov/libm-2.11.1.so
b7749000-b774a000 rwxp 00024000 08:05 1153106    /lib/tls/i686/cmov/libm-2.11.1.so
b774a000-b7833000 r-xp 00000000 08:05 344160     /usr/lib/libstdc++.so.6.0.13
b7833000-b7834000 ---p 000e9000 08:05 344160     /usr/lib/libstdc++.so.6.0.13
b7834000-b7838000 r-xp 000e9000 08:05 344160     /usr/lib/libstdc++.so.6.0.13
b7838000-b7839000 rwxp 000ed000 08:05 344160     /usr/lib/libstdc++.so.6.0.13
b7839000-b7841000 rwxp 00000000 00:00 0 
b7841000-b7843000 r-xp 00000000 08:05 1153105    /lib/tls/i686/cmov/libdl-2.11.1.so
b7843000-b7844000 r-xp 00001000 08:05 1153105    /lib/tls/i686/cmov/libdl-2.11.1.so
b7844000-b7845000 rwxp 00002000 08:05 1153105    /lib/tls/i686/cmov/libdl-2.11.1.so
b7845000-b785a000 r-xp 00000000 08:05 1154175    /lib/tls/i686/cmov/libpthread-2.11.1.so
b785a000-b785b000 r-xp 00014000 08:05 1154175    /lib/tls/i686/cmov/libpthread-2.11.1.so
b785b000-b785c000 rwxp 00015000 08:05 1154175    /lib/tls/i686/cmov/libpthread-2.11.1.so
b785c000-b785e000 rwxp 00000000 00:00 0 
b786b000-b786c000 rwxp 00000000 00:00 0 
b786c000-b786d000 ---p 00000000 00:00 0 
b786d000-b7870000 rwxp 00000000 00:00 0 
b7870000-b7872000 rwxs 00000000 08:01 1441815    /home/boinc/BOINC/slots/2/boinc_mmap_file
b7872000-b7874000 rwxp 00000000 00:00 0 
b7874000-b7875000 r-xp 00000000 00:00 0          [vdso]
b7875000-b7890000 r-xp 00000000 08:05 1152819    /lib/ld-2.11.1.so
b7890000-b7891000 r-xp 0001a000 08:05 1152819    /lib/ld-2.11.1.so
b7891000-b7892000 rwxp 0001b000 08:05 1152819    /lib/ld-2.11.1.so
bfc1c000-bfc8c000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb7874400]
[0xb7874422]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0xb75d5651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0xb75d8a82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0xb760c49d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7616591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7617de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb761aecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7805741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb780579d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb75c1bd6]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
03 Nov 2011 19:55:13 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 777,600 1,410,508 1.8139
03 Nov 2011 06:28:53 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 751,680 1,363,532 1.8140
02 Nov 2011 18:01:37 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 725,760 1,316,502 1.8140
02 Nov 2011 03:39:02 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 699,840 1,269,346 1.8138
01 Nov 2011 15:23:40 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 673,920 1,222,418 1.8139
01 Nov 2011 00:57:06 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 648,000 1,175,392 1.8139
31 Oct 2011 19:44:37 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 622,080 1,128,320 1.8138
31 Oct 2011 19:24:38 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 596,160 1,081,225 1.8136
31 Oct 2011 19:04:48 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 570,240 1,034,335 1.8139
31 Oct 2011 18:45:41 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 544,320 987,587 1.8144
31 Oct 2011 18:27:43 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 518,400 940,685 1.8146
31 Oct 2011 18:09:02 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 492,480 893,784 1.8149
31 Oct 2011 17:24:39 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 466,560 846,767 1.8149
31 Oct 2011 17:11:02 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 440,640 799,911 1.8153
31 Oct 2011 16:48:24 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 414,720 753,007 1.8157
31 Oct 2011 16:00:08 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 388,800 706,025 1.8159
31 Oct 2011 15:21:57 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 362,880 658,906 1.8158
31 Oct 2011 13:49:08 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 336,960 611,894 1.8159
31 Oct 2011 13:49:11 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 311,040 564,782 1.8158
31 Oct 2011 13:49:13 805269 13468629 hadcm3n_yh2k_1900_40_007354982_2 285,120 517,699 1.8157


©2024 climateprediction.net