climateprediction.net (CPDN) home page
Task 13661836

Task 13661836

Name hadcm3n_ydpb_1900_40_007518455_4
Workunit 7715930
Created 25 Nov 2011, 19:10:44 UTC
Sent 25 Nov 2011, 19:17:41 UTC
Report deadline 25 Feb 2012, 2:44:52 UTC
Received 1 Jan 2012, 3:38:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1025691
Run time 21 days 11 hours 7 min 27 sec
CPU time 20 days 4 hours 38 min 17 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 1.63 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:32:31 (3803): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:27:40 (2117): No heartbeat from core client for 30 sec - exiting
12:27:41 (2117): No heartbeat from core client for 30 sec - exiting
12:27:42 (2117): No heartbeat from core client for 30 sec - exiting
12:27:43 (2117): No heartbeat from core client for 30 sec - exiting
12:27:44 (2117): No heartbeat from core client for 30 sec - exiting
12:27:45 (2117): No heartbeat from core client for 30 sec - exiting
12:27:46 (2117): No heartbeat from core client for 30 sec - exiting
12:27:47 (2117): No heartbeat from core client for 30 sec - exiting
12:27:48 (2117): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:44:22 (4056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:46:14 (4820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:47:37 (5445): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:50:00 (6311): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:52:23 (7241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:54:47 (8123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
09:03:44 (2102): No heartbeat from core client for 30 sec - exiting
09:03:46 (2102): No heartbeat from core client for 30 sec - exiting
09:03:48 (2102): No heartbeat from core client for 30 sec - exiting
09:03:49 (2102): No heartbeat from core client for 30 sec - exiting
09:03:50 (2102): No heartbeat from core client for 30 sec - exiting
09:03:51 (2102): No heartbeat from core client for 30 sec - exiting
09:03:52 (2102): No heartbeat from core client for 30 sec - exiting
09:03:53 (2102): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:15:02 (28543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:15:04 (28543): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:13:49 (3562): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:13:50 (3562): No heartbeat from core client for 30 sec - exiting
19:13:51 (3562): No heartbeat from core client for 30 sec - exiting
19:13:52 (3562): No heartbeat from core client for 30 sec - exiting
19:13:53 (3562): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
21:53:38 (3546): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09233bb0 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7508591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7509de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb750cecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb76f7741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb76f779d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb74b3bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 5373978    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 5373978    /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
091de000-09244000 rw-p 00000000 00:00 0          [heap]
b6f00000-b6f21000 rw-p 00000000 00:00 0 
b6f21000-b7000000 ---p 00000000 00:00 0 
b7020000-b749b000 rw-s 00000000 08:01 3286562    /var/lib/boinc-client/slots/4/139045
b749b000-b749d000 rw-p 00000000 00:00 0 
b749d000-b75f0000 r-xp 00000000 08:01 25034933   /lib/tls/i686/cmov/libc-2.11.1.so
b75f0000-b75f1000 ---p 00153000 08:01 25034933   /lib/tls/i686/cmov/libc-2.11.1.so
b75f1000-b75f3000 r--p 00153000 08:01 25034933   /lib/tls/i686/cmov/libc-2.11.1.so
b75f3000-b75f4000 rw-p 00155000 08:01 25034933   /lib/tls/i686/cmov/libc-2.11.1.so
b75f4000-b75f7000 rw-p 00000000 00:00 0 
b75f7000-b7614000 r-xp 00000000 08:01 25034835   /lib/libgcc_s.so.1
b7614000-b7615000 r--p 0001c000 08:01 25034835   /lib/libgcc_s.so.1
b7615000-b7616000 rw-p 0001d000 08:01 25034835   /lib/libgcc_s.so.1
b7616000-b763a000 r-xp 00000000 08:01 25034941   /lib/tls/i686/cmov/libm-2.11.1.so
b763a000-b763b000 r--p 00023000 08:01 25034941   /lib/tls/i686/cmov/libm-2.11.1.so
b763b000-b763c000 rw-p 00024000 08:01 25034941   /lib/tls/i686/cmov/libm-2.11.1.so
b763c000-b7725000 r-xp 00000000 08:01 11538099   /usr/lib/libstdc++.so.6.0.13
b7725000-b7726000 ---p 000e9000 08:01 11538099   /usr/lib/libstdc++.so.6.0.13
b7726000-b772a000 r--p 000e9000 08:01 11538099   /usr/lib/libstdc++.so.6.0.13
b772a000-b772b000 rw-p 000ed000 08:01 11538099   /usr/lib/libstdc++.so.6.0.13
b772b000-b7733000 rw-p 00000000 00:00 0 
b7733000-b7735000 r-xp 00000000 08:01 25034940   /lib/tls/i686/cmov/libdl-2.11.1.so
b7735000-b7736000 r--p 00001000 08:01 25034940   /lib/tls/i686/cmov/libdl-2.11.1.so
b7736000-b7737000 rw-p 00002000 08:01 25034940   /lib/tls/i686/cmov/libdl-2.11.1.so
b7737000-b774c000 r-xp 00000000 08:01 25035100   /lib/tls/i686/cmov/libpthread-2.11.1.so
b774c000-b774d000 r--p 00014000 08:01 25035100   /lib/tls/i686/cmov/libpthread-2.11.1.so
b774d000-b774e000 rw-p 00015000 08:01 25035100   /lib/tls/i686/cmov/libpthread-2.11.1.so
b774e000-b7750000 rw-p 00000000 00:00 0 
b7763000-b7764000 rw-p 00000000 00:00 0 
b7764000-b7765000 ---p 00000000 00:00 0 
b7765000-b7768000 rw-p 00000000 00:00 0 
b7768000-b776a000 rw-s 00000000 08:01 3286559    /var/lib/boinc-client/slots/4/boinc_mmap_file
b776a000-b776c000 rw-p 00000000 00:00 0 
b776c000-b776d000 r-xp 00000000 00:00 0          [vdso]
b776d000-b7788000 r-xp 00000000 08:01 25034808   /lib/ld-2.11.1.so
b7788000-b7789000 r--p 0001a000 08:01 25034808   /lib/ld-2.11.1.so
b7789000-b778a000 rw-p 0001b000 08:01 25034808   /lib/ld-2.11.1.so
bfacc000-bfb3c000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb776c400]
[0xb776c430]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x51)[0xb74c7651]
/lib/tls/i686/cmov/libc.so.6(abort+0x182)[0xb74caa82]
/lib/tls/i686/cmov/libc.so.6(+0x6149d)[0xb74fe49d]
/lib/tls/i686/cmov/libc.so.6(+0x6b591)[0xb7508591]
/lib/tls/i686/cmov/libc.so.6(+0x6cde8)[0xb7509de8]
/lib/tls/i686/cmov/libc.so.6(cfree+0x6d)[0xb750cecd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb76f7741]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb76f779d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb74b3bd6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Jan 2012 03:41:19 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 777,600 1,744,693 2.2437
31 Dec 2011 09:41:39 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 751,680 1,685,663 2.2425
30 Dec 2011 08:29:55 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 725,760 1,628,143 2.2434
29 Dec 2011 16:26:16 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 699,840 1,572,202 2.2465
28 Dec 2011 10:15:06 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 673,920 1,513,324 2.2456
26 Dec 2011 19:12:24 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 648,000 1,455,390 2.2460
26 Dec 2011 00:43:36 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 622,080 1,397,663 2.2468
24 Dec 2011 01:33:36 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 596,160 1,339,762 2.2473
22 Dec 2011 19:51:50 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 570,240 1,282,356 2.2488
22 Dec 2011 03:46:55 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 544,320 1,225,753 2.2519
21 Dec 2011 10:48:24 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 518,400 1,167,538 2.2522
20 Dec 2011 09:48:02 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 492,480 1,108,237 2.2503
18 Dec 2011 20:24:14 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 466,560 1,051,426 2.2536
17 Dec 2011 19:07:27 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 440,640 995,349 2.2589
16 Dec 2011 02:55:01 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 414,720 938,633 2.2633
14 Dec 2011 20:45:29 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 388,800 880,418 2.2644
13 Dec 2011 22:45:00 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 362,880 822,189 2.2657
12 Dec 2011 20:34:52 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 336,960 764,571 2.2690
11 Dec 2011 13:02:54 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 311,040 706,212 2.2705
10 Dec 2011 08:00:55 1025691 13661836 hadcm3n_ydpb_1900_40_007518455_4 285,120 646,980 2.2691


©2025 cpdn.org