climateprediction.net home page
Task 15597857

Task 15597857

Name hadcm3n_4e4b_1940_40_008309868_1
Workunit 8461003
Created 8 Feb 2013, 1:12:06 UTC
Sent 8 Feb 2013, 1:46:12 UTC
Report deadline 10 May 2013, 9:13:23 UTC
Received 22 Feb 2013, 17:00:41 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1203187
Run time 11 days 7 hours 37 min 32 sec
CPU time 11 days 7 hours 37 min 32 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.60 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
02:21:43 (11607): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:23:55 (11652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:26:14 (11693): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:29:14 (11746): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:24:47 (1693): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:27:46 (4904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:30:36 (4979): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:21:53 (3613): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:22:48 (9209): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:25:38 (14344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:29:34 (14410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:26:06 (7469): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:27:11 (7499): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:28:55 (7528): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:17:34 (30406): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:26:00 (811): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:30:54 (967): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:18:39 (18738): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:19:36 (29676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:24:27 (29748): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:28:46 (29810): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:27:43 (570): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:29:45 (3833): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x081d7220 ***
======= Backtrace: =========
/lib/i686/cmov/libc.so.6(+0x6b381)[0xf74d4381]
/lib/i686/cmov/libc.so.6(+0x6cbd8)[0xf74d5bd8]
/lib/i686/cmov/libc.so.6(cfree+0x6d)[0xf74d8cbd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76af701]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76af75d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf747fca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:03 4844757                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:03 4844757                            /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08181000-081e7000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fec000-f7467000 rw-s 00000000 08:03 4922019                            /var/lib/boinc-client/slots/6/134625
f7467000-f7469000 rw-p 00000000 00:00 0 
f7469000-f75a9000 r-xp 00000000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75a9000-f75aa000 ---p 00140000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75aa000-f75ac000 r--p 00140000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75ac000-f75ad000 rw-p 00142000 08:03 7440184                            /lib/i686/cmov/libc-2.11.3.so
f75ad000-f75b0000 rw-p 00000000 00:00 0 
f75b0000-f75cd000 r-xp 00000000 08:03 9451459                            /lib/libgcc_s.so.1
f75cd000-f75ce000 rw-p 0001c000 08:03 9451459                            /lib/libgcc_s.so.1
f75ce000-f75f2000 r-xp 00000000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f75f2000-f75f3000 r--p 00023000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f75f3000-f75f4000 rw-p 00024000 08:03 7440166                            /lib/i686/cmov/libm-2.11.3.so
f75f4000-f76dd000 r-xp 00000000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f76dd000-f76e1000 r--p 000e9000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f76e1000-f76e2000 rw-p 000ed000 08:03 53058                              /usr/lib/libstdc++.so.6.0.13
f76e2000-f76ea000 rw-p 00000000 00:00 0 
f76ea000-f76ec000 r-xp 00000000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f76ec000-f76ed000 r--p 00001000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f76ed000-f76ee000 rw-p 00002000 08:03 7440162                            /lib/i686/cmov/libdl-2.11.3.so
f76ee000-f7703000 r-xp 00000000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7703000-f7704000 r--p 00014000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7704000-f7705000 rw-p 00015000 08:03 7440174                            /lib/i686/cmov/libpthread-2.11.3.so
f7705000-f7707000 rw-p 00000000 00:00 0 
f7710000-f7711000 rw-p 00000000 00:00 0 
f7711000-f7712000 ---p 00000000 00:00 0 
f7712000-f7715000 rw-p 00000000 00:00 0 
f7715000-f7717000 rw-s 00000000 08:03 4922016                            /var/lib/boinc-client/slots/6/boinc_mmap_file
f7717000-f7719000 rw-p 00000000 00:00 0 
f7719000-f771a000 r-xp 00000000 00:00 0                                  [vdso]
f771a000-f7735000 r-xp 00000000 08:03 53232                              /lib/ld-2.11.3.so
f7735000-f7736000 r--p 0001b000 08:03 53232                              /lib/ld-2.11.3.so
f7736000-f7737000 rw-p 0001c000 08:03 53232                              /lib/ld-2.11.3.so
ffecb000-fff3a000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7719400]
[0xf7719425]
/lib/i686/cmov/libc.so.6(gsignal+0x51)[0xf7493781]
/lib/i686/cmov/libc.so.6(abort+0x182)[0xf7496bb2]
/lib/i686/cmov/libc.so.6(+0x61285)[0xf74ca285]
/lib/i686/cmov/libc.so.6(+0x6b381)[0xf74d4381]
/lib/i686/cmov/libc.so.6(+0x6cbd8)[0xf74d5bd8]
/lib/i686/cmov/libc.so.6(cfree+0x6d)[0xf74d8cbd]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76af701]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf76af75d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf747fca6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Feb 2013 09:52:12 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 518,400 977,844 1.8863
21 Feb 2013 16:50:58 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 492,480 928,723 1.8858
21 Feb 2013 01:02:57 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 466,560 880,110 1.8864
20 Feb 2013 09:28:14 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 440,640 831,475 1.8870
19 Feb 2013 17:52:12 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 414,720 782,844 1.8876
19 Feb 2013 02:06:47 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 388,800 734,355 1.8888
18 Feb 2013 06:22:48 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 362,880 684,973 1.8876
17 Feb 2013 06:51:35 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 336,960 635,487 1.8859
16 Feb 2013 13:30:16 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 311,040 585,996 1.8840
15 Feb 2013 19:38:43 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 285,120 536,496 1.8816
15 Feb 2013 02:40:55 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 259,200 487,530 1.8809
14 Feb 2013 10:51:08 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 233,280 438,682 1.8805
13 Feb 2013 19:01:58 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 207,360 390,677 1.8841
13 Feb 2013 03:40:17 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 181,440 342,881 1.8898
12 Feb 2013 10:45:04 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 155,520 294,766 1.8954
11 Feb 2013 19:01:56 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 129,600 246,697 1.9035
11 Feb 2013 02:14:47 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 103,680 198,581 1.9153
10 Feb 2013 09:17:16 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 77,760 149,726 1.9255
09 Feb 2013 16:15:51 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 51,840 100,311 1.9350
08 Feb 2013 20:57:35 1203187 15597857 hadcm3n_4e4b_1940_40_008309868_1 25,920 50,326 1.9416


©2024 climateprediction.net