climateprediction.net home page
Task 15780493

Task 15780493

Name hadcm3n_4bhu_1940_40_008301944_4
Workunit 8453079
Created 13 May 2013, 5:04:10 UTC
Sent 13 May 2013, 5:06:20 UTC
Report deadline 12 Aug 2013, 12:33:31 UTC
Received 9 Jun 2013, 13:38:39 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1110299
Run time 26 days 2 hours 2 min 15 sec
CPU time 23 days 6 hours 19 min 41 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 2.94 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:10:51 (610): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:10:54 (610): No heartbeat from core client for 30 sec - exiting
10:10:55 (610): No heartbeat from core client for 30 sec - exiting
10:10:56 (610): No heartbeat from core client for 30 sec - exiting
10:10:57 (610): No heartbeat from core client for 30 sec - exiting
10:10:58 (610): No heartbeat from core client for 30 sec - exiting
10:10:59 (610): No heartbeat from core client for 30 sec - exiting
10:11:00 (610): No heartbeat from core client for 30 sec - exiting
10:11:01 (610): No heartbeat from core client for 30 sec - exiting
19:34:49 (60476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:14:28 (71559): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:08 (84305): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:16:09 (84305): No heartbeat from core client for 30 sec - exiting
09:16:10 (84305): No heartbeat from core client for 30 sec - exiting
03:55:33 (85503): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:15:30 (3974): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:15:32 (3974): No heartbeat from core client for 30 sec - exiting
08:15:33 (3974): No heartbeat from core client for 30 sec - exiting
08:15:34 (3974): No heartbeat from core client for 30 sec - exiting
08:15:35 (3974): No heartbeat from core client for 30 sec - exiting
08:15:36 (3974): No heartbeat from core client for 30 sec - exiting
08:15:37 (3974): No heartbeat from core client for 30 sec - exiting
08:15:39 (3974): No heartbeat from core client for 30 sec - exiting
08:15:40 (3974): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
12:55:01 (8486): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:28:18 (13101): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:07:22 (489): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:08:54 (4674): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:49:31 (5757): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:51:07 (34786): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:51:08 (34786): No heartbeat from core client for 30 sec - exiting
17:51:09 (34786): No heartbeat from core client for 30 sec - exiting
17:51:10 (34786): No heartbeat from core client for 30 sec - exiting
00:58:09 (35869): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:01:22 (42976): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
17:54:16 (52735): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x481c004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x481c000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x820004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x820000: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6821a04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6821a00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(14402,0xacf142c0) malloc: *** error for object 0x6001800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x4a1d004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0xa25004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x6a12804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x6a12800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x9206604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x9206600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x9201804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x9201800: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(649,0xacf142c0) malloc: *** error for object 0x9201804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G63
Sun Jun  9 14:03:15 2013

Thread 0 Crashed:

Thread 1:

atos cannot load symbols for the file hadcm3n_6.07_i686-apple-darwin for architecture i386.
Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fd88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/15/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x9026c000 - 0x9026ffff /usr/lib/system/libmathCommon.A.dylib
0x9038d000 - 0x903abfff /usr/lib/system/libsystem_kernel.dylib
0x90463000 - 0x90491fff /usr/lib/libSystem.B.dylib
0x9081a000 - 0x9087cfff /usr/lib/libstdc++.6.dylib
0x90b16000 - 0x90b1bfff /usr/lib/system/libmacho.dylib
0x911af000 - 0x911b0fff /usr/lib/system/libremovefile.dylib
0x91ec6000 - 0x91ecafff /usr/lib/system/libsystem_network.dylib
0x926ee000 - 0x926fcfff /usr/lib/libz.1.dylib
0x93163000 - 0x93163fff /usr/lib/system/libkeymgr.dylib
0x93b82000 - 0x93b8afff /usr/lib/system/liblaunch.dylib
0x93ffb000 - 0x93ffefff /usr/lib/system/libcompiler_rt.dylib
0x94003000 - 0x94007fff /usr/lib/system/libcache.dylib
0x9459a000 - 0x9459bfff /usr/lib/system/libunc.dylib
0x96c1d000 - 0x96c33fff /usr/lib/system/libxpc.dylib
0x97e9a000 - 0x97eddfff /usr/lib/system/libcommonCrypto.dylib
0x9936e000 - 0x9939dfff /usr/lib/system/libsystem_info.dylib
0x9939e000 - 0x993a6fff /usr/lib/system/libcopyfile.dylib
0x993c5000 - 0x993cefff /usr/lib/libc++abi.dylib
0x9942d000 - 0x99434fff /usr/lib/system/libsystem_dnssd.dylib
0x99bae000 - 0x99bb6fff /usr/lib/system/libunwind.dylib
0x99d0e000 - 0x99d0efff /usr/lib/system/libdnsinfo.dylib
0x9a0bd000 - 0x9a0c4fff /usr/lib/system/libsystem_notify.dylib
0x9a5f8000 - 0x9a6c3fff /usr/lib/system/libsystem_c.dylib
0x9a6e6000 - 0x9a6f4fff /usr/lib/system/libdispatch.dylib
0x9aaae000 - 0x9aaaffff /usr/lib/system/libquarantine.dylib
0x9ae06000 - 0x9ae08fff /usr/lib/system/libdyld.dylib
0x9b0e0000 - 0x9b0e1fff /usr/lib/system/libsystem_blocks.dylib
0x9b0e2000 - 0x9b0e3fff /usr/lib/system/libsystem_sandbox.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2013 03:37:40 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 1,036,800 2,009,174 1.9379
08 Jun 2013 09:18:53 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 1,010,880 1,958,912 1.9378
07 Jun 2013 14:27:57 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 984,960 1,904,028 1.9331
06 Jun 2013 16:55:05 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 959,040 1,853,132 1.9323
05 Jun 2013 20:08:42 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 933,120 1,802,065 1.9312
05 Jun 2013 00:57:00 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 907,200 1,750,964 1.9301
04 Jun 2013 08:09:37 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 881,280 1,699,510 1.9285
03 Jun 2013 07:12:20 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 855,360 1,651,603 1.9309
02 Jun 2013 11:14:37 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 829,440 1,599,188 1.9280
01 Jun 2013 15:22:00 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 803,520 1,546,249 1.9243
31 May 2013 17:36:54 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 777,600 1,493,954 1.9212
30 May 2013 22:16:40 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 751,680 1,443,413 1.9202
30 May 2013 06:48:22 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 725,760 1,392,512 1.9187
29 May 2013 13:39:35 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 699,840 1,341,967 1.9175
28 May 2013 23:09:17 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 673,920 1,293,656 1.9196
28 May 2013 09:18:54 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 648,000 1,245,725 1.9224
27 May 2013 19:36:53 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 622,080 1,197,900 1.9256
27 May 2013 05:37:52 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 596,160 1,149,292 1.9278
26 May 2013 15:47:12 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 570,240 1,100,940 1.9307
26 May 2013 01:43:06 1110299 15780493 hadcm3n_4bhu_1940_40_008301944_4 544,320 1,052,141 1.9329


©2024 climateprediction.net