climateprediction.net home page
Task 15134989

Task 15134989

Name hadcm3n_ybyt_1980_40_008154342_4
Workunit 8309466
Created 17 Aug 2012, 13:52:09 UTC
Sent 17 Aug 2012, 15:00:04 UTC
Report deadline 16 Nov 2012, 22:27:15 UTC
Received 9 Oct 2012, 13:16:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1179081
Run time 5 days 1 hours 35 min 6 sec
CPU time 1 days 10 hours 19 min 6 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 3.22 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.0.31</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 08:40:07 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd1398 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 09:04:29 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbdf3d838 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 11:06:59 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbe706b58 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 19:13:19 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd0d98 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 19:51:06 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbd9daf28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 20:45:07 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd1398 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 21:57:05 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbeb6d628 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 22:36:50 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbeaa4cf8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sat Oct  6 22:56:14 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbeb3f1a8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sun Oct  7 03:09:37 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbd9e2e88 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sun Oct  7 09:04:13 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd1348 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
SIGBUS: bus error

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sun Oct  7 09:45:53 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbde20008 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9533, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Sun Oct  7 21:10:12 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbe706b58 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 00:16:03 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbda51e58 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 00:25:32 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd0d98 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGBUS: bus error

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 02:21:16 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbdece9d8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 02:43:29 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd0d98 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
SIGILL: illegal instruction

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 05:58:41 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbdf3d838 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 06:03:21 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbeaa6d48 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 09:24:34 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbddd1398 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 10:31:16 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbe0c86e8 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGILL: illegal instruction

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 10:59:02 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbdf3d838 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=32057, iMonCtr=1
Model crash detected, will try to restart...
SIGSEGV: segmentation violation
SIGILL: illegal instruction

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.7.5 build 11G56
Mon Oct  8 19:55:04 2012

Thread 0 Crashed:

Thread 1:

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbdf3d838 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x911a7000 - 0x911aefff /usr/lib/system/libsystem_dnssd.dylib
0x91361000 - 0x91363fff /usr/lib/system/libdyld.dylib
0x92ce3000 - 0x92ce3fff /usr/lib/system/libkeymgr.dylib
0x92f7a000 - 0x92f7bfff /usr/lib/system/libremovefile.dylib
0x9309a000 - 0x930a8fff /usr/lib/system/libdispatch.dylib
0x93713000 - 0x9371bfff /usr/lib/system/libunwind.dylib
0x9530d000 - 0x9532bfff /usr/lib/system/libsystem_kernel.dylib
0x95668000 - 0x95669fff /usr/lib/system/libunc.dylib
0x95e6f000 - 0x95e76fff /usr/lib/system/libsystem_notify.dylib
0x9600f000 - 0x9600ffff /usr/lib/system/libdnsinfo.dylib
0x97809000 - 0x9780afff /usr/lib/system/libquarantine.dylib
0x97878000 - 0x9788efff /usr/lib/system/libxpc.dylib
0x9788f000 - 0x97894fff /usr/lib/system/libmacho.dylib
0x97895000 - 0x97896fff /usr/lib/system/libsystem_sandbox.dylib
0x97fd0000 - 0x97ffefff /usr/lib/libSystem.B.dylib
0x984fe000 - 0x98506fff /usr/lib/system/libcopyfile.dylib
0x9852e000 - 0x9855dfff /usr/lib/system/libsystem_info.dylib
0x9855e000 - 0x98562fff /usr/lib/system/libcache.dylib
0x99735000 - 0x99800fff /usr/lib/system/libsystem_c.dylib
0x9a062000 - 0x9a065fff /usr/lib/system/libmathCommon.A.dylib
0x9a76e000 - 0x9a7b1fff /usr/lib/system/libcommonCrypto.dylib
0x9a7b2000 - 0x9a7b5fff /usr/lib/system/libcompiler_rt.dylib
0x9a7b8000 - 0x9a7bcfff /usr/lib/system/libsystem_network.dylib
0x9c141000 - 0x9c142fff /usr/lib/system/libsystem_blocks.dylib
0x9c424000 - 0x9c432fff /usr/lib/libz.1.dylib
0x9c94b000 - 0x9c953fff /usr/lib/system/liblaunch.dylib


Exiting...
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13e3004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x13b0600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x1bb3804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x1bb4604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(54046,0xacd522c0) malloc: *** error for object 0x1bb4600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_ybyt_1980_40_008154342/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Oct 2012 00:44:09 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 259,200 94,543 0.3647
07 Oct 2012 12:20:44 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 233,280 99,193 0.4252
06 Oct 2012 20:56:23 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 207,360 91,404 0.4408
06 Oct 2012 07:42:17 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 181,440 99,956 0.5509
05 Oct 2012 20:03:10 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 155,520 84,196 0.5414
05 Oct 2012 11:58:09 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 129,600 80,328 0.6198
04 Oct 2012 15:49:42 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 103,680 51,351 0.4953
20 Aug 2012 14:05:30 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 77,760 22,731 0.2923
19 Aug 2012 04:33:25 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 51,840 9,544 0.1841
18 Aug 2012 16:24:16 1179081 15134989 hadcm3n_ybyt_1980_40_008154342_4 25,920 9,863 0.3805


©2024 climateprediction.net