climateprediction.net home page
Task 12735888

Task 12735888

Name hadcm3n_o1k6_1900_40_007197353_0
Workunit 7395633
Created 28 Mar 2011, 14:00:40 UTC
Sent 1 Apr 2011, 16:35:38 UTC
Report deadline 2 Jul 2011, 0:02:49 UTC
Received 30 May 2011, 12:54:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 621557
Run time 21 days 19 hours 58 min 33 sec
CPU time 20 days 12 hours 48 min 30 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 3.09 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.12.26</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
OPEN:  File Creation Failed: No space left on device
OPEN:  Unable to Open File dataout/o1k6ka.dab0ch0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    
11:37:28 (98113): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x101f004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x103a604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x103a600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x184e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x184e004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(224,0xa0a2f540) malloc: *** error for object 0x821004: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation
hadcm3n_6.07_i686-apple-darwin(43393,0xa0a2f540) malloc: *** error for object 0x84b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(43393,0xa0a2f540) malloc: *** error for object 0x281c604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(43393,0xa0a2f540) malloc: *** error for object 0x84b604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(43393,0xa0a2f540) malloc: *** error for object 0x84b600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(43393,0xa0a2f540) malloc: *** error for object 0x1839204: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
SIGSEGV: segmentation violation

Crashed executable name: hadcm3n_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Mon May 30 08:52:57 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x96edb0a3 _small_free_list_remove_ptr + 234
1   libSystem.B.dylib                   0x96ed7b6c _szone_free_definite_size + 3457
2   libSystem.B.dylib                   0x96ed6b88 _free + 244
3   hadcm3n_6.07_i686-apple-darwin      0x0000ba58 __Z12annual_cyclePKSt6vectorISsSaISsEEPKcii + 3482
4   hadcm3n_6.07_i686-apple-darwin      0x0000d36b __Z12decadalMeansiPKc + 957
5   hadcm3n_6.07_i686-apple-darwin      0x000067ff __Z9doCM3Procv + 185
6   hadcm3n_6.07_i686-apple-darwin      0x0000876a __Z6workerv + 2896
7   hadcm3n_6.07_i686-apple-darwin      0x00008aa9 _main + 491
8   hadcm3n_6.07_i686-apple-darwin      0x00002676 start + 54

Thread 1:
0   libSystem.B.dylib                   0x96ed01ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x96f57809 _nanosleep + 345
2   libSystem.B.dylib                   0x96f576aa _usleep + 61
3   hadcm3n_6.07_i686-apple-darwin      0x00071a7c __Z11boinc_sleepd + 188
4   hadcm3n_6.07_i686-apple-darwin      0x00067282 __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x96efd7fd __pthread_start + 345
6   libSystem.B.dylib                   0x96efd682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbff8fc18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x0007697e  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -    0x93fff /Library/Application Support/BOINC Data/slots/0/../../projects/climateprediction.net/hadcm3n_6.07_i686-apple-darwin
0x96ecf000 - 0x97076fff /usr/lib/libSystem.B.dylib
0x972c1000 - 0x9732bfff /usr/lib/libstdc++.6.dylib
0x98aad000 - 0x98ab0fff /usr/lib/system/libmathCommon.A.dylib
0x991f6000 - 0x99204fff /usr/lib/libz.1.dylib


Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
16 May 2011 23:05:05 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 1,036,800 1,773,376 1.7104
16 May 2011 09:48:03 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 1,010,880 1,728,041 1.7094
15 May 2011 20:30:40 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 984,960 1,682,636 1.7083
15 May 2011 07:16:16 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 959,040 1,637,993 1.7080
14 May 2011 17:37:35 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 933,120 1,594,630 1.7089
14 May 2011 04:56:54 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 907,200 1,551,461 1.7102
13 May 2011 16:15:02 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 881,280 1,508,275 1.7115
13 May 2011 03:24:26 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 855,360 1,464,563 1.7122
12 May 2011 14:26:56 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 829,440 1,420,761 1.7129
12 May 2011 01:41:48 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 803,520 1,377,491 1.7143
11 May 2011 12:53:11 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 777,600 1,334,150 1.7157
11 May 2011 00:03:09 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 751,680 1,290,733 1.7171
10 May 2011 11:07:51 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 725,760 1,247,303 1.7186
09 May 2011 22:03:50 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 699,840 1,203,684 1.7199
09 May 2011 09:21:39 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 673,920 1,160,469 1.7220
08 May 2011 20:26:29 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 648,000 1,116,643 1.7232
08 May 2011 07:38:05 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 622,080 1,073,236 1.7252
07 May 2011 19:03:10 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 596,160 1,030,221 1.7281
07 May 2011 06:05:49 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 570,240 986,553 1.7301
06 May 2011 17:18:26 621557 12735888 hadcm3n_o1k6_1900_40_007197353_0 544,320 942,715 1.7319


©2024 climateprediction.net