Task 12888490

Name	hadcm3n_p4vi_1900_40_007223902_2
Workunit	7422142
Created	17 May 2011, 4:00:27 UTC
Sent	17 May 2011, 4:00:33 UTC
Report deadline	16 Aug 2011, 11:27:44 UTC
Received	9 Jun 2011, 12:48:30 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	896411
Run time	10 days 19 hours 23 min 1 sec
CPU time	10 days 4 hours 32 min 28 sec
Validate state	Invalid
Credit	7,153.92
Device peak FLOPS	3.29 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:22:06 (344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:36:09 (350): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:43:27 (3137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:43:29 (3137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:21:16 (1717): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(15279,0xa004c540) malloc: * error for object 0x4002204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=15305, selfPID=15305, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x3801c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x3801c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x1812c04: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x1812c00: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x1812204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x1812200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(7236,0xa004c540) malloc: * error for object 0x1812200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.6 build 10J567 Mon Jun 6 05:58:17 2011 Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7237, selfPID=7237, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(360,0xa004c540) malloc: * error for object 0x3035204: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(360,0xa004c540) malloc: * error for object 0x3035200: incorrect checksum for freed object - object was probably modified after being freed. * set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jun 2011 01:12:10	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	596,160	880,053	1.4762
08 Jun 2011 13:39:14	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	570,240	841,849	1.4763
08 Jun 2011 02:05:00	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	544,320	806,164	1.4810
06 Jun 2011 12:02:35	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	518,400	766,897	1.4794
06 Jun 2011 00:41:25	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	492,480	728,318	1.4789
05 Jun 2011 13:02:19	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	466,560	688,243	1.4751
05 Jun 2011 01:02:52	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	440,640	646,852	1.4680
04 Jun 2011 12:56:15	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	414,720	605,490	1.4600
04 Jun 2011 01:12:58	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	388,800	568,246	1.4615
03 Jun 2011 09:27:43	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	362,880	529,317	1.4587
02 Jun 2011 06:46:51	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	336,960	489,227	1.4519
01 Jun 2011 13:30:51	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	311,040	448,096	1.4406
01 Jun 2011 01:01:35	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	285,120	408,841	1.4339
30 May 2011 08:23:53	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	259,200	369,351	1.4250
29 May 2011 19:39:08	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	233,280	331,939	1.4229
27 May 2011 15:27:39	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	207,360	290,384	1.4004
26 May 2011 10:39:12	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	181,440	252,528	1.3918
26 May 2011 01:06:07	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	155,520	219,318	1.4102
25 May 2011 09:39:19	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	129,600	186,128	1.4362
23 May 2011 11:29:07	896411	12888490	hadcm3n_p4vi_1900_40_007223902_2	103,680	152,416	1.4701