Task 12941781

Name	hadcm3n_p5gb_1900_40_007224651_2
Workunit	7422891
Created	6 Jun 2011, 16:28:26 UTC
Sent	6 Jun 2011, 16:28:38 UTC
Report deadline	5 Sep 2011, 23:55:49 UTC
Received	8 Aug 2011, 16:09:20 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1143283
Run time	8 days 9 hours 54 min 49 sec
CPU time	7 days 17 hours 44 min 6 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:33:34 (2238): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:33:36 (2238): No heartbeat from core client for 30 sec - exiting 00:33:37 (2238): No heartbeat from core client for 30 sec - exiting 00:33:38 (2238): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:17:06 (2234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 19:14:28 (2308): No heartbeat from core client for 30 sec - exiting 19:14:30 (2308): No heartbeat from core client for 30 sec - exiting 19:14:31 (2308): No heartbeat from core client for 30 sec - exiting 19:14:32 (2308): No heartbeat from core client for 30 sec - exiting 19:14:33 (2308): No heartbeat from core client for 30 sec - exiting 19:14:34 (2308): No heartbeat from core client for 30 sec - exiting 19:14:35 (2308): No heartbeat from core client for 30 sec - exiting 19:14:36 (2308): No heartbeat from core client for 30 sec - exiting 19:14:37 (2308): No heartbeat from core client for 30 sec - exiting 19:14:38 (2308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:02:25 (2471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:11:56 (2229): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 10:23:17 (2211): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 14:24:00 (2316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 17:14:57 (4042): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 17:15:42 (5523): No heartbeat from core client for 30 sec - exiting 17:15:43 (5523): No heartbeat from core client for 30 sec - exiting 17:15:44 (5523): No heartbeat from core client for 30 sec - exiting 17:15:45 (5523): No heartbeat from core client for 30 sec - exiting 17:15:46 (5523): No heartbeat from core client for 30 sec - exiting 17:15:47 (5523): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2592, selfPID=2592, iMonCtr=1 ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 18:12:38 (2263): No heartbeat from core client for 30 sec - exiting 18:12:39 (2263): No heartbeat from core client for 30 sec - exiting 18:12:40 (2263): No heartbeat from core client for 30 sec - exiting 18:12:41 (2263): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. 08:36:03 (2242): No heartbeat from core client for 30 sec - exiting 08:36:04 (2242): No heartbeat from core client for 30 sec - exiting 08:36:05 (2242): No heartbeat from core client for 30 sec - exiting 08:36:06 (2242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. CPDN Monitor - Quit request from BOINC... ERROR: ld.so: object '/usr/lib/libc/memcpy-preload.so' from /etc/ld.so.preload cannot be preloaded: ignored. Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77ac400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804cedf] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050a03] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7504e46] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Aug 2011 07:14:45	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	414,720	655,191	1.5798
26 Jul 2011 16:17:21	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	388,800	620,380	1.5956
25 Jul 2011 21:07:05	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	362,880	579,130	1.5959
25 Jul 2011 19:38:35	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	336,960	537,863	1.5962
08 Jul 2011 20:44:36	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	311,040	496,502	1.5963
07 Jul 2011 15:36:24	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	285,120	455,296	1.5969
29 Jun 2011 18:17:51	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	259,200	413,832	1.5966
26 Jun 2011 17:56:47	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	233,280	372,391	1.5963
24 Jun 2011 23:33:37	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	207,360	330,984	1.5962
21 Jun 2011 21:56:36	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	181,440	289,475	1.5954
20 Jun 2011 17:21:21	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	155,520	248,178	1.5958
20 Jun 2011 17:21:21	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	129,600	206,796	1.5956
13 Jun 2011 21:22:18	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	103,680	165,591	1.5971
12 Jun 2011 22:05:23	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	77,760	124,170	1.5968
11 Jun 2011 15:42:44	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	51,840	82,667	1.5947
08 Jun 2011 21:19:43	1143283	12941781	hadcm3n_p5gb_1900_40_007224651_2	25,920	41,273	1.5923