Task 15517345

Name	hadcm3n_zlc8_1880_40_008249145_2
Workunit	8404269
Created	30 Dec 2012, 0:10:32 UTC
Sent	30 Dec 2012, 0:11:16 UTC
Report deadline	31 Mar 2013, 7:38:27 UTC
Received	13 Feb 2013, 23:31:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1239819
Run time	20 days 2 hours 45 min 16 sec
CPU time	20 days 2 hours 45 min 16 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	1.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish 08:01:03 (3396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 19:27:37 (3537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 11:27:13 (3548): No heartbeat from core client for 30 sec - exiting 11:27:17 (3548): No heartbeat from core client for 30 sec - exiting 11:27:18 (3548): No heartbeat from core client for 30 sec - exiting 11:27:19 (3548): No heartbeat from core client for 30 sec - exiting 11:27:20 (3548): No heartbeat from core client for 30 sec - exiting 11:27:21 (3548): No heartbeat from core client for 30 sec - exiting 11:27:22 (3548): No heartbeat from core client for 30 sec - exiting 11:27:23 (3548): No heartbeat from core client for 30 sec - exiting 11:27:24 (3548): No heartbeat from core client for 30 sec - exiting 11:27:25 (3548): No heartbeat from core client for 30 sec - exiting 11:27:26 (3548): No heartbeat from core client for 30 sec - exiting 11:27:27 (3548): No heartbeat from core client for 30 sec - exiting 11:27:28 (3548): No heartbeat from core client for 30 sec - exiting 11:27:29 (3548): No heartbeat from core client for 30 sec - exiting 11:27:30 (3548): No heartbeat from core client for 30 sec - exiting 11:27:31 (3548): No heartbeat from core client for 30 sec - exiting 11:27:32 (3548): No heartbeat from core client for 30 sec - exiting 11:27:33 (3548): No heartbeat from core client for 30 sec - exiting 11:27:34 (3548): No heartbeat from core client for 30 sec - exiting 11:27:35 (3548): No heartbeat from core client for 30 sec - exiting 11:27:36 (3548): No heartbeat from core client for 30 sec - exiting 11:27:37 (3548): No heartbeat from core client for 30 sec - exiting 11:27:38 (3548): No heartbeat from core client for 30 sec - exiting 11:27:39 (3548): No heartbeat from core client for 30 sec - exiting 11:27:40 (3548): No heartbeat from core client for 30 sec - exiting 11:27:41 (3548): No heartbeat from core client for 30 sec - exiting 11:27:42 (3548): No heartbeat from core client for 30 sec - exiting 11:27:43 (3548): No heartbeat from core client for 30 sec - exiting 11:27:44 (3548): No heartbeat from core client for 30 sec - exiting 11:27:45 (3548): No heartbeat from core client for 30 sec - exiting 11:27:46 (3548): No heartbeat from core client for 30 sec - exiting 11:27:47 (3548): No heartbeat from core client for 30 sec - exiting 11:27:48 (3548): No heartbeat from core client for 30 sec - exiting 11:27:49 (3548): No heartbeat from core client for 30 sec - exiting 11:27:50 (3548): No heartbeat from core client for 30 sec - exiting 11:27:51 (3548): No heartbeat from core client for 30 sec - exiting 11:27:52 (3548): No heartbeat from core client for 30 sec - exiting 11:27:53 (3548): No heartbeat from core client for 30 sec - exiting 11:27:54 (3548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7712400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805067e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7454e46] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... 08:25:02 (3550): No heartbeat from core client for 30 sec - exiting 08:25:04 (3550): No heartbeat from core client for 30 sec - exiting 08:25:05 (3550): No heartbeat from core client for 30 sec - exiting 08:25:06 (3550): No heartbeat from core client for 30 sec - exiting 08:25:07 (3550): No heartbeat from core client for 30 sec - exiting 08:25:08 (3550): No heartbeat from core client for 30 sec - exiting 08:25:09 (3550): No heartbeat from core client for 30 sec - exiting 08:25:10 (3550): No heartbeat from core client for 30 sec - exiting 08:25:11 (3550): No heartbeat from core client for 30 sec - exiting 08:25:12 (3550): No heartbeat from core client for 30 sec - exiting 08:25:13 (3550): No heartbeat from core client for 30 sec - exiting 08:25:14 (3550): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:18:37 (5424): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf7706400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804cedf] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050a03] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7448e46] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Feb 2013 07:32:29	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	440,640	1,632,439	3.7047
03 Feb 2013 00:55:50	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	414,720	1,527,665	3.6836
01 Feb 2013 11:17:20	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	388,800	1,426,191	3.6682
30 Jan 2013 23:08:55	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	362,880	1,323,696	3.6478
30 Jan 2013 02:37:21	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	336,960	1,221,163	3.6241
28 Jan 2013 06:14:06	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	311,040	1,185,405	3.8111
25 Jan 2013 11:30:47	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	285,120	1,045,770	3.6678
25 Jan 2013 01:44:05	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	259,200	943,869	3.6415
22 Jan 2013 22:51:18	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	233,280	851,043	3.6482
10 Jan 2013 19:44:58	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	181,440	696,356	3.8379
08 Jan 2013 15:50:54	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	155,520	589,194	3.7885
06 Jan 2013 01:34:28	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	129,600	500,826	3.8644
05 Jan 2013 01:44:11	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	103,680	399,515	3.8533
03 Jan 2013 11:31:32	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	77,760	300,541	3.8650
02 Jan 2013 11:41:23	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	51,840	201,126	3.8797
01 Jan 2013 01:24:47	1239819	15517345	hadcm3n_zlc8_1880_40_008249145_2	25,920	101,399	3.9120