Task 15847830

Name	hadcm3n_o2om_1980_40_008384866_3
Workunit	8535725
Created	18 Jun 2013, 17:49:40 UTC
Sent	18 Jun 2013, 18:57:23 UTC
Report deadline	18 Sep 2013, 2:24:34 UTC
Received	26 Jun 2013, 10:19:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1132881
Run time	7 days 0 hours 28 min 50 sec
CPU time	6 days 10 hours 27 min 56 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.21 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> 21:30:54 (8107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:55 (8107): No heartbeat from core client for 30 sec - exiting 21:30:56 (8107): No heartbeat from core client for 30 sec - exiting 21:30:57 (8107): No heartbeat from core client for 30 sec - exiting 21:30:58 (8107): No heartbeat from core client for 30 sec - exiting 21:30:59 (8107): No heartbeat from core client for 30 sec - exiting 21:31:00 (8107): No heartbeat from core client for 30 sec - exiting 21:31:01 (8107): No heartbeat from core client for 30 sec - exiting 21:31:02 (8107): No heartbeat from core client for 30 sec - exiting 21:31:03 (8107): No heartbeat from core client for 30 sec - exiting 21:31:04 (8107): No heartbeat from core client for 30 sec - exiting 21:31:05 (8107): No heartbeat from core client for 30 sec - exiting 21:31:06 (8107): No heartbeat from core client for 30 sec - exiting 21:31:07 (8107): No heartbeat from core client for 30 sec - exiting 21:31:08 (8107): No heartbeat from core client for 30 sec - exiting 21:31:09 (8107): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:39:00 (19519): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:27:02 (2062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:27:03 (2062): No heartbeat from core client for 30 sec - exiting 03:27:04 (2062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:15:38 (24723): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:51:37 (14414): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:51:24 (29546): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:51:25 (29546): No heartbeat from core client for 30 sec - exiting 03:51:26 (29546): No heartbeat from core client for 30 sec - exiting 03:51:27 (29546): No heartbeat from core client for 30 sec - exiting 03:51:28 (29546): No heartbeat from core client for 30 sec - exiting 03:51:29 (29546): No heartbeat from core client for 30 sec - exiting 03:51:30 (29546): No heartbeat from core client for 30 sec - exiting 03:51:31 (29546): No heartbeat from core client for 30 sec - exiting 03:51:32 (29546): No heartbeat from core client for 30 sec - exiting 03:51:33 (29546): No heartbeat from core client for 30 sec - exiting 04:01:33 (30140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:01:34 (30140): No heartbeat from core client for 30 sec - exiting 04:01:35 (30140): No heartbeat from core client for 30 sec - exiting 04:01:36 (30140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:08:16 (5938): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:32:13 (18821): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:36 (23140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:39:37 (23140): No heartbeat from core client for 30 sec - exiting 03:39:38 (23140): No heartbeat from core client for 30 sec - exiting 03:39:39 (23140): No heartbeat from core client for 30 sec - exiting 03:39:40 (23140): No heartbeat from core client for 30 sec - exiting 03:39:41 (23140): No heartbeat from core client for 30 sec - exiting 03:39:42 (23140): No heartbeat from core client for 30 sec - exiting 03:39:43 (23140): No heartbeat from core client for 30 sec - exiting 03:39:44 (23140): No heartbeat from core client for 30 sec - exiting 03:39:45 (23140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:35:07 (30664): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:55:50 (18667): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:47:50 (4191): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:24:14 (16624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:24:15 (16624): No heartbeat from core client for 30 sec - exiting 23:24:16 (16624): No heartbeat from core client for 30 sec - exiting 23:24:17 (16624): No heartbeat from core client for 30 sec - exiting 23:24:18 (16624): No heartbeat from core client for 30 sec - exiting 23:24:19 (16624): No heartbeat from core client for 30 sec - exiting 23:24:20 (16624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:31:01 (27288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:47:31 (4530): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:38:44 (14766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:45 (14766): No heartbeat from core client for 30 sec - exiting 05:38:46 (14766): No heartbeat from core client for 30 sec - exiting 05:38:47 (14766): No heartbeat from core client for 30 sec - exiting 05:38:48 (14766): No heartbeat from core client for 30 sec - exiting 05:38:49 (14766): No heartbeat from core client for 30 sec - exiting 05:38:50 (14766): No heartbeat from core client for 30 sec - exiting 05:38:51 (14766): No heartbeat from core client for 30 sec - exiting 05:38:52 (14766): No heartbeat from core client for 30 sec - exiting 05:38:53 (14766): No heartbeat from core client for 30 sec - exiting 05:38:54 (14766): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Stack trace (15 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf779b400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf74dabd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jun 2013 10:20:20	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	259,200	556,075	2.1454
25 Jun 2013 15:55:28	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	233,280	500,070	2.1436
24 Jun 2013 21:50:16	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	207,360	444,333	2.1428
24 Jun 2013 04:23:00	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	181,440	388,447	2.1409
23 Jun 2013 10:17:23	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	155,520	332,392	2.1373
22 Jun 2013 16:35:12	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	129,600	277,198	2.1389
21 Jun 2013 22:18:20	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	103,680	221,687	2.1382
21 Jun 2013 05:26:57	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	77,760	166,432	2.1403
20 Jun 2013 11:14:03	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	51,840	110,224	2.1262
19 Jun 2013 12:17:59	1132881	15847830	hadcm3n_o2om_1980_40_008384866_3	25,920	54,613	2.1070