Task 13121129

Name	hadcm3n_yjvv_1900_40_007358629_0
Workunit	7556059
Created	6 Jul 2011, 15:00:59 UTC
Sent	8 Jul 2011, 6:57:15 UTC
Report deadline	7 Oct 2011, 14:24:26 UTC
Received	3 Aug 2011, 10:04:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1120190
Run time	5 days 2 hours 14 min 9 sec
CPU time	4 days 23 hours 28 min 18 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	1.98 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:59:52 (2200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:09 (5711): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:03:51 (5761): No heartbeat from core client for 30 sec - exiting 11:03:52 (5761): No heartbeat from core client for 30 sec - exiting 11:03:53 (5761): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 09:17:23 (2004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:57:39 (2035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:40 (2035): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 10:39:00 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:39:01 (3028): No heartbeat from core client for 30 sec - exiting 10:39:02 (3028): No heartbeat from core client for 30 sec - exiting 10:39:03 (3028): No heartbeat from core client for 30 sec - exiting 10:39:04 (3028): No heartbeat from core client for 30 sec - exiting 10:39:05 (3028): No heartbeat from core client for 30 sec - exiting 10:39:06 (3028): No heartbeat from core client for 30 sec - exiting 10:39:07 (3028): No heartbeat from core client for 30 sec - exiting 10:39:08 (3028): No heartbeat from core client for 30 sec - exiting 10:39:09 (3028): No heartbeat from core client for 30 sec - exiting 10:39:10 (3028): No heartbeat from core client for 30 sec - exiting 10:39:11 (3028): No heartbeat from core client for 30 sec - exiting 10:39:12 (3028): No heartbeat from core client for 30 sec - exiting 10:39:13 (3028): No heartbeat from core client for 30 sec - exiting 10:39:14 (3028): No heartbeat from core client for 30 sec - exiting 10:39:15 (3028): No heartbeat from core client for 30 sec - exiting 10:39:16 (3028): No heartbeat from core client for 30 sec - exiting 10:39:17 (3028): No heartbeat from core client for 30 sec - exiting 10:39:18 (3028): No heartbeat from core client for 30 sec - exiting 10:39:19 (3028): No heartbeat from core client for 30 sec - exiting 10:39:20 (3028): No heartbeat from core client for 30 sec - exiting 10:39:21 (3028): No heartbeat from core client for 30 sec - exiting 10:39:22 (3028): No heartbeat from core client for 30 sec - exiting 10:39:23 (3028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 08:51:50 (2049): No heartbeat from core client for 30 sec - exiting 08:51:56 (2049): No heartbeat from core client for 30 sec - exiting 08:51:57 (2049): No heartbeat from core client for 30 sec - exiting 08:51:58 (2049): No heartbeat from core client for 30 sec - exiting 08:51:59 (2049): No heartbeat from core client for 30 sec - exiting 08:52:00 (2049): No heartbeat from core client for 30 sec - exiting 08:52:01 (2049): No heartbeat from core client for 30 sec - exiting 08:52:02 (2049): No heartbeat from core client for 30 sec - exiting 08:52:03 (2049): No heartbeat from core client for 30 sec - exiting 08:52:04 (2049): No heartbeat from core client for 30 sec - exiting 08:52:05 (2049): No heartbeat from core client for 30 sec - exiting 08:52:07 (2049): No heartbeat from core client for 30 sec - exiting 08:52:08 (2049): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:44 (2731): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:02:48 (2731): No heartbeat from core client for 30 sec - exiting 17:12:45 (19729): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:47 (19729): No heartbeat from core client for 30 sec - exiting 08:48:08 (2028): No heartbeat from core client for 30 sec - exiting 08:48:09 (2028): No heartbeat from core client for 30 sec - exiting 08:48:10 (2028): No heartbeat from core client for 30 sec - exiting 08:48:11 (2028): No heartbeat from core client for 30 sec - exiting 08:48:12 (2028): No heartbeat from core client for 30 sec - exiting 08:48:13 (2028): No heartbeat from core client for 30 sec - exiting 08:48:14 (2028): No heartbeat from core client for 30 sec - exiting 08:48:16 (2028): No heartbeat from core client for 30 sec - exiting 08:48:17 (2028): No heartbeat from core client for 30 sec - exiting 08:48:18 (2028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:41 (2736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:06 (2266): No heartbeat from core client for 30 sec - exiting 11:04:07 (2266): No heartbeat from core client for 30 sec - exiting 11:04:08 (2266): No heartbeat from core client for 30 sec - exiting 11:04:09 (2266): No heartbeat from core client for 30 sec - exiting 11:04:10 (2266): No heartbeat from core client for 30 sec - exiting 11:04:11 (2266): No heartbeat from core client for 30 sec - exiting 11:04:12 (2266): No heartbeat from core client for 30 sec - exiting 11:04:13 (2266): No heartbeat from core client for 30 sec - exiting 11:04:14 (2266): No heartbeat from core client for 30 sec - exiting 11:04:15 (2266): No heartbeat from core client for 30 sec - exiting 11:04:16 (2266): No heartbeat from core client for 30 sec - exiting 11:04:17 (2266): No heartbeat from core client for 30 sec - exiting 11:04:18 (2266): No heartbeat from core client for 30 sec - exiting 11:04:19 (2266): No heartbeat from core client for 30 sec - exiting 11:04:20 (2266): No heartbeat from core client for 30 sec - exiting 11:04:21 (2266): No heartbeat from core client for 30 sec - exiting 11:04:22 (2266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:04:02 (2211): No heartbeat from core client for 30 sec - exiting 17:04:03 (2211): No heartbeat from core client for 30 sec - exiting 17:04:04 (2211): No heartbeat from core client for 30 sec - exiting 17:04:05 (2211): No heartbeat from core client for 30 sec - exiting 17:04:06 (2211): No heartbeat from core client for 30 sec - exiting 17:04:07 (2211): No heartbeat from core client for 30 sec - exiting 17:04:08 (2211): No heartbeat from core client for 30 sec - exiting 17:04:09 (2211): No heartbeat from core client for 30 sec - exiting 17:04:10 (2211): No heartbeat from core client for 30 sec - exiting 17:04:11 (2211): No heartbeat from core client for 30 sec - exiting 17:04:12 (2211): No heartbeat from core client for 30 sec - exiting 17:04:13 (2211): No heartbeat from core client for 30 sec - exiting 17:04:14 (2211): No heartbeat from core client for 30 sec - exiting 17:04:15 (2211): No heartbeat from core client for 30 sec - exiting 17:04:16 (2211): No heartbeat from core client for 30 sec - exiting 17:04:19 (2211): No heartbeat from core client for 30 sec - exiting 17:04:20 (2211): No heartbeat from core client for 30 sec - exiting 17:04:21 (2211): No heartbeat from core client for 30 sec - exiting 17:04:22 (2211): No heartbeat from core client for 30 sec - exiting 17:04:23 (2211): No heartbeat from core client for 30 sec - exiting 17:04:24 (2211): No heartbeat from core client for 30 sec - exiting 17:04:25 (2211): No heartbeat from core client for 30 sec - exiting 17:04:26 (2211): No heartbeat from core client for 30 sec - exiting 17:04:28 (2211): No heartbeat from core client for 30 sec - exiting 17:04:29 (2211): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:53 (2142): No heartbeat from core client for 30 sec - exiting 09:01:58 (2142): No heartbeat from core client for 30 sec - exiting 09:01:59 (2142): No heartbeat from core client for 30 sec - exiting 09:02:00 (2142): No heartbeat from core client for 30 sec - exiting 09:02:01 (2142): No heartbeat from core client for 30 sec - exiting 09:02:02 (2142): No heartbeat from core client for 30 sec - exiting 09:02:03 (2142): No heartbeat from core client for 30 sec - exiting 09:02:04 (2142): No heartbeat from core client for 30 sec - exiting 09:02:05 (2142): No heartbeat from core client for 30 sec - exiting 09:02:06 (2142): No heartbeat from core client for 30 sec - exiting 09:02:07 (2142): No heartbeat from core client for 30 sec - exiting 09:02:08 (2142): No heartbeat from core client for 30 sec - exiting 09:02:09 (2142): No heartbeat from core client for 30 sec - exiting 09:02:11 (2142): No heartbeat from core client for 30 sec - exiting 09:02:12 (2142): No heartbeat from core client for 30 sec - exiting 09:02:13 (2142): No heartbeat from core client for 30 sec - exiting 09:02:14 (2142): No heartbeat from core client for 30 sec - exiting 09:02:15 (2142): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:09:56 (1762): No heartbeat from core client for 30 sec - exiting 09:09:58 (1762): No heartbeat from core client for 30 sec - exiting 09:09:59 (1762): No heartbeat from core client for 30 sec - exiting 09:10:00 (1762): No heartbeat from core client for 30 sec - exiting 09:10:01 (1762): No heartbeat from core client for 30 sec - exiting 09:10:02 (1762): No heartbeat from core client for 30 sec - exiting 09:10:03 (1762): No heartbeat from core client for 30 sec - exiting 09:10:04 (1762): No heartbeat from core client for 30 sec - exiting 09:10:05 (1762): No heartbeat from core client for 30 sec - exiting 09:10:06 (1762): No heartbeat from core client for 30 sec - exiting 09:10:07 (1762): No heartbeat from core client for 30 sec - exiting 09:10:08 (1762): No heartbeat from core client for 30 sec - exiting 09:10:09 (1762): No heartbeat from core client for 30 sec - exiting 09:10:10 (1762): No heartbeat from core client for 30 sec - exiting 09:10:11 (1762): No heartbeat from core client for 30 sec - exiting 09:10:13 (1762): No heartbeat from core client for 30 sec - exiting 09:10:14 (1762): No heartbeat from core client for 30 sec - exiting 09:10:15 (1762): No heartbeat from core client for 30 sec - exiting 09:10:16 (1762): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:06:53 (2023): No heartbeat from core client for 30 sec - exiting 09:06:54 (2023): No heartbeat from core client for 30 sec - exiting 09:06:55 (2023): No heartbeat from core client for 30 sec - exiting 09:06:56 (2023): No heartbeat from core client for 30 sec - exiting 09:06:57 (2023): No heartbeat from core client for 30 sec - exiting 09:06:58 (2023): No heartbeat from core client for 30 sec - exiting 09:06:59 (2023): No heartbeat from core client for 30 sec - exiting 09:07:00 (2023): No heartbeat from core client for 30 sec - exiting 09:07:01 (2023): No heartbeat from core client for 30 sec - exiting 09:07:02 (2023): No heartbeat from core client for 30 sec - exiting 09:07:03 (2023): No heartbeat from core client for 30 sec - exiting 09:07:04 (2023): No heartbeat from core client for 30 sec - exiting 09:07:05 (2023): No heartbeat from core client for 30 sec - exiting 09:07:06 (2023): No heartbeat from core client for 30 sec - exiting 09:07:07 (2023): No heartbeat from core client for 30 sec - exiting 09:07:09 (2023): No heartbeat from core client for 30 sec - exiting 09:07:10 (2023): No heartbeat from core client for 30 sec - exiting 09:07:11 (2023): No heartbeat from core client for 30 sec - exiting 09:07:12 (2023): No heartbeat from core client for 30 sec - exiting 09:07:13 (2023): No heartbeat from core client for 30 sec - exiting 09:07:14 (2023): No heartbeat from core client for 30 sec - exiting 09:07:15 (2023): No heartbeat from core client for 30 sec - exiting 09:07:16 (2023): No heartbeat from core client for 30 sec - exiting 09:07:17 (2023): No heartbeat from core client for 30 sec - exiting 09:07:18 (2023): No heartbeat from core client for 30 sec - exiting 09:07:19 (2023): No heartbeat from core client for 30 sec - exiting 09:07:20 (2023): No heartbeat from core client for 30 sec - exiting 09:07:21 (2023): No heartbeat from core client for 30 sec - exiting 09:07:22 (2023): No heartbeat from core client for 30 sec - exiting 09:07:23 (2023): No heartbeat from core client for 30 sec - exiting 09:07:24 (2023): No heartbeat from core client for 30 sec - exiting 09:07:25 (2023): No heartbeat from core client for 30 sec - exiting 09:07:26 (2023): No heartbeat from core client for 30 sec - exiting 09:07:27 (2023): No heartbeat from core client for 30 sec - exiting 09:07:28 (2023): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:18:19 (2241): No heartbeat from core client for 30 sec - exiting 10:18:20 (2241): No heartbeat from core client for 30 sec - exiting 10:18:21 (2241): No heartbeat from core client for 30 sec - exiting 10:18:22 (2241): No heartbeat from core client for 30 sec - exiting 10:18:23 (2241): No heartbeat from core client for 30 sec - exiting 10:18:24 (2241): No heartbeat from core client for 30 sec - exiting 10:18:25 (2241): No heartbeat from core client for 30 sec - exiting 10:18:26 (2241): No heartbeat from core client for 30 sec - exiting 10:18:27 (2241): No heartbeat from core client for 30 sec - exiting 10:18:28 (2241): No heartbeat from core client for 30 sec - exiting 10:18:29 (2241): No heartbeat from core client for 30 sec - exiting 10:18:30 (2241): No heartbeat from core client for 30 sec - exiting 10:18:31 (2241): No heartbeat from core client for 30 sec - exiting 10:18:32 (2241): No heartbeat from core client for 30 sec - exiting 10:18:33 (2241): No heartbeat from core client for 30 sec - exiting 10:18:34 (2241): No heartbeat from core client for 30 sec - exiting 10:18:35 (2241): No heartbeat from core client for 30 sec - exiting 10:18:36 (2241): No heartbeat from core client for 30 sec - exiting 10:18:37 (2241): No heartbeat from core client for 30 sec - exiting 10:18:38 (2241): No heartbeat from core client for 30 sec - exiting 10:18:39 (2241): No heartbeat from core client for 30 sec - exiting 10:18:40 (2241): No heartbeat from core client for 30 sec - exiting 10:18:41 (2241): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish Signal 3 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Aug 2011 08:21:29	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	207,360	399,102	1.9247
29 Jul 2011 11:09:06	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	181,440	348,968	1.9233
27 Jul 2011 14:27:38	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	155,520	299,295	1.9245
25 Jul 2011 22:58:57	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	129,600	249,128	1.9223
25 Jul 2011 19:29:04	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	103,680	199,519	1.9244
25 Jul 2011 13:24:29	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	77,760	149,368	1.9209
25 Jul 2011 13:24:29	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	51,840	99,005	1.9098
25 Jul 2011 13:24:29	1120190	13121129	hadcm3n_yjvv_1900_40_007358629_0	25,920	48,406	1.8675