Task 15596490

Name	hadcm3n_47wr_1940_40_008309419_0
Workunit	8460554
Created	7 Feb 2013, 21:02:34 UTC
Sent	7 Feb 2013, 21:04:05 UTC
Report deadline	10 May 2013, 4:31:16 UTC
Received	25 Mar 2013, 21:56:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	947732
Run time	7 days 3 hours 51 min 7 sec
CPU time	5 days 12 hours 24 min 28 sec
Validate state	Invalid
Credit	2,177.28
Device peak FLOPS	1.67 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:41:19 (3099): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:05:17 (2183): No heartbeat from core client for 30 sec - exiting 11:05:18 (2183): No heartbeat from core client for 30 sec - exiting 11:05:19 (2183): No heartbeat from core client for 30 sec - exiting 11:05:20 (2183): No heartbeat from core client for 30 sec - exiting 11:05:21 (2183): No heartbeat from core client for 30 sec - exiting 11:05:22 (2183): No heartbeat from core client for 30 sec - exiting 11:05:23 (2183): No heartbeat from core client for 30 sec - exiting 11:05:24 (2183): No heartbeat from core client for 30 sec - exiting 11:05:25 (2183): No heartbeat from core client for 30 sec - exiting 11:05:26 (2183): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:07:09 (1824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:06:51 (1833): No heartbeat from core client for 30 sec - exiting 10:06:59 (1833): No heartbeat from core client for 30 sec - exiting 10:07:00 (1833): No heartbeat from core client for 30 sec - exiting 10:07:01 (1833): No heartbeat from core client for 30 sec - exiting 10:07:02 (1833): No heartbeat from core client for 30 sec - exiting 10:07:06 (1833): No heartbeat from core client for 30 sec - exiting 10:07:07 (1833): No heartbeat from core client for 30 sec - exiting 10:07:08 (1833): No heartbeat from core client for 30 sec - exiting 10:07:09 (1833): No heartbeat from core client for 30 sec - exiting 10:07:10 (1833): No heartbeat from core client for 30 sec - exiting 10:07:11 (1833): No heartbeat from core client for 30 sec - exiting 10:07:12 (1833): No heartbeat from core client for 30 sec - exiting 10:07:13 (1833): No heartbeat from core client for 30 sec - exiting 10:07:14 (1833): No heartbeat from core client for 30 sec - exiting 10:07:15 (1833): No heartbeat from core client for 30 sec - exiting 10:07:16 (1833): No heartbeat from core client for 30 sec - exiting 10:07:17 (1833): No heartbeat from core client for 30 sec - exiting 10:07:18 (1833): No heartbeat from core client for 30 sec - exiting 10:07:19 (1833): No heartbeat from core client for 30 sec - exiting 10:07:20 (1833): No heartbeat from core client for 30 sec - exiting 10:07:21 (1833): No heartbeat from core client for 30 sec - exiting 10:07:22 (1833): No heartbeat from core client for 30 sec - exiting 10:07:23 (1833): No heartbeat from core client for 30 sec - exiting 10:07:24 (1833): No heartbeat from core client for 30 sec - exiting 10:07:25 (1833): No heartbeat from core client for 30 sec - exiting 10:07:26 (1833): No heartbeat from core client for 30 sec - exiting 10:07:27 (1833): No heartbeat from core client for 30 sec - exiting 10:07:28 (1833): No heartbeat from core client for 30 sec - exiting 10:07:29 (1833): No heartbeat from core client for 30 sec - exiting 10:07:30 (1833): No heartbeat from core client for 30 sec - exiting 10:07:31 (1833): No heartbeat from core client for 30 sec - exiting 10:07:32 (1833): No heartbeat from core client for 30 sec - exiting 10:07:33 (1833): No heartbeat from core client for 30 sec - exiting 10:07:34 (1833): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:53 (1805): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:20:54 (2527): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:16:45 (1835): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:16:48 (1835): No heartbeat from core client for 30 sec - exiting 11:17:27 (22343): No heartbeat from core client for 30 sec - exiting 11:17:28 (22343): No heartbeat from core client for 30 sec - exiting 11:17:29 (22343): No heartbeat from core client for 30 sec - exiting 11:17:30 (22343): No heartbeat from core client for 30 sec - exiting 11:17:31 (22343): No heartbeat from core client for 30 sec - exiting 11:17:32 (22343): No heartbeat from core client for 30 sec - exiting 11:17:33 (22343): No heartbeat from core client for 30 sec - exiting 11:17:34 (22343): No heartbeat from core client for 30 sec - exiting 11:17:35 (22343): No heartbeat from core client for 30 sec - exiting 11:17:36 (22343): No heartbeat from core client for 30 sec - exiting 11:17:37 (22343): No heartbeat from core client for 30 sec - exiting 11:17:38 (22343): No heartbeat from core client for 30 sec - exiting 11:17:39 (22343): No heartbeat from core client for 30 sec - exiting 11:17:40 (22343): No heartbeat from core client for 30 sec - exiting 11:17:41 (22343): No heartbeat from core client for 30 sec - exiting 11:17:42 (22343): No heartbeat from core client for 30 sec - exiting 11:17:43 (22343): No heartbeat from core client for 30 sec - exiting 11:17:44 (22343): No heartbeat from core client for 30 sec - exiting 11:17:45 (22343): No heartbeat from core client for 30 sec - exiting 11:17:46 (22343): No heartbeat from core client for 30 sec - exiting 11:17:47 (22343): No heartbeat from core client for 30 sec - exiting 11:17:48 (22343): No heartbeat from core client for 30 sec - exiting 11:17:49 (22343): No heartbeat from core client for 30 sec - exiting 11:17:50 (22343): No heartbeat from core client for 30 sec - exiting 11:17:51 (22343): No heartbeat from core client for 30 sec - exiting 11:17:52 (22343): No heartbeat from core client for 30 sec - exiting 11:17:53 (22343): No heartbeat from core client for 30 sec - exiting 11:17:54 (22343): No heartbeat from core client for 30 sec - exiting 11:17:55 (22343): No heartbeat from core client for 30 sec - exiting 11:17:56 (22343): No heartbeat from core client for 30 sec - exiting 11:17:57 (22343): No heartbeat from core client for 30 sec - exiting 11:17:58 (22343): No heartbeat from core client for 30 sec - exiting 11:17:59 (22343): No heartbeat from core client for 30 sec - exiting 11:18:00 (22343): No heartbeat from core client for 30 sec - exiting 11:18:01 (22343): No heartbeat from core client for 30 sec - exiting 11:18:02 (22343): No heartbeat from core client for 30 sec - exiting 11:18:03 (22343): No heartbeat from core client for 30 sec - exiting 11:18:04 (22343): No heartbeat from core client for 30 sec - exiting 11:18:05 (22343): No heartbeat from core client for 30 sec - exiting 11:18:06 (22343): No heartbeat from core client for 30 sec - exiting 11:18:07 (22343): No heartbeat from core client for 30 sec - exiting 11:18:08 (22343): No heartbeat from core client for 30 sec - exiting 11:18:09 (22343): No heartbeat from core client for 30 sec - exiting 11:18:10 (22343): No heartbeat from core client for 30 sec - exiting 11:18:11 (22343): No heartbeat from core client for 30 sec - exiting 11:18:12 (22343): No heartbeat from core client for 30 sec - exiting 11:18:13 (22343): No heartbeat from core client for 30 sec - exiting 11:18:14 (22343): No heartbeat from core client for 30 sec - exiting 11:18:15 (22343): No heartbeat from core client for 30 sec - exiting 11:18:16 (22343): No heartbeat from core client for 30 sec - exiting 11:18:17 (22343): No heartbeat from core client for 30 sec - exiting 11:18:18 (22343): No heartbeat from core client for 30 sec - exiting 11:18:19 (22343): No heartbeat from core client for 30 sec - exiting 11:18:20 (22343): No heartbeat from core client for 30 sec - exiting 11:18:21 (22343): No heartbeat from core client for 30 sec - exiting 11:18:22 (22343): No heartbeat from core client for 30 sec - exiting 11:18:23 (22343): No heartbeat from core client for 30 sec - exiting 11:18:24 (22343): No heartbeat from core client for 30 sec - exiting 11:18:25 (22343): No heartbeat from core client for 30 sec - exiting 11:18:26 (22343): No heartbeat from core client for 30 sec - exiting 11:18:27 (22343): No heartbeat from core client for 30 sec - exiting 11:18:28 (22343): No heartbeat from core client for 30 sec - exiting 11:18:29 (22343): No heartbeat from core client for 30 sec - exiting 11:18:30 (22343): No heartbeat from core client for 30 sec - exiting 11:18:31 (22343): No heartbeat from core client for 30 sec - exiting 11:18:32 (22343): No heartbeat from core client for 30 sec - exiting 11:18:33 (22343): No heartbeat from core client for 30 sec - exiting 11:18:34 (22343): No heartbeat from core client for 30 sec - exiting 11:18:35 (22343): No heartbeat from core client for 30 sec - exiting 11:18:36 (22343): No heartbeat from core client for 30 sec - exiting 11:18:37 (22343): No heartbeat from core client for 30 sec - exiting 11:18:38 (22343): No heartbeat from core client for 30 sec - exiting 11:18:39 (22343): No heartbeat from core client for 30 sec - exiting 11:18:40 (22343): No heartbeat from core client for 30 sec - exiting 11:18:41 (22343): No heartbeat from core client for 30 sec - exiting 11:18:42 (22343): No heartbeat from core client for 30 sec - exiting 11:18:43 (22343): No heartbeat from core client for 30 sec - exiting 11:18:44 (22343): No heartbeat from core client for 30 sec - exiting 11:18:45 (22343): No heartbeat from core client for 30 sec - exiting 11:18:46 (22343): No heartbeat from core client for 30 sec - exiting 11:18:47 (22343): No heartbeat from core client for 30 sec - exiting 11:18:48 (22343): No heartbeat from core client for 30 sec - exiting 11:18:49 (22343): No heartbeat from core client for 30 sec - exiting 11:18:50 (22343): No heartbeat from core client for 30 sec - exiting 11:18:51 (22343): No heartbeat from core client for 30 sec - exiting 11:18:52 (22343): No heartbeat from core client for 30 sec - exiting 11:18:53 (22343): No heartbeat from core client for 30 sec - exiting 11:18:54 (22343): No heartbeat from core client for 30 sec - exiting 11:18:55 (22343): No heartbeat from core client for 30 sec - exiting 11:18:56 (22343): No heartbeat from core client for 30 sec - exiting 11:18:57 (22343): No heartbeat from core client for 30 sec - exiting 11:18:58 (22343): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: STWORK : Error in PP_FILE tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: STWORK : Error in PP_FILE Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2013 00:22:03	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	181,440	465,491	2.5655
18 Mar 2013 18:32:48	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	155,520	400,176	2.5731
12 Mar 2013 22:47:19	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	129,600	334,582	2.5817
05 Mar 2013 01:18:46	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	103,680	268,268	2.5875
26 Feb 2013 23:14:27	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	77,760	200,284	2.5757
22 Feb 2013 00:50:17	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	51,840	132,069	2.5476
19 Feb 2013 22:40:40	947732	15596490	hadcm3n_47wr_1940_40_008309419_0	25,920	65,693	2.5345