Task 15911378

Name	hadcm3n_zi62_1960_40_008340108_4
Workunit	8490969
Created	30 Jul 2013, 9:35:22 UTC
Sent	30 Jul 2013, 9:37:51 UTC
Report deadline	29 Oct 2013, 17:05:02 UTC
Received	21 Aug 2013, 6:16:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1286626
Run time	2 days 21 hours 22 min 14 sec
CPU time	2 days 10 hours 49 min 34 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:44:58 (1061): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:45:48 (2387): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:35:56 (1277): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:40:49 (2549): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:41:07 (2549): No heartbeat from core client for 30 sec - exiting 15:41:08 (2549): No heartbeat from core client for 30 sec - exiting 15:41:09 (2549): No heartbeat from core client for 30 sec - exiting 15:41:10 (2549): No heartbeat from core client for 30 sec - exiting 15:41:11 (2549): No heartbeat from core client for 30 sec - exiting 15:41:12 (2549): No heartbeat from core client for 30 sec - exiting 15:42:40 (2564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:44:06 (2570): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:49:08 (2580): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:46 (1638): No heartbeat from core client for 30 sec - exiting 07:31:58 (1638): No heartbeat from core client for 30 sec - exiting 07:31:59 (1638): No heartbeat from core client for 30 sec - exiting 07:32:00 (1638): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 08:23:54 (2159): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:04:35 (2227): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:04:36 (2227): No heartbeat from core client for 30 sec - exiting 11:04:37 (2227): No heartbeat from core client for 30 sec - exiting 11:04:38 (2227): No heartbeat from core client for 30 sec - exiting 11:06:28 (2234): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:04 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:39 (2246): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:08:40 (2246): No heartbeat from core client for 30 sec - exiting 11:08:41 (2246): No heartbeat from core client for 30 sec - exiting 11:10:20 (2253): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:10:21 (2253): No heartbeat from core client for 30 sec - exiting 11:11:04 (2259): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:05 (2259): No heartbeat from core client for 30 sec - exiting 11:11:06 (2259): No heartbeat from core client for 30 sec - exiting BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... 11:17:20 (2289): No heartbeat from core client for 30 sec - exiting 11:17:25 (2289): No heartbeat from core client for 30 sec - exiting 11:17:26 (2289): No heartbeat from core client for 30 sec - exiting 11:17:27 (2289): No heartbeat from core client for 30 sec - exiting 11:17:28 (2289): No heartbeat from core client for 30 sec - exiting 11:17:29 (2289): No heartbeat from core client for 30 sec - exiting 11:17:30 (2289): No heartbeat from core client for 30 sec - exiting 11:17:33 (2289): No heartbeat from core client for 30 sec - exiting 11:17:35 (2289): No heartbeat from core client for 30 sec - exiting 11:17:36 (2289): No heartbeat from core client for 30 sec - exiting 11:17:37 (2289): No heartbeat from core client for 30 sec - exiting 11:17:38 (2289): No heartbeat from core client for 30 sec - exiting 11:18:24 (2289): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 14:21:27 (2370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:21:28 (2370): No heartbeat from core client for 30 sec - exiting 14:21:29 (2370): No heartbeat from core client for 30 sec - exiting 14:21:30 (2370): No heartbeat from core client for 30 sec - exiting 14:21:31 (2370): No heartbeat from core client for 30 sec - exiting 14:21:32 (2370): No heartbeat from core client for 30 sec - exiting 14:21:33 (2370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:36:38 (2587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:57 (2599): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:55:58 (2599): No heartbeat from core client for 30 sec - exiting 15:55:59 (2599): No heartbeat from core client for 30 sec - exiting 15:56:00 (2599): No heartbeat from core client for 30 sec - exiting 15:56:01 (2599): No heartbeat from core client for 30 sec - exiting 15:56:02 (2599): No heartbeat from core client for 30 sec - exiting 15:56:03 (2599): No heartbeat from core client for 30 sec - exiting 15:56:04 (2599): No heartbeat from core client for 30 sec - exiting 15:56:05 (2599): No heartbeat from core client for 30 sec - exiting 15:56:06 (2599): No heartbeat from core client for 30 sec - exiting 15:56:07 (2599): No heartbeat from core client for 30 sec - exiting 15:56:08 (2599): No heartbeat from core client for 30 sec - exiting 16:36:21 (2608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 10:10:52 (1439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
15 Aug 2013 03:33:47	1286626	15911378	hadcm3n_zi62_1960_40_008340108_4	129,600	200,842	1.5497
15 Aug 2013 03:33:47	1286626	15911378	hadcm3n_zi62_1960_40_008340108_4	103,680	161,005	1.5529
15 Aug 2013 03:33:47	1286626	15911378	hadcm3n_zi62_1960_40_008340108_4	77,760	120,735	1.5527
15 Aug 2013 03:33:47	1286626	15911378	hadcm3n_zi62_1960_40_008340108_4	51,840	80,196	1.5470
15 Aug 2013 03:33:47	1286626	15911378	hadcm3n_zi62_1960_40_008340108_4	25,920	40,263	1.5534