Task 18026030

Name	hadam3pm2_pen6_1991_10_009529275_1
Workunit	9611018
Created	8 Mar 2015, 10:50:47 UTC
Sent	8 Mar 2015, 15:36:27 UTC
Report deadline	18 Feb 2016, 20:56:27 UTC
Received	23 May 2015, 12:13:47 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1273826
Run time	54 days 8 hours 20 min 54 sec
CPU time	20 days 17 hours 34 min 48 sec
Validate state	Invalid
Credit	8,900.08
Device peak FLOPS	0.72 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:14:18 (19118): No heartbeat from client for 30 sec - exiting 05:14:18 (19118): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... oa.pc\|4dec.nc oa.pc\|5jan.nc oa.pc\|5feb.nc oa.pc\|5mar.nc oa.pc\|5apr.nc oa.pc\|5may.nc oa.pc\|5jun.nc oa.pc\|5jul.nc oa.pc\|5aug.nc oa.pc\|5sep.nc oa.pc\|5oct.nc oa.pc\|5nov.nc oa.pe\|4dec.nc oa.pe\|5jan.nc oa.pe\|5feb.nc oa.pe\|5mar.nc oa.pe\|5apr.nc oa.pe\|5may.nc oa.pe\|5jun.nc oa.pe\|5jul.nc oa.pe\|5aug.nc oa.pe\|5sep.nc oa.pe\|5oct.nc oa.pe\|5nov.nc 01:02:32 (24299): No heartbeat from client for 30 sec - exiting 01:02:32 (24299): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:13 (6906): No heartbeat from client for 30 sec - exiting 01:03:13 (6906): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:04:18 (6927): No heartbeat from client for 30 sec - exiting 01:04:18 (6927): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:07:01 (6948): No heartbeat from client for 30 sec - exiting 01:07:01 (6948): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:24:39 (6965): No heartbeat from client for 30 sec - exiting 07:24:39 (6965): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:26:30 (11770): No heartbeat from client for 30 sec - exiting 07:26:30 (11770): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:28:56 (11799): No heartbeat from client for 30 sec - exiting 07:28:56 (11799): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:44 (11957): No heartbeat from client for 30 sec - exiting 07:30:44 (11957): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:08 (12014): No heartbeat from client for 30 sec - exiting 07:35:08 (12014): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:35:53 (12249): No heartbeat from client for 30 sec - exiting 07:35:53 (12249): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:37:10 (12282): No heartbeat from client for 30 sec - exiting 07:37:10 (12282): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:38:36 (12324): No heartbeat from client for 30 sec - exiting 07:38:36 (12324): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:39:23 (12350): No heartbeat from client for 30 sec - exiting 07:39:23 (12350): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:40:40 (12379): No heartbeat from client for 30 sec - exiting 07:40:40 (12379): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:41:26 (12420): No heartbeat from client for 30 sec - exiting 07:41:26 (12420): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:42:12 (12436): No heartbeat from client for 30 sec - exiting 07:42:12 (12436): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:13 (12466): No heartbeat from client for 30 sec - exiting 07:43:13 (12466): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:59 (12495): No heartbeat from client for 30 sec - exiting 07:43:59 (12495): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:10 (12525): No heartbeat from client for 30 sec - exiting 07:45:10 (12525): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:58 (12558): No heartbeat from client for 30 sec - exiting 07:45:58 (12558): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:46:59 (12579): No heartbeat from client for 30 sec - exiting 07:46:59 (12579): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:47:45 (12612): No heartbeat from client for 30 sec - exiting 07:47:45 (12612): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:21 (12638): No heartbeat from client for 30 sec - exiting 07:49:21 (12638): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:50:08 (12677): No heartbeat from client for 30 sec - exiting 07:50:08 (12677): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:04 (12694): No heartbeat from client for 30 sec - exiting 07:51:04 (12694): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:52:29 (12731): No heartbeat from client for 30 sec - exiting 07:52:29 (12731): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:53:17 (12796): No heartbeat from client for 30 sec - exiting 07:53:17 (12796): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:54:39 (12814): No heartbeat from client for 30 sec - exiting 07:54:39 (12814): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:55:25 (12843): No heartbeat from client for 30 sec - exiting 07:55:25 (12843): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:36 (12860): No heartbeat from client for 30 sec - exiting 07:56:36 (12860): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:22 (12902): No heartbeat from client for 30 sec - exiting 07:57:22 (12902): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:44 (12916): No heartbeat from client for 30 sec - exiting 07:58:44 (12916): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:59:30 (12951): No heartbeat from client for 30 sec - exiting 07:59:30 (12951): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:57 (12968): No heartbeat from client for 30 sec - exiting 08:00:57 (12968): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:43 (13010): No heartbeat from client for 30 sec - exiting 08:01:43 (13010): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:02:29 (13045): No heartbeat from client for 30 sec - exiting 08:02:29 (13045): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:30 (13070): No heartbeat from client for 30 sec - exiting 08:03:30 (13070): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:04:18 (13103): No heartbeat from client for 30 sec - exiting 08:04:18 (13103): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:05:44 (13129): No heartbeat from client for 30 sec - exiting 08:05:44 (13129): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:30 (13170): No heartbeat from client for 30 sec - exiting 08:06:30 (13170): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:07:46 (13199): No heartbeat from client for 30 sec - exiting 08:07:46 (13199): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:33 (13233): No heartbeat from client for 30 sec - exiting 08:08:33 (13233): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:09:25 (13250): No heartbeat from client for 30 sec - exiting 08:09:25 (13250): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:07 (13281): No heartbeat from client for 30 sec - exiting 08:11:07 (13281): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:53 (13326): No heartbeat from client for 30 sec - exiting 08:11:53 (13326): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:12:48 (13355): No heartbeat from client for 30 sec - exiting 08:12:48 (13355): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:39 (13384): No heartbeat from client for 30 sec - exiting 08:13:39 (13384): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:31 (13415): No heartbeat from client for 30 sec - exiting 08:14:31 (13415): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:15:52 (13445): No heartbeat from client for 30 sec - exiting 08:15:52 (13445): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:16:38 (13487): No heartbeat from client for 30 sec - exiting 08:16:38 (13487): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:17:25 (13504): No heartbeat from client for 30 sec - exiting 08:17:25 (13504): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:51 (13536): No heartbeat from client for 30 sec - exiting 08:18:51 (13536): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:06 (13575): No heartbeat from client for 30 sec - exiting 08:27:06 (13575): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:27:53 (14008): No heartbeat from client for 30 sec - exiting 08:27:53 (14008): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:28:50 (14038): No heartbeat from client for 30 sec - exiting 08:28:50 (14038): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:05 (14067): No heartbeat from client for 30 sec - exiting 08:30:05 (14067): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:52 (14101): No heartbeat from client for 30 sec - exiting 08:30:52 (14101): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:32:08 (14122): No heartbeat from client for 30 sec - exiting 08:32:08 (14122): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:32:55 (14155): No heartbeat from client for 30 sec - exiting 08:32:55 (14155): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:33:40 (14172): No heartbeat from client for 30 sec - exiting 08:33:40 (14172): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:02 (14197): No heartbeat from client for 30 sec - exiting 08:35:02 (14197): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:48 (14231): No heartbeat from client for 30 sec - exiting 08:35:48 (14231): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:47 (14269): No heartbeat from client for 30 sec - exiting 08:36:47 (14269): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:37:30 (14298): No heartbeat from client for 30 sec - exiting 08:37:30 (14298): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:40:51 (14353): No heartbeat from client for 30 sec - exiting 08:40:51 (14353): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:43:32 (14407): No heartbeat from client for 30 sec - exiting 08:43:32 (14407): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:44:58 (14440): No heartbeat from client for 30 sec - exiting 08:44:58 (14440): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:45:45 (14458): No heartbeat from client for 30 sec - exiting 08:45:45 (14458): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:46:31 (14507): No heartbeat from client for 30 sec - exiting 08:46:31 (14507): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:17 (14522): No heartbeat from client for 30 sec - exiting 08:47:17 (14522): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:48:43 (14543): No heartbeat from client for 30 sec - exiting 08:48:43 (14543): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:49:29 (14559): No heartbeat from client for 30 sec - exiting 08:49:29 (14559): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:11 (14574): No heartbeat from client for 30 sec - exiting 08:50:11 (14574): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:51:37 (14598): No heartbeat from client for 30 sec - exiting 08:51:37 (14598): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:24 (14613): No heartbeat from client for 30 sec - exiting 08:52:24 (14613): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:53:04 (14628): No heartbeat from client for 30 sec - exiting 08:53:04 (14628): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:30 (14647): No heartbeat from client for 30 sec - exiting 08:54:30 (14647): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:55:11 (14662): No heartbeat from client for 30 sec - exiting 08:55:11 (14662): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... oa.pc\|8dec.nc oa.pc\|9jan.nc oa.pc\|9feb.nc oa.pc\|9mar.nc oa.pc\|9apr.nc oa.pc\|9may.nc oa.pc\|9jun.nc oa.pc\|9jul.nc oa.pc\|9aug.nc oa.pc\|9sep.nc oa.pc\|9oct.nc oa.pc\|9nov.nc oa.pe\|8dec.nc oa.pe\|9jan.nc oa.pe\|9feb.nc oa.pe\|9mar.nc oa.pe\|9apr.nc oa.pe\|9may.nc oa.pe\|9jun.nc oa.pe\|9jul.nc oa.pe\|9aug.nc oa.pe\|9sep.nc oa.pe\|9oct.nc oa.pe\|9nov.nc oa.pc\|9dec.nc oa.pc\|0jan.nc oa.pc\|0feb.nc oa.pc\|0mar.nc oa.pc\|0apr.nc oa.pc\|0may.nc oa.pc\|0jun.nc oa.pc\|0jul.nc oa.pc\|0aug.nc oa.pc\|0sep.nc oa.pc\|0oct.nc oa.pc\|0nov.nc oa.pe\|9dec.nc oa.pe\|0jan.nc oa.pe\|0feb.nc oa.pe\|0mar.nc oa.pe\|0apr.nc oa.pe\|0may.nc oa.pe\|0jun.nc oa.pe\|0jul.nc oa.pe\|0aug.nc oa.pe\|0sep.nc oa.pe\|0oct.nc oa.pe\|0nov.nc Model crashed: æM Model crashed: § Model crashed: § Model crashed: § Model crashed: § Model crashed: § Sorry, too many model crashes! :-( 07:13:36 (852): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 May 2015 08:30:10	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	308,228	2,456,826	7.9708
22 May 2015 08:21:58	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	305,348	2,435,187	7.9751
22 May 2015 08:11:22	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	302,468	2,412,820	7.9771
20 May 2015 00:58:02	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	299,588	2,389,960	7.9775
19 May 2015 14:13:51	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	296,708	2,367,926	7.9807
19 May 2015 01:31:57	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	293,828	2,345,516	7.9826
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	290,948	2,322,002	7.9808
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	288,068	2,298,444	7.9788
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	285,188	2,274,826	7.9766
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	282,308	2,251,105	7.9739
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	279,428	2,227,612	7.9720
18 May 2015 14:15:20	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	273,668	2,180,647	7.9682
14 May 2015 21:59:23	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	270,788	2,157,765	7.9685
14 May 2015 10:46:37	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	267,908	2,136,710	7.9755
14 May 2015 00:41:09	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	265,028	2,115,313	7.9815
13 May 2015 17:29:32	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	262,148	2,092,760	7.9831
13 May 2015 10:43:30	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	259,268	2,071,360	7.9893
13 May 2015 01:49:44	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	256,388	2,050,821	7.9989
12 May 2015 14:50:51	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	253,508	2,030,093	8.0080
12 May 2015 09:14:27	1273826	18026030	hadam3pm2_pen6_1991_10_009529275_1	250,628	2,008,558	8.0141