Task 15820913

Name	hadcm3n_o5qp_1980_40_008385585_0
Workunit	8536444
Created	3 Jun 2013, 3:41:39 UTC
Sent	11 Jun 2013, 6:34:52 UTC
Report deadline	10 Sep 2013, 14:02:03 UTC
Received	21 Jul 2013, 21:22:51 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1278132
Run time	14 days 23 hours 47 min 13 sec
CPU time	14 days 16 hours 9 min 45 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	1.53 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:31:56 (2747): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 07:01:48 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:49:31 (27614): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:05:43 (29028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 05:13:46 (29597): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:14:19 (29597): No heartbeat from core client for 30 sec - exiting 05:14:22 (29597): No heartbeat from core client for 30 sec - exiting 05:24:39 (29613): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:46 (29613): No heartbeat from core client for 30 sec - exiting 05:36:37 (29652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:38:01 (29652): No heartbeat from core client for 30 sec - exiting 06:05:46 (29704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:05:54 (29704): No heartbeat from core client for 30 sec - exiting 06:05:55 (29704): No heartbeat from core client for 30 sec - exiting 06:26:20 (29760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:26:57 (29760): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish 09:09:03 (2274): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:06 (4495): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:14:25 (4506): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:14:26 (4506): No heartbeat from core client for 30 sec - exiting 09:14:27 (4506): No heartbeat from core client for 30 sec - exiting 09:14:28 (4506): No heartbeat from core client for 30 sec - exiting 09:14:29 (4506): No heartbeat from core client for 30 sec - exiting 09:14:30 (4506): No heartbeat from core client for 30 sec - exiting 09:14:31 (4506): No heartbeat from core client for 30 sec - exiting 09:14:32 (4506): No heartbeat from core client for 30 sec - exiting 09:16:59 (4517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:18:39 (4548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:20:03 (4559): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:23:03 (4566): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:33 (4577): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:26:17 (4593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:28:43 (4598): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:56 (4621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 09:46:07 (4703): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:47 (4981): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:07 (5018): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:30:16 (5018): No heartbeat from core client for 30 sec - exiting 10:33:02 (5094): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:45:39 (5111): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:49:14 (5178): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:38 (5194): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:09 (5210): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:55:10 (5210): No heartbeat from core client for 30 sec - exiting 11:55:11 (5210): No heartbeat from core client for 30 sec - exiting 11:55:12 (5210): No heartbeat from core client for 30 sec - exiting 11:55:13 (5210): No heartbeat from core client for 30 sec - exiting 11:55:14 (5210): No heartbeat from core client for 30 sec - exiting 11:55:15 (5210): No heartbeat from core client for 30 sec - exiting 11:55:16 (5210): No heartbeat from core client for 30 sec - exiting 11:55:17 (5210): No heartbeat from core client for 30 sec - exiting 11:55:18 (5210): No heartbeat from core client for 30 sec - exiting 11:55:19 (5210): No heartbeat from core client for 30 sec - exiting 11:55:20 (5210): No heartbeat from core client for 30 sec - exiting 11:59:28 (5353): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:33 (5353): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 12:05:32 (5387): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:03 (5406): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:07:04 (5406): No heartbeat from core client for 30 sec - exiting 12:07:05 (5406): No heartbeat from core client for 30 sec - exiting 12:07:06 (5406): No heartbeat from core client for 30 sec - exiting 12:07:42 (5418): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:30:39 (5426): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:00:34 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:34 (5598): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:26 (5615): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:27 (5615): No heartbeat from core client for 30 sec - exiting 13:06:28 (5615): No heartbeat from core client for 30 sec - exiting 13:06:29 (5615): No heartbeat from core client for 30 sec - exiting 13:06:30 (5615): No heartbeat from core client for 30 sec - exiting 13:06:31 (5615): No heartbeat from core client for 30 sec - exiting 13:06:32 (5615): No heartbeat from core client for 30 sec - exiting 13:06:33 (5615): No heartbeat from core client for 30 sec - exiting 13:06:34 (5615): No heartbeat from core client for 30 sec - exiting 13:06:35 (5615): No heartbeat from core client for 30 sec - exiting 13:06:36 (5615): No heartbeat from core client for 30 sec - exiting 13:06:37 (5615): No heartbeat from core client for 30 sec - exiting 13:06:38 (5615): No heartbeat from core client for 30 sec - exiting 13:06:39 (5615): No heartbeat from core client for 30 sec - exiting 13:06:40 (5615): No heartbeat from core client for 30 sec - exiting 13:08:09 (5628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:08:10 (5628): No heartbeat from core client for 30 sec - exiting 13:08:11 (5628): No heartbeat from core client for 30 sec - exiting 13:08:12 (5628): No heartbeat from core client for 30 sec - exiting 13:08:13 (5628): No heartbeat from core client for 30 sec - exiting 13:08:14 (5628): No heartbeat from core client for 30 sec - exiting 13:08:15 (5628): No heartbeat from core client for 30 sec - exiting 13:08:16 (5628): No heartbeat from core client for 30 sec - exiting 13:08:17 (5628): No heartbeat from core client for 30 sec - exiting 13:08:18 (5628): No heartbeat from core client for 30 sec - exiting 13:08:19 (5628): No heartbeat from core client for 30 sec - exiting 13:08:20 (5628): No heartbeat from core client for 30 sec - exiting 13:08:21 (5628): No heartbeat from core client for 30 sec - exiting 13:08:22 (5628): No heartbeat from core client for 30 sec - exiting 14:22:47 (5643): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:24:46 (5826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:33 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:27:29 (5840): No heartbeat from core client for 30 sec - exiting 14:28:49 (5852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:24 (5883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:12 (5898): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:13 (5898): No heartbeat from core client for 30 sec - exiting 14:39:14 (5898): No heartbeat from core client for 30 sec - exiting 14:39:15 (5898): No heartbeat from core client for 30 sec - exiting 14:39:16 (5898): No heartbeat from core client for 30 sec - exiting 14:39:17 (5898): No heartbeat from core client for 30 sec - exiting 15:59:42 (5914): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:45 (5914): No heartbeat from core client for 30 sec - exiting 16:04:30 (6118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:40 (6141): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 21:23:37	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	1,036,800	1,267,223	1.2222
23 Jul 2013 20:59:25	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	1,010,880	1,232,746	1.2195
23 Jul 2013 20:45:58	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	984,960	1,198,419	1.2167
23 Jul 2013 20:32:09	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	959,040	1,164,636	1.2144
23 Jul 2013 20:19:01	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	933,120	1,134,930	1.2163
23 Jul 2013 20:09:18	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	907,200	1,108,896	1.2223
23 Jul 2013 19:55:25	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	881,280	1,082,488	1.2283
23 Jul 2013 19:25:05	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	855,360	1,050,942	1.2287
23 Jul 2013 17:50:27	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	829,440	1,014,973	1.2237
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	803,520	981,691	1.2217
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	777,600	954,516	1.2275
23 Jul 2013 14:52:14	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	751,680	927,087	1.2334
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	725,760	895,845	1.2344
23 Jul 2013 14:52:11	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	699,840	867,391	1.2394
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	673,920	840,878	1.2477
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	648,000	813,492	1.2554
23 Jul 2013 14:52:10	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	622,080	786,288	1.2640
23 Jul 2013 14:52:12	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	596,160	760,143	1.2751
23 Jul 2013 14:52:12	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	570,240	728,287	1.2772
23 Jul 2013 14:52:15	1278132	15820913	hadcm3n_o5qp_1980_40_008385585_0	544,320	701,141	1.2881