Task 15799611

Name	hadcm3n_zip0_1920_40_008365944_4
Workunit	8516803
Created	28 May 2013, 15:57:17 UTC
Sent	28 May 2013, 15:57:24 UTC
Report deadline	27 Aug 2013, 23:24:35 UTC
Received	29 Jun 2013, 5:06:39 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1190093
Run time	10 days 18 hours 34 min 44 sec
CPU time	10 days 3 hours 18 min 13 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.39 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> (unknown error) - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:49:41 (3556): No heartbeat from core client for 30 sec - exiting 04:49:42 (3556): No heartbeat from core client for 30 sec - exiting 04:49:44 (3556): No heartbeat from core client for 30 sec - exiting 04:49:45 (3556): No heartbeat from core client for 30 sec - exiting 04:49:46 (3556): No heartbeat from core client for 30 sec - exiting 04:49:47 (3556): No heartbeat from core client for 30 sec - exiting 04:49:48 (3556): No heartbeat from core client for 30 sec - exiting 04:49:49 (3556): No heartbeat from core client for 30 sec - exiting 04:49:50 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:03:30 (3604): No heartbeat from core client for 30 sec - exiting 15:03:31 (3604): No heartbeat from core client for 30 sec - exiting 15:03:32 (3604): No heartbeat from core client for 30 sec - exiting 15:03:33 (3604): No heartbeat from core client for 30 sec - exiting 15:03:34 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 06:35:10 (3520): No heartbeat from core client for 30 sec - exiting 06:35:11 (3520): No heartbeat from core client for 30 sec - exiting 06:35:12 (3520): No heartbeat from core client for 30 sec - exiting 06:35:13 (3520): No heartbeat from core client for 30 sec - exiting 06:35:15 (3520): No heartbeat from core client for 30 sec - exiting 06:35:16 (3520): No heartbeat from core client for 30 sec - exiting 06:35:17 (3520): No heartbeat from core client for 30 sec - exiting 06:35:18 (3520): No heartbeat from core client for 30 sec - exiting 06:35:19 (3520): No heartbeat from core client for 30 sec - exiting 06:35:20 (3520): No heartbeat from core client for 30 sec - exiting 06:35:21 (3520): No heartbeat from core client for 30 sec - exiting 06:35:22 (3520): No heartbeat from core client for 30 sec - exiting 06:35:23 (3520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 06:31:51 (3924): No heartbeat from core client for 30 sec - exiting 06:31:52 (3924): No heartbeat from core client for 30 sec - exiting 06:31:53 (3924): No heartbeat from core client for 30 sec - exiting 06:31:55 (3924): No heartbeat from core client for 30 sec - exiting 06:31:56 (3924): No heartbeat from core client for 30 sec - exiting 06:31:57 (3924): No heartbeat from core client for 30 sec - exiting 06:31:58 (3924): No heartbeat from core client for 30 sec - exiting 06:31:59 (3924): No heartbeat from core client for 30 sec - exiting 06:32:00 (3924): No heartbeat from core client for 30 sec - exiting 06:32:01 (3924): No heartbeat from core client for 30 sec - exiting 06:32:02 (3924): No heartbeat from core client for 30 sec - exiting 06:32:03 (3924): No heartbeat from core client for 30 sec - exiting 06:32:04 (3924): No heartbeat from core client for 30 sec - exiting 06:32:06 (3924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:53:24 (3516): No heartbeat from core client for 30 sec - exiting 13:53:25 (3516): No heartbeat from core client for 30 sec - exiting 13:53:26 (3516): No heartbeat from core client for 30 sec - exiting 13:53:27 (3516): No heartbeat from core client for 30 sec - exiting 13:53:28 (3516): No heartbeat from core client for 30 sec - exiting 13:53:30 (3516): No heartbeat from core client for 30 sec - exiting 13:53:31 (3516): No heartbeat from core client for 30 sec - exiting 13:53:32 (3516): No heartbeat from core client for 30 sec - exiting 13:53:33 (3516): No heartbeat from core client for 30 sec - exiting 13:53:34 (3516): No heartbeat from core client for 30 sec - exiting 13:53:35 (3516): No heartbeat from core client for 30 sec - exiting 13:53:36 (3516): No heartbeat from core client for 30 sec - exiting 13:53:37 (3516): No heartbeat from core client for 30 sec - exiting 13:53:38 (3516): No heartbeat from core client for 30 sec - exiting 13:53:39 (3516): No heartbeat from core client for 30 sec - exiting 13:53:40 (3516): No heartbeat from core client for 30 sec - exiting 13:53:42 (3516): No heartbeat from core client for 30 sec - exiting 13:53:43 (3516): No heartbeat from core client for 30 sec - exiting 13:53:44 (3516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:30:07 (3416): No heartbeat from core client for 30 sec - exiting 06:30:08 (3416): No heartbeat from core client for 30 sec - exiting 06:30:09 (3416): No heartbeat from core client for 30 sec - exiting 06:30:10 (3416): No heartbeat from core client for 30 sec - exiting 06:30:11 (3416): No heartbeat from core client for 30 sec - exiting 06:30:12 (3416): No heartbeat from core client for 30 sec - exiting 06:30:13 (3416): No heartbeat from core client for 30 sec - exiting 06:30:14 (3416): No heartbeat from core client for 30 sec - exiting 06:30:15 (3416): No heartbeat from core client for 30 sec - exiting 06:30:17 (3416): No heartbeat from core client for 30 sec - exiting 06:30:18 (3416): No heartbeat from core client for 30 sec - exiting 06:30:19 (3416): No heartbeat from core client for 30 sec - exiting 06:30:20 (3416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:42:15 (4276): No heartbeat from core client for 30 sec - exiting 12:42:16 (4276): No heartbeat from core client for 30 sec - exiting 12:42:17 (4276): No heartbeat from core client for 30 sec - exiting 12:42:18 (4276): No heartbeat from core client for 30 sec - exiting 12:42:19 (4276): No heartbeat from core client for 30 sec - exiting 12:42:21 (4276): No heartbeat from core client for 30 sec - exiting 12:42:22 (4276): No heartbeat from core client for 30 sec - exiting 12:42:23 (4276): No heartbeat from core client for 30 sec - exiting 12:42:24 (4276): No heartbeat from core client for 30 sec - exiting 12:42:25 (4276): No heartbeat from core client for 30 sec - exiting 12:42:26 (4276): No heartbeat from core client for 30 sec - exiting 12:42:27 (4276): No heartbeat from core client for 30 sec - exiting 12:42:28 (4276): No heartbeat from core client for 30 sec - exiting 12:42:29 (4276): No heartbeat from core client for 30 sec - exiting 12:42:30 (4276): No heartbeat from core client for 30 sec - exiting 12:42:31 (4276): No heartbeat from core client for 30 sec - exiting 12:42:33 (4276): No heartbeat from core client for 30 sec - exiting 12:42:34 (4276): No heartbeat from core client for 30 sec - exiting 12:42:35 (4276): No heartbeat from core client for 30 sec - exiting 12:42:36 (4276): No heartbeat from core client for 30 sec - exiting 12:42:37 (4276): No heartbeat from core client for 30 sec - exiting 12:42:38 (4276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:31:54 (3628): No heartbeat from core client for 30 sec - exiting 06:31:55 (3628): No heartbeat from core client for 30 sec - exiting 06:31:56 (3628): No heartbeat from core client for 30 sec - exiting 06:31:57 (3628): No heartbeat from core client for 30 sec - exiting 06:31:59 (3628): No heartbeat from core client for 30 sec - exiting 06:32:00 (3628): No heartbeat from core client for 30 sec - exiting 06:32:01 (3628): No heartbeat from core client for 30 sec - exiting 06:32:02 (3628): No heartbeat from core client for 30 sec - exiting 06:32:03 (3628): No heartbeat from core client for 30 sec - exiting 06:32:04 (3628): No heartbeat from core client for 30 sec - exiting 06:32:05 (3628): No heartbeat from core client for 30 sec - exiting 06:32:06 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:28:07 (3352): No heartbeat from core client for 30 sec - exiting 06:28:08 (3352): No heartbeat from core client for 30 sec - exiting 06:28:09 (3352): No heartbeat from core client for 30 sec - exiting 06:28:10 (3352): No heartbeat from core client for 30 sec - exiting 06:28:11 (3352): No heartbeat from core client for 30 sec - exiting 06:28:12 (3352): No heartbeat from core client for 30 sec - exiting 06:28:14 (3352): No heartbeat from core client for 30 sec - exiting 06:28:15 (3352): No heartbeat from core client for 30 sec - exiting 06:28:16 (3352): No heartbeat from core client for 30 sec - exiting 06:28:17 (3352): No heartbeat from core client for 30 sec - exiting 06:28:18 (3352): No heartbeat from core client for 30 sec - exiting 06:28:19 (3352): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:18 (3388): No heartbeat from core client for 30 sec - exiting 13:07:19 (3388): No heartbeat from core client for 30 sec - exiting 13:07:20 (3388): No heartbeat from core client for 30 sec - exiting 13:07:21 (3388): No heartbeat from core client for 30 sec - exiting 13:07:23 (3388): No heartbeat from core client for 30 sec - exiting 13:07:24 (3388): No heartbeat from core client for 30 sec - exiting 13:07:25 (3388): No heartbeat from core client for 30 sec - exiting 13:07:26 (3388): No heartbeat from core client for 30 sec - exiting 13:07:27 (3388): No heartbeat from core client for 30 sec - exiting 13:07:28 (3388): No heartbeat from core client for 30 sec - exiting 13:07:29 (3388): No heartbeat from core client for 30 sec - exiting 13:07:30 (3388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:08 (3420): No heartbeat from core client for 30 sec - exiting 22:00:09 (3420): No heartbeat from core client for 30 sec - exiting 22:00:10 (3420): No heartbeat from core client for 30 sec - exiting 22:00:11 (3420): No heartbeat from core client for 30 sec - exiting 22:00:12 (3420): No heartbeat from core client for 30 sec - exiting 22:00:13 (3420): No heartbeat from core client for 30 sec - exiting 22:00:15 (3420): No heartbeat from core client for 30 sec - exiting 22:00:16 (3420): No heartbeat from core client for 30 sec - exiting 22:00:17 (3420): No heartbeat from core client for 30 sec - exiting 22:00:18 (3420): No heartbeat from core client for 30 sec - exiting 22:00:19 (3420): No heartbeat from core client for 30 sec - exiting 22:00:20 (3420): No heartbeat from core client for 30 sec - exiting 22:00:21 (3420): No heartbeat from core client for 30 sec - exiting 22:00:22 (3420): No heartbeat from core client for 30 sec - exiting 22:00:23 (3420): No heartbeat from core client for 30 sec - exiting 22:00:24 (3420): No heartbeat from core client for 30 sec - exiting 22:00:25 (3420): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 03:22:12 (3824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:18:46 (3436): No heartbeat from core client for 30 sec - exiting 08:18:47 (3436): No heartbeat from core client for 30 sec - exiting 08:18:49 (3436): No heartbeat from core client for 30 sec - exiting 08:18:50 (3436): No heartbeat from core client for 30 sec - exiting 08:18:51 (3436): No heartbeat from core client for 30 sec - exiting 08:18:52 (3436): No heartbeat from core client for 30 sec - exiting 08:18:53 (3436): No heartbeat from core client for 30 sec - exiting 08:18:54 (3436): No heartbeat from core client for 30 sec - exiting 08:18:55 (3436): No heartbeat from core client for 30 sec - exiting 08:18:56 (3436): No heartbeat from core client for 30 sec - exiting 08:18:57 (3436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4000, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3868, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Jul 2013 09:58:14	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	518,400	875,891	1.6896
27 Jun 2013 21:01:11	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	492,480	832,096	1.6896
26 Jun 2013 14:52:28	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	466,560	787,759	1.6884
26 Jun 2013 01:56:05	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	440,640	743,687	1.6877
24 Jun 2013 21:19:40	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	414,720	700,285	1.6886
24 Jun 2013 01:16:28	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	388,800	655,982	1.6872
23 Jun 2013 01:18:33	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	362,880	611,218	1.6844
22 Jun 2013 10:52:13	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	336,960	565,225	1.6774
20 Jun 2013 15:51:16	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	311,040	519,995	1.6718
19 Jun 2013 02:43:43	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	285,120	474,095	1.6628
16 Jun 2013 21:55:29	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	259,200	428,507	1.6532
14 Jun 2013 10:18:16	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	233,280	383,910	1.6457
13 Jun 2013 22:11:29	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	207,360	341,499	1.6469
09 Jun 2013 20:10:14	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	181,440	297,696	1.6407
06 Jun 2013 18:50:37	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	155,520	255,170	1.6408
05 Jun 2013 19:48:05	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	129,600	212,825	1.6422
04 Jun 2013 20:08:13	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	103,680	170,205	1.6416
03 Jun 2013 12:06:12	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	77,760	127,171	1.6354
30 May 2013 20:18:59	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	51,840	84,206	1.6243
29 May 2013 16:25:54	1190093	15799611	hadcm3n_zip0_1920_40_008365944_4	25,920	42,201	1.6281