Task 16068164

Name	hadcm3n_ocds_1900_40_008471171_1
Workunit	8622010
Created	15 Oct 2013, 21:25:22 UTC
Sent	15 Oct 2013, 21:26:05 UTC
Report deadline	15 Jan 2014, 4:53:16 UTC
Received	28 Dec 2013, 10:01:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1168291
Run time	42 days 10 hours 57 min 40 sec
CPU time	38 days 6 hours 23 min 33 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	1.92 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 20:19:11 (5908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:04:45 (5444): No heartbeat from core client for 30 sec - exiting 19:04:46 (5444): No heartbeat from core client for 30 sec - exiting 19:04:47 (5444): No heartbeat from core client for 30 sec - exiting 19:04:49 (5444): No heartbeat from core client for 30 sec - exiting 19:04:50 (5444): No heartbeat from core client for 30 sec - exiting 19:04:51 (5444): No heartbeat from core client for 30 sec - exiting 19:04:52 (5444): No heartbeat from core client for 30 sec - exiting 19:04:53 (5444): No heartbeat from core client for 30 sec - exiting 19:04:54 (5444): No heartbeat from core client for 30 sec - exiting 19:04:55 (5444): No heartbeat from core client for 30 sec - exiting 19:04:56 (5444): No heartbeat from core client for 30 sec - exiting 19:04:57 (5444): No heartbeat from core client for 30 sec - exiting 19:04:58 (5444): No heartbeat from core client for 30 sec - exiting 19:04:59 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:08:16 (5412): No heartbeat from core client for 30 sec - exiting 19:08:17 (5412): No heartbeat from core client for 30 sec - exiting 19:08:19 (5412): No heartbeat from core client for 30 sec - exiting 19:08:20 (5412): No heartbeat from core client for 30 sec - exiting 19:08:21 (5412): No heartbeat from core client for 30 sec - exiting 19:08:22 (5412): No heartbeat from core client for 30 sec - exiting 19:08:23 (5412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:36:48 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:59:19 (756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:53:41 (5640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 19:19:52 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:21 (4488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:58 (3344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:41:08 (5248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:14:54 (4948): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:25:40 (504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:04:57 (448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:14:53 (4212): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:40:42 (3408): No heartbeat from core client for 30 sec - exiting 03:40:43 (3408): No heartbeat from core client for 30 sec - exiting 03:40:44 (3408): No heartbeat from core client for 30 sec - exiting 03:40:45 (3408): No heartbeat from core client for 30 sec - exiting 03:40:46 (3408): No heartbeat from core client for 30 sec - exiting 03:40:47 (3408): No heartbeat from core client for 30 sec - exiting 03:40:48 (3408): No heartbeat from core client for 30 sec - exiting 03:40:49 (3408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 04:30:29 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1152, iMonCtr=1 Model crash de19:58:25 (5012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:05:22 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3140, iMonCtr=1 Model crash detected, will try to restart... 18:46:33 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... C21:41:32 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:56:53 (5184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5008, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... 00:20:32 (4612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:57:00 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2013 09:00:38	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	1,036,800	3,306,207	3.1889
26 Dec 2013 18:53:18	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	1,010,880	3,220,747	3.1861
25 Dec 2013 02:49:13	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	984,960	3,128,876	3.1767
22 Dec 2013 11:50:16	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	959,040	3,043,439	3.1734
21 Dec 2013 02:49:52	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	933,120	2,958,825	3.1709
18 Dec 2013 06:11:15	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	907,200	2,873,951	3.1679
16 Dec 2013 03:57:15	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	881,280	2,788,165	3.1638
14 Dec 2013 23:38:53	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	855,360	2,699,317	3.1558
13 Dec 2013 20:01:26	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	829,440	2,612,330	3.1495
11 Dec 2013 04:41:43	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	803,520	2,531,969	3.1511
09 Dec 2013 03:43:04	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	777,600	2,453,534	3.1553
08 Dec 2013 00:46:12	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	751,680	2,367,135	3.1491
07 Dec 2013 00:58:06	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	725,760	2,287,138	3.1514
05 Dec 2013 02:45:49	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	699,840	2,207,656	3.1545
02 Dec 2013 23:31:40	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	673,920	2,127,385	3.1567
01 Dec 2013 04:17:38	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	648,000	2,047,993	3.1605
29 Nov 2013 19:46:22	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	622,080	1,965,646	3.1598
27 Nov 2013 01:49:02	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	596,160	1,883,529	3.1594
24 Nov 2013 22:40:45	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	570,240	1,799,609	3.1559
23 Nov 2013 21:24:02	1168291	16068164	hadcm3n_ocds_1900_40_008471171_1	544,320	1,719,360	3.1587