Task 15445924

Name	hadcm3n_z8pu_1880_40_008247992_1
Workunit	8403116
Created	21 Nov 2012, 11:08:40 UTC
Sent	21 Nov 2012, 11:08:44 UTC
Report deadline	20 Feb 2013, 18:35:55 UTC
Received	4 Feb 2013, 19:25:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1237376
Run time	21 days 5 hours 46 min 1 sec
CPU time	19 days 23 hours 32 min 8 sec
Validate state	Invalid
Credit	12,441.60
Device peak FLOPS	2.72 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:02:56 (5044): No heartbeat from core client for 30 sec - exiting 08:02:57 (5044): No heartbeat from core client for 30 sec - exiting 08:02:58 (5044): No heartbeat from core client for 30 sec - exiting 08:02:59 (5044): No heartbeat from core client for 30 sec - exiting 08:03:00 (5044): No heartbeat from core client for 30 sec - exiting 08:03:01 (5044): No heartbeat from core client for 30 sec - exiting 08:03:02 (5044): No heartbeat from core client for 30 sec - exiting 08:03:03 (5044): No heartbeat from core client for 30 sec - exiting 08:03:04 (5044): No heartbeat from core client for 30 sec - exiting 08:03:05 (5044): No heartbeat from core client for 30 sec - exiting 08:03:06 (5044): No heartbeat from core client for 30 sec - exiting 08:03:07 (5044): No heartbeat from core client for 30 sec - exiting 08:03:08 (5044): No heartbeat from core client for 30 sec - exiting 08:03:09 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:03:50 (4064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:19:40 (5116): No heartbeat from core client for 30 sec - exiting 16:19:41 (5116): No heartbeat from core client for 30 sec - exiting 16:19:42 (5116): No heartbeat from core client for 30 sec - exiting 16:19:43 (5116): No heartbeat from core client for 30 sec - exiting 16:19:44 (5116): No heartbeat from core client for 30 sec - exiting 16:19:45 (5116): No heartbeat from core client for 30 sec - exiting 16:19:46 (5116): No heartbeat from core client for 30 sec - exiting 16:19:47 (5116): No heartbeat from core client for 30 sec - exiting 16:19:48 (5116): No heartbeat from core client for 30 sec - exiting 16:19:49 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:44:04 (3820): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3620, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4888, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3816, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3680, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4800, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4016, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4188, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4624, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4072, iMonCtr=1 Model crash detected, will try to restart... 21:04:34 (3628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 05:50:20 (2924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:37:01 (3856): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Feb 2013 18:26:51	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	1,036,800	1,726,320	1.6650
03 Feb 2013 12:20:05	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	1,010,880	1,682,433	1.6643
02 Feb 2013 10:36:01	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	984,960	1,638,609	1.6636
31 Jan 2013 19:46:27	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	959,040	1,598,582	1.6669
28 Jan 2013 19:50:34	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	933,120	1,556,107	1.6676
25 Jan 2013 09:40:29	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	907,200	1,512,989	1.6678
23 Jan 2013 17:21:01	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	881,280	1,469,198	1.6671
22 Jan 2013 18:32:58	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	855,360	1,427,803	1.6692
21 Jan 2013 08:41:12	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	829,440	1,381,750	1.6659
19 Jan 2013 14:00:23	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	803,520	1,337,457	1.6645
18 Jan 2013 09:55:25	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	777,600	1,291,810	1.6613
17 Jan 2013 10:44:58	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	751,680	1,245,869	1.6574
15 Jan 2013 09:08:40	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	725,760	1,199,963	1.6534
11 Jan 2013 17:11:02	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	699,840	1,154,768	1.6500
10 Jan 2013 12:10:00	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	673,920	1,110,768	1.6482
06 Jan 2013 15:57:42	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	648,000	1,067,440	1.6473
04 Jan 2013 06:39:51	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	622,080	1,023,812	1.6458
02 Jan 2013 14:31:20	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	596,160	981,987	1.6472
30 Dec 2012 13:20:26	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	570,240	939,120	1.6469
27 Dec 2012 14:20:41	1237376	15445924	hadcm3n_z8pu_1880_40_008247992_1	544,320	897,641	1.6491