Task 13401054

Name	hadcm3n_o3ym_1940_40_007443467_3
Workunit	7640970
Created	19 Sep 2011, 15:10:18 UTC
Sent	19 Sep 2011, 15:19:44 UTC
Report deadline	19 Dec 2011, 22:46:55 UTC
Received	27 Nov 2011, 18:33:35 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	25 (0x00000019) Unknown error code
Computer ID	1069880
Run time	11 days 2 hours 17 min 36 sec
CPU time	11 days 2 hours 17 min 36 sec
Validate state	Invalid
Credit	6,842.88
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.10.18</core_client_version> <![CDATA[ <message> Das Laufwerk kann einen bestimmten Bereich oder eine bestimmte Spur nicht finden. (0x19) - exit code 25 (0x19) </message> <stderr_txt> 08:36:00 (3584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:47 (1072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4320, iMonCtr=1 Model crash detected, will try to restart... 09:16:48 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:24:03 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:04 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:51 (2552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:31 (5792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:59:01 (3652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:01:48 (4456): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 23:35:13 (4596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:36:13 (3216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:16 (4836): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:29:35 (4344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:30:50 (4480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:32:56 (4208): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:35:48 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:40:11 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:24:41 (932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:27 (4396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:22:54 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:25:00 (4788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:17:58 (4320): No heartbeat from core client for 30 sec - exiting 18:17:59 (4320): No heartbeat from core client for 30 sec - exiting 18:18:00 (4320): No heartbeat from core client for 30 sec - exiting 18:18:01 (4320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4912, iMonCtr=1 Model crash detected, will try to restart... 08:31:18 (4904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:08:32 (4828): No heartbeat from core client for 30 sec - exiting 10:08:33 (4828): No heartbeat from core client for 30 sec - exiting 10:08:34 (4828): No heartbeat from core client for 30 sec - exiting 10:08:36 (4828): No heartbeat from core client for 30 sec - exiting 10:08:37 (4828): No heartbeat from core client for 30 sec - exiting 10:08:38 (4828): No heartbeat from core client for 30 sec - exiting 10:08:39 (4828): No heartbeat from core client for 30 sec - exiting 10:08:40 (4828): No heartbeat from core client for 30 sec - exiting 10:08:41 (4828): No heartbeat from core client for 30 sec - exiting 10:08:42 (4828): No heartbeat from core client for 30 sec - exiting 10:08:43 (4828): No heartbeat from core client for 30 sec - exiting 10:08:44 (4828): No heartbeat from core client for 30 sec - exiting 10:08:45 (4828): No heartbeat from core client for 30 sec - exiting 10:08:46 (4828): No heartbeat from core client for 30 sec - exiting 10:08:48 (4828): No heartbeat from core client for 30 sec - exiting 10:08:49 (4828): No heartbeat from core client for 30 sec - exiting 10:08:50 (4828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:58:28 (4376): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:59:24 (4144): No heartbeat from core client for 30 sec - exiting 22:59:25 (4144): No heartbeat from core client for 30 sec - exiting 22:59:26 (4144): No heartbeat from core client for 30 sec - exiting 22:59:27 (4144): No heartbeat from core client for 30 sec - exiting 22:59:28 (4144): No heartbeat from core client for 30 sec - exiting 22:59:29 (4144): No heartbeat from core client for 30 sec - exiting 22:59:30 (4144): No heartbeat from core client for 30 sec - exiting 22:59:31 (4144): No heartbeat from core client for 30 sec - exiting 22:59:32 (4144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:55:59 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:51 (4972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:59:10 (4224): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:28:45 (4812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:35 (4468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:05:36 (4468): No heartbeat from core client for 30 sec - exiting 10:05:37 (4468): No heartbeat from core client for 30 sec - exiting 10:05:38 (4468): No heartbeat from core client for 30 sec - exiting 23:26:01 (4736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:25 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:56:52 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:56:53 (2920): No heartbeat from core client for 30 sec - exiting 15:56:54 (2920): No heartbeat from core client for 30 sec - exiting 15:56:55 (2920): No heartbeat from core client for 30 sec - exiting 15:56:56 (2920): No heartbeat from core client for 30 sec - exiting 15:56:57 (2920): No heartbeat from core client for 30 sec - exiting 15:56:58 (2920): No heartbeat from core client for 30 sec - exiting 15:56:59 (2920): No heartbeat from core client for 30 sec - exiting 15:57:01 (2920): No heartbeat from core client for 30 sec - exiting 15:57:02 (2920): No heartbeat from core client for 30 sec - exiting 15:57:03 (2920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:46:53 (4540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 11:53:45 (2812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:57 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:58:58 (5116): No heartbeat from core client for 30 sec - exiting 11:58:59 (5116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:00:03 (4704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:49 (4408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:36:13 (4528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:35:17 (4444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 10:42:11 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:23:19 (4796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:38:04 (3484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:58:51 (4996): No heartbeat from core client for 30 sec - exiting 18:58:52 (4996): No heartbeat from core client for 30 sec - exiting 18:58:53 (4996): No heartbeat from core client for 30 sec - exiting 18:58:55 (4996): No heartbeat from core client for 30 sec - exiting 18:58:56 (4996): No heartbeat from core client for 30 sec - exiting 18:58:57 (4996): No heartbeat from core client for 30 sec - exiting 18:58:58 (4996): No heartbeat from core client for 30 sec - exiting 18:58:59 (4996): No heartbeat from core client for 30 sec - exiting 18:59:00 (4996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:01 (4996): No heartbeat from core client for 30 sec - exiting 18:59:02 (4996): No heartbeat from core client for 30 sec - exiting 15:35:41 (5644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4824, iMonCtr=1 Model crash detected, will try to restart... 18:40:12 (1928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3568, iMonCtr=1 Model crash detected, will try to restart... 11:07:12 (4892): No heartbeat from core client for 30 sec - exiting 11:07:14 (4892): No heartbeat from core client for 30 sec - exiting 11:07:15 (4892): No heartbeat from core client for 30 sec - exiting 11:07:16 (4892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:13:41 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:31:41 (4308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:58:34 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:59:38 (4584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:58 (4824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... 11:49:42 (5032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:41:22 (3972): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:12:01 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=352, iMonCtr=1 Model crash detected, will try to restart... 10:16:03 (4776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:11:08 (4712): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2460, iMonCtr=1 Model crash detected, will try to restart... 13:00:00 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:01 (3188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:55 (3896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:27:34 (4604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:07:02 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:11:59 (920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:01 (920): No heartbeat from core client for 30 sec - exiting 18:12:02 (920): No heartbeat from core client for 30 sec - exiting 18:12:03 (920): No heartbeat from core client for 30 sec - exiting 18:12:04 (920): No heartbeat from core client for 30 sec - exiting 18:12:05 (920): No heartbeat from core client for 30 sec - exiting 18:12:06 (920): No heartbeat from core client for 30 sec - exiting 18:12:07 (920): No heartbeat from core client for 30 sec - exiting 18:12:08 (920): No heartbeat from core client for 30 sec - exiting 18:12:09 (920): No heartbeat from core client for 30 sec - exiting 18:12:10 (920): No heartbeat from core client for 30 sec - exiting 18:13:24 (3816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 18:16:59 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:09 (3440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:19:01 (4708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Nov 2011 16:39:36	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	570,240	952,439	1.6702
19 Nov 2011 13:30:00	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	544,320	909,977	1.6718
19 Nov 2011 09:13:46	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	518,400	866,125	1.6708
19 Nov 2011 09:13:46	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	492,480	821,320	1.6677
05 Nov 2011 20:43:27	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	466,560	775,296	1.6617
31 Oct 2011 18:33:54	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	440,640	727,028	1.6499
31 Oct 2011 18:09:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	414,720	679,954	1.6395
13 Oct 2011 19:36:32	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	388,800	632,313	1.6263
11 Oct 2011 17:33:07	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	362,880	584,088	1.6096
09 Oct 2011 16:49:17	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	336,960	535,226	1.5884
01 Oct 2011 18:17:31	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	311,040	486,750	1.5649
29 Sep 2011 20:13:56	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	285,120	440,106	1.5436
28 Sep 2011 14:24:53	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	259,200	393,246	1.5172
27 Sep 2011 13:57:04	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	233,280	345,901	1.4828
26 Sep 2011 10:30:49	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	207,360	299,949	1.4465
26 Sep 2011 09:15:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	181,440	269,282	1.4841
26 Sep 2011 09:15:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	155,520	238,712	1.5349
26 Sep 2011 09:15:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	129,600	205,705	1.5872
26 Sep 2011 09:15:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	103,680	171,512	1.6542
26 Sep 2011 09:15:05	1069880	13401054	hadcm3n_o3ym_1940_40_007443467_3	77,760	136,758	1.7587