Task 13291528

Name	hadcm3n_p6x9_1940_40_007421568_1
Workunit	7619203
Created	25 Aug 2011, 2:43:21 UTC
Sent	25 Aug 2011, 2:46:54 UTC
Report deadline	24 Nov 2011, 10:14:05 UTC
Received	22 Sep 2011, 7:14:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1161298
Run time	16 days 17 hours 17 min 9 sec
CPU time	16 days 3 hours 24 min 43 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.56 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> La periferica non riconosce il comando. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:26:18 (2904): No heartbeat from core client for 30 sec - exiting 13:26:19 (2904): No heartbeat from core client for 30 sec - exiting 13:26:20 (2904): No heartbeat from core client for 30 sec - exiting 13:26:22 (2904): No heartbeat from core client for 30 sec - exiting 13:26:23 (2904): No heartbeat from core client for 30 sec - exiting 13:26:24 (2904): No heartbeat from core client for 30 sec - exiting 13:26:25 (2904): No heartbeat from core client for 30 sec - exiting 13:26:26 (2904): No heartbeat from core client for 30 sec - exiting 13:26:27 (2904): No heartbeat from core client for 30 sec - exiting 13:26:28 (2904): No heartbeat from core client for 30 sec - exiting 13:26:29 (2904): No heartbeat from core client for 30 sec - exiting 13:26:30 (2904): No heartbeat from core client for 30 sec - exiting 13:26:31 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:26:33 (2904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:52:59 (2856): No heartbeat from core client for 30 sec - exiting 01:53:00 (2856): No heartbeat from core client for 30 sec - exiting 01:53:01 (2856): No heartbeat from core client for 30 sec - exiting 01:53:02 (2856): No heartbeat from core client for 30 sec - exiting 01:53:03 (2856): No heartbeat from core client for 30 sec - exiting 01:53:04 (2856): No heartbeat from core client for 30 sec - exiting 01:53:05 (2856): No heartbeat from core client for 30 sec - exiting 01:53:06 (2856): No heartbeat from core client for 30 sec - exiting 01:53:08 (2856): No heartbeat from core client for 30 sec - exiting 01:53:09 (2856): No heartbeat from core client for 30 sec - exiting 01:53:10 (2856): No heartbeat from core client for 30 sec - exiting 01:53:11 (2856): No heartbeat from core client for 30 sec - exiting 01:53:12 (2856): No heartbeat from core client for 30 sec - exiting 01:53:13 (2856): No heartbeat from core client for 30 sec - exiting 01:53:14 (2856): No heartbeat from core client for 30 sec - exiting 01:53:15 (2856): No heartbeat from core client for 30 sec - exiting 01:53:16 (2856): No heartbeat from core client for 30 sec - exiting 01:53:17 (2856): No heartbeat from core client for 30 sec - exiting 01:53:18 (2856): No heartbeat from core client for 30 sec - exiting 01:53:20 (2856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:53:21 (2856): No heartbeat from core client for 30 sec - exiting 02:07:36 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:26:32 (2720): No heartbeat from core client for 30 sec - exiting 02:26:34 (2720): No heartbeat from core client for 30 sec - exiting 02:26:35 (2720): No heartbeat from core client for 30 sec - exiting 02:26:36 (2720): No heartbeat from core client for 30 sec - exiting 02:26:37 (2720): No heartbeat from core client for 30 sec - exiting 02:26:38 (2720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:10:47 (2892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:21:36 (3588): No heartbeat from core client for 30 sec - exiting 02:21:37 (3588): No heartbeat from core client for 30 sec - exiting 02:21:38 (3588): No heartbeat from core client for 30 sec - exiting 02:21:39 (3588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:29:04 (2912): No heartbeat from core client for 30 sec - exiting 05:29:05 (2912): No heartbeat from core client for 30 sec - exiting 05:29:07 (2912): No heartbeat from core client for 30 sec - exiting 05:29:08 (2912): No heartbeat from core client for 30 sec - exiting 05:29:09 (2912): No heartbeat from core client for 30 sec - exiting 05:29:10 (2912): No heartbeat from core client for 30 sec - exiting 05:29:11 (2912): No heartbeat from core client for 30 sec - exiting 05:29:12 (2912): No heartbeat from core client for 30 sec - exiting 05:29:13 (2912): No heartbeat from core client for 30 sec - exiting 05:29:14 (2912): No heartbeat from core client for 30 sec - exiting 05:29:15 (2912): No heartbeat from core client for 30 sec - exiting 05:29:16 (2912): No heartbeat from core client for 30 sec - exiting 05:29:17 (2912): No heartbeat from core client for 30 sec - exiting 05:29:19 (2912): No heartbeat from core client for 30 sec - exiting 05:29:20 (2912): No heartbeat from core client for 30 sec - exiting 05:29:21 (2912): No heartbeat from core client for 30 sec - exiting 05:29:22 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 10:44:47 (2692): No heartbeat from core client for 30 sec - exiting 10:44:48 (2692): No heartbeat from core client for 30 sec - exiting 10:44:49 (2692): No heartbeat from core client for 30 sec - exiting 10:44:51 (2692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... 02:30:42 (2724): No heartbeat from core client for 30 sec - exiting 02:30:43 (2724): No heartbeat from core client for 30 sec - exiting 02:30:44 (2724): No heartbeat from core client for 30 sec - exiting 02:30:45 (2724): No heartbeat from core client for 30 sec - exiting 02:30:47 (2724): No heartbeat from core client for 30 sec - exiting 02:30:48 (2724): No heartbeat from core client for 30 sec - exiting 02:30:49 (2724): No heartbeat from core client for 30 sec - exiting 02:30:50 (2724): No heartbeat from core client for 30 sec - exiting 02:30:51 (2724): No heartbeat from core client for 30 sec - exiting 02:30:52 (2724): No heartbeat from core client for 30 sec - exiting 02:30:53 (2724): No heartbeat from core client for 30 sec - exiting 02:30:54 (2724): No heartbeat from core client for 30 sec - exiting 02:30:55 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:30:56 (2724): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 06:09:45 (2688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2968, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Sep 2011 07:11:39	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	518,400	1,386,152	2.6739
21 Sep 2011 05:44:36	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	492,480	1,315,402	2.6710
20 Sep 2011 00:31:37	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	466,560	1,245,981	2.6706
17 Sep 2011 00:31:06	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	440,640	1,176,955	2.6710
16 Sep 2011 00:49:48	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	414,720	1,107,482	2.6704
15 Sep 2011 04:59:12	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	388,800	1,037,795	2.6692
14 Sep 2011 08:47:50	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	362,880	967,718	2.6668
14 Sep 2011 00:28:30	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	336,960	898,100	2.6653
13 Sep 2011 00:27:01	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	311,040	828,539	2.6638
12 Sep 2011 00:19:15	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	285,120	758,059	2.6587
12 Sep 2011 00:19:15	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	259,200	687,470	2.6523
10 Sep 2011 00:27:37	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	233,280	617,816	2.6484
08 Sep 2011 23:47:57	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	207,360	548,192	2.6437
07 Sep 2011 00:26:34	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	181,440	478,297	2.6361
06 Sep 2011 03:57:35	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	155,520	408,147	2.6244
05 Sep 2011 07:53:57	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	129,600	336,648	2.5976
03 Sep 2011 00:29:02	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	103,680	267,129	2.5765
01 Sep 2011 10:18:44	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	77,760	197,232	2.5364
01 Sep 2011 00:28:45	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	51,840	131,306	2.5329
31 Aug 2011 00:24:07	1161298	13291528	hadcm3n_p6x9_1940_40_007421568_1	25,920	65,110	2.5120