Task 16232539

Name	hadcm3n_7lqx_1980_40_008439468_1
Workunit	8590324
Created	14 Jan 2014, 7:48:51 UTC
Sent	14 Jan 2014, 7:50:15 UTC
Report deadline	15 Apr 2014, 15:17:26 UTC
Received	27 Jan 2014, 10:25:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1255064
Run time	9 days 13 hours 28 min 41 sec
CPU time	9 days 3 hours 32 min 42 sec
Validate state	Invalid
Credit	5,287.68
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.33</core_client_version> <![CDATA[ <message> Das Gerät erkennt den Befehl nicht. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:35:23 (5720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:15 (7584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:16 (5632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:50:17 (5632): No heartbeat from core client for 30 sec - exiting 08:50:18 (5632): No heartbeat from core client for 30 sec - exiting 08:50:19 (5632): No heartbeat from core client for 30 sec - exiting 08:50:20 (5632): No heartbeat from core client for 30 sec - exiting 08:50:21 (5632): No heartbeat from core client for 30 sec - exiting 08:50:22 (5632): No heartbeat from core client for 30 sec - exiting 08:50:23 (5632): No heartbeat from core client for 30 sec - exiting 08:50:24 (5632): No heartbeat from core client for 30 sec - exiting 08:50:25 (5632): No heartbeat from core client for 30 sec - exiting 08:50:26 (5632): No heartbeat from core client for 30 sec - exiting 08:52:35 (8152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:36 (8152): No heartbeat from core client for 30 sec - exiting 08:52:37 (8152): No heartbeat from core client for 30 sec - exiting 08:52:38 (8152): No heartbeat from core client for 30 sec - exiting 08:52:39 (8152): No heartbeat from core client for 30 sec - exiting 08:52:40 (8152): No heartbeat from core client for 30 sec - exiting 08:52:41 (8152): No heartbeat from core client for 30 sec - exiting 08:52:42 (8152): No heartbeat from core client for 30 sec - exiting 08:52:43 (8152): No heartbeat from core client for 30 sec - exiting 08:54:04 (4592): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:05 (4592): No heartbeat from core client for 30 sec - exiting 08:54:06 (4592): No heartbeat from core client for 30 sec - exiting 08:54:07 (4592): No heartbeat from core client for 30 sec - exiting 08:54:08 (4592): No heartbeat from core client for 30 sec - exiting 08:54:09 (4592): No heartbeat from core client for 30 sec - exiting 08:54:10 (4592): No heartbeat from core client for 30 sec - exiting 08:54:11 (4592): No heartbeat from core client for 30 sec - exiting 08:54:12 (4592): No heartbeat from core client for 30 sec - exiting 08:54:13 (4592): No heartbeat from core client for 30 sec - exiting 08:54:14 (4592): No heartbeat from core client for 30 sec - exiting 09:04:27 (6944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:21 (7444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:22 (7444): No heartbeat from core client for 30 sec - exiting 09:06:23 (7444): No heartbeat from core client for 30 sec - exiting 09:06:24 (7444): No heartbeat from core client for 30 sec - exiting 09:06:25 (7444): No heartbeat from core client for 30 sec - exiting 09:06:26 (7444): No heartbeat from core client for 30 sec - exiting 09:06:27 (7444): No heartbeat from core client for 30 sec - exiting 09:06:28 (7444): No heartbeat from core client for 30 sec - exiting 09:06:29 (7444): No heartbeat from core client for 30 sec - exiting 09:06:30 (7444): No heartbeat from core client for 30 sec - exiting 09:06:31 (7444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:15:35 (2624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:37 (2624): No heartbeat from core client for 30 sec - exiting 18:15:57 (2624): No heartbeat from core client for 30 sec - exiting 18:20:47 (4856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:32:48 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:35:01 (6624): No heartbeat from core client for 30 sec - exiting 08:35:02 (6624): No heartbeat from core client for 30 sec - exiting 08:38:33 (7444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:17 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:26:42 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:52 (3152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:50 (7028): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 13:00:51 (7028): No heartbeat from core client for 30 sec - exiting 13:00:52 (7028): No heartbeat from core client for 30 sec - exiting 13:00:53 (7028): No heartbeat from core client for 30 sec - exiting 13:00:54 (7028): No heartbeat from core client for 30 sec - exiting 13:00:55 (7028): No heartbeat from core client for 30 sec - exiting 13:00:56 (7028): No heartbeat from core client for 30 sec - exiting 13:00:57 (7028): No heartbeat from core client for 30 sec - exiting 13:00:58 (7028): No heartbeat from core client for 30 sec - exiting 13:00:59 (7028): No heartbeat from core client for 30 sec - exiting 13:01:00 (7028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:07:09 (8004): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 15:07:10 (8004): No heartbeat from core client for 30 sec - exiting 15:07:11 (8004): No heartbeat from core client for 30 sec - exiting 15:07:12 (8004): No heartbeat from core client for 30 sec - exiting 15:07:13 (8004): No heartbeat from core client for 30 sec - exiting 15:07:14 (8004): No heartbeat from core client for 30 sec - exiting 15:07:15 (8004): No heartbeat from core client for 30 sec - exiting 15:07:16 (8004): No heartbeat from core client for 30 sec - exiting 15:07:17 (8004): No heartbeat from core client for 30 sec - exiting 15:07:18 (8004): No heartbeat from core client for 30 sec - exiting 15:07:19 (8004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:27:04 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:27 (7876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:05 (6880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:44:41 (7792): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:49:08 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:45 (6624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:28:59 (6768): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 12:29:00 (6768): No heartbeat from core client for 30 sec - exiting 12:29:01 (6768): No heartbeat from core client for 30 sec - exiting 12:29:02 (6768): No heartbeat from core client for 30 sec - exiting 12:29:03 (6768): No heartbeat from core client for 30 sec - exiting 12:29:04 (6768): No heartbeat from core client for 30 sec - exiting 12:29:05 (6768): No heartbeat from core client for 30 sec - exiting 12:29:06 (6768): No heartbeat from core client for 30 sec - exiting 12:29:07 (6768): No heartbeat from core client for 30 sec - exiting 12:29:08 (6768): No heartbeat from core client for 30 sec - exiting 12:29:09 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:13:31 (5376): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:04:34 (428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 11:04:35 (428): No heartbeat from core client for 30 sec - exiting 11:04:36 (428): No heartbeat from core client for 30 sec - exiting 11:04:37 (428): No heartbeat from core client for 30 sec - exiting 11:04:38 (428): No heartbeat from core client for 30 sec - exiting 11:04:39 (428): No heartbeat from core client for 30 sec - exiting 11:04:40 (428): No heartbeat from core client for 30 sec - exiting 11:04:41 (428): No heartbeat from core client for 30 sec - exiting 11:04:42 (428): No heartbeat from core client for 30 sec - exiting 11:04:43 (428): No heartbeat from core client for 30 sec - exiting 11:04:44 (428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:09:01 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:02 (7528): No heartbeat from core client for 30 sec - exiting 12:09:03 (7528): No heartbeat from core client for 30 sec - exiting 12:09:04 (7528): No heartbeat from core client for 30 sec - exiting 12:09:05 (7528): No heartbeat from core client for 30 sec - exiting 12:09:06 (7528): No heartbeat from core client for 30 sec - exiting 12:09:07 (7528): No heartbeat from core client for 30 sec - exiting 12:09:08 (7528): No heartbeat from core client for 30 sec - exiting 12:09:09 (7528): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:03:50 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:03:51 (5204): No heartbeat from core client for 30 sec - exiting 15:03:52 (5204): No heartbeat from core client for 30 sec - exiting 15:03:53 (5204): No heartbeat from core client for 30 sec - exiting 15:03:54 (5204): No heartbeat from core client for 30 sec - exiting 15:03:55 (5204): No heartbeat from core client for 30 sec - exiting 15:03:56 (5204): No heartbeat from core client for 30 sec - exiting 15:03:57 (5204): No heartbeat from core client for 30 sec - exiting 15:03:58 (5204): No heartbeat from core client for 30 sec - exiting 15:03:59 (5204): No heartbeat from core client for 30 sec - exiting 15:04:00 (5204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:03:36 (1408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:35:05 (1108): No heartbeat from core client for 30 sec - exiting 09:35:47 (1108): No heartbeat from core client for 30 sec - exiting 09:35:48 (1108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:35:49 (1108): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7436, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Jan 2014 20:15:12	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	440,640	751,653	1.7058
26 Jan 2014 06:56:44	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	414,720	706,435	1.7034
25 Jan 2014 16:42:47	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	388,800	660,672	1.6993
25 Jan 2014 03:11:09	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	362,880	615,434	1.6960
24 Jan 2014 12:57:42	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	336,960	572,412	1.6988
23 Jan 2014 10:05:33	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	311,040	528,745	1.6999
22 Jan 2014 08:33:23	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	285,120	484,799	1.7003
21 Jan 2014 07:39:42	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	259,200	442,772	1.7082
20 Jan 2014 02:54:05	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	233,280	397,238	1.7028
19 Jan 2014 13:51:21	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	207,360	351,984	1.6975
19 Jan 2014 11:40:46	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	181,440	306,786	1.6908
19 Jan 2014 11:40:46	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	155,520	261,756	1.6831
19 Jan 2014 11:40:46	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	129,600	216,484	1.6704
17 Jan 2014 06:01:31	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	103,680	174,126	1.6795
16 Jan 2014 15:40:23	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	77,760	129,413	1.6643
16 Jan 2014 07:58:18	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	51,840	87,087	1.6799
15 Jan 2014 08:08:45	1255064	16232539	hadcm3n_7lqx_1980_40_008439468_1	25,920	43,517	1.6789