Task 15635959

Name	hadcm3n_zfyl_1960_40_008320987_0
Workunit	8472122
Created	24 Feb 2013, 16:42:28 UTC
Sent	24 Feb 2013, 16:43:06 UTC
Report deadline	27 May 2013, 0:10:17 UTC
Received	28 Mar 2013, 9:58:48 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1267596
Run time	2 days 10 hours 57 min 36 sec
CPU time	1 days 19 hours 53 min 6 sec
Validate state	Invalid
Credit	622.08
Device peak FLOPS	2.74 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.8.44</core_client_version> <![CDATA[ <message> The device does not recognise the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:24:53 (384): No heartbeat from core client for 30 sec - exiting 19:24:54 (384): No heartbeat from core client for 30 sec - exiting 19:24:55 (384): No heartbeat from core client for 30 sec - exiting 19:24:56 (384): No heartbeat from core client for 30 sec - exiting 19:24:57 (384): No heartbeat from core client for 30 sec - exiting 19:24:58 (384): No heartbeat from core client for 30 sec - exiting 19:24:59 (384): No heartbeat from core client for 30 sec - exiting 19:25:00 (384): No heartbeat from core client for 30 sec - exiting 19:25:01 (384): No heartbeat from core client for 30 sec - exiting 19:25:02 (384): No heartbeat from core client for 30 sec - exiting 19:25:03 (384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:58:29 (10196): No heartbeat from core client for 30 sec - exiting 18:58:30 (10196): No heartbeat from core client for 30 sec - exiting 18:58:31 (10196): No heartbeat from core client for 30 sec - exiting 18:58:32 (10196): No heartbeat from core client for 30 sec - exiting 18:58:33 (10196): No heartbeat from core client for 30 sec - exiting 18:58:34 (10196): No heartbeat from core client for 30 sec - exiting 18:58:35 (10196): No heartbeat from core client for 30 sec - exiting 18:58:36 (10196): No heartbeat from core client for 30 sec - exiting 18:58:37 (10196): No heartbeat from core client for 30 sec - exiting 18:58:38 (10196): No heartbeat from core client for 30 sec - exiting 18:58:39 (10196): No heartbeat from core client for 30 sec - exiting 18:58:40 (10196): No heartbeat from core client for 30 sec - exiting 18:58:41 (10196): No heartbeat from core client for 30 sec - exiting 18:58:42 (10196): No heartbeat from core client for 30 sec - exiting 18:58:43 (10196): No heartbeat from core client for 30 sec - exiting 18:58:44 (10196): No heartbeat from core client for 30 sec - exiting 18:58:45 (10196): No heartbeat from core client for 30 sec - exiting 18:58:46 (10196): No heartbeat from core client for 30 sec - exiting 18:58:47 (10196): No heartbeat from core client for 30 sec - exiting 18:58:48 (10196): No heartbeat from core client for 30 sec - exiting 18:58:49 (10196): No heartbeat from core client for 30 sec - exiting 18:58:50 (10196): No heartbeat from core client for 30 sec - exiting 18:58:51 (10196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:40:31 (60): No heartbeat from core client for 30 sec - exiting 14:40:32 (60): No heartbeat from core client for 30 sec - exiting 14:40:33 (60): No heartbeat from core client for 30 sec - exiting 14:40:34 (60): No heartbeat from core client for 30 sec - exiting 14:40:35 (60): No heartbeat from core client for 30 sec - exiting 14:40:36 (60): No heartbeat from core client for 30 sec - exiting 14:40:37 (60): No heartbeat from core client for 30 sec - exiting 14:40:38 (60): No heartbeat from core client for 30 sec - exiting 14:40:39 (60): No heartbeat from core client for 30 sec - exiting 14:40:40 (60): No heartbeat from core client for 30 sec - exiting 14:40:41 (60): No heartbeat from core client for 30 sec - exiting 14:40:42 (60): No heartbeat from core client for 30 sec - exiting 14:40:43 (60): No heartbeat from core client for 30 sec - exiting 14:40:44 (60): No heartbeat from core client for 30 sec - exiting 14:40:45 (60): No heartbeat from core client for 30 sec - exiting 14:40:46 (60): No heartbeat from core client for 30 sec - exiting 14:40:47 (60): No heartbeat from core client for 30 sec - exiting 14:40:48 (60): No heartbeat from core client for 30 sec - exiting 14:40:49 (60): No heartbeat from core client for 30 sec - exiting 14:40:50 (60): No heartbeat from core client for 30 sec - exiting 14:40:51 (60): No heartbeat from core client for 30 sec - exiting 14:40:52 (60): No heartbeat from core client for 30 sec - exiting 14:40:53 (60): No heartbeat from core client for 30 sec - exiting 14:40:54 (60): No heartbeat from core client for 30 sec - exiting 14:40:55 (60): No heartbeat from core client for 30 sec - exiting 14:40:56 (60): No heartbeat from core client for 30 sec - exiting 14:40:57 (60): No heartbeat from core client for 30 sec - exiting 14:40:58 (60): No heartbeat from core client for 30 sec - exiting 14:40:59 (60): No heartbeat from core client for 30 sec - exiting 14:41:00 (60): No heartbeat from core client for 30 sec - exiting 14:41:01 (60): No heartbeat from core client for 30 sec - exiting 14:41:02 (60): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:59:23 (4560): No heartbeat from core client for 30 sec - exiting 15:59:24 (4560): No heartbeat from core client for 30 sec - exiting 15:59:25 (4560): No heartbeat from core client for 30 sec - exiting 15:59:26 (4560): No heartbeat from core client for 30 sec - exiting 15:59:27 (4560): No heartbeat from core client for 30 sec - exiting 15:59:28 (4560): No heartbeat from core client for 30 sec - exiting 15:59:29 (4560): No heartbeat from core client for 30 sec - exiting 15:59:30 (4560): No heartbeat from core client for 30 sec - exiting 15:59:31 (4560): No heartbeat from core client for 30 sec - exiting 15:59:32 (4560): No heartbeat from core client for 30 sec - exiting 15:59:33 (4560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:19:14 (9160): No heartbeat from core client for 30 sec - exiting 08:19:15 (9160): No heartbeat from core client for 30 sec - exiting 08:19:16 (9160): No heartbeat from core client for 30 sec - exiting 08:19:17 (9160): No heartbeat from core client for 30 sec - exiting 08:19:18 (9160): No heartbeat from core client for 30 sec - exiting 08:19:19 (9160): No heartbeat from core client for 30 sec - exiting 08:19:20 (9160): No heartbeat from core client for 30 sec - exiting 08:19:21 (9160): No heartbeat from core client for 30 sec - exiting 08:19:22 (9160): No heartbeat from core client for 30 sec - exiting 08:19:23 (9160): No heartbeat from core client for 30 sec - exiting 08:19:24 (9160): No heartbeat from core client for 30 sec - exiting 08:19:25 (9160): No heartbeat from core client for 30 sec - exiting 08:19:26 (9160): No heartbeat from core client for 30 sec - exiting 08:19:27 (9160): No heartbeat from core client for 30 sec - exiting 08:19:28 (9160): No heartbeat from core client for 30 sec - exiting 08:19:29 (9160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6664, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Mar 2013 22:10:10	1267596	15635959	hadcm3n_zfyl_1960_40_008320987_0	51,840	108,310	2.0893
20 Mar 2013 05:51:19	1267596	15635959	hadcm3n_zfyl_1960_40_008320987_0	25,920	55,354	2.1356