Task 13288017

Name	hadcm3n_p2p0_1940_40_007420142_1
Workunit	7617777
Created	24 Aug 2011, 21:26:56 UTC
Sent	24 Aug 2011, 21:27:28 UTC
Report deadline	24 Nov 2011, 4:54:39 UTC
Received	6 Sep 2011, 12:41:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1160749
Run time	2 days 21 hours 19 min 4 sec
CPU time	2 days 21 hours 9 min 31 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 02:54:50 (7480): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on p2p0ko.dae4560 CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on p2p0ko.dae46j0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:29:10 (5216): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:34:51 (8468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:22:07 (8452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:16 (8452): No heartbeat from core client for 30 sec - exiting 07:22:18 (8452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on p2p0ko.dae62l0 Ocean Restart file copy failed on p2p0ko.dae62m0 CPDN Monitor - Quit request from BOINC... Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 07:37:43 (5372): No heartbeat from core client for 30 sec - exiting 07:37:44 (5372): No heartbeat from core client for 30 sec - exiting 07:37:45 (5372): No heartbeat from core client for 30 sec - exiting 07:37:46 (5372): No heartbeat from core client for 30 sec - exiting 07:37:47 (5372): No heartbeat from core client for 30 sec - exiting 07:37:48 (5372): No heartbeat from core client for 30 sec - exiting 07:37:49 (5372): No heartbeat from core client for 30 sec - exiting 07:37:50 (5372): No heartbeat from core client for 30 sec - exiting 07:37:52 (5372): No heartbeat from core client for 30 sec - exiting 07:37:53 (5372): No heartbeat from core client for 30 sec - exiting 07:37:54 (5372): No heartbeat from core client for 30 sec - exiting 07:37:55 (5372): No heartbeat from core client for 30 sec - exiting 07:37:56 (5372): No heartbeat from core client for 30 sec - exiting 07:37:57 (5372): No heartbeat from core client for 30 sec - exiting 07:37:58 (5372): No heartbeat from core client for 30 sec - exiting 07:37:59 (5372): No heartbeat from core client for 30 sec - exiting 07:38:00 (5372): No heartbeat from core client for 30 sec - exiting 07:38:01 (5372): No heartbeat from core client for 30 sec - exiting 07:38:02 (5372): No heartbeat from core client for 30 sec - exiting 07:38:04 (5372): No heartbeat from core client for 30 sec - exiting 07:38:05 (5372): No heartbeat from core client for 30 sec - exiting 07:38:06 (5372): No heartbeat from core client for 30 sec - exiting 07:38:07 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Atmos Hold Restart file rename failed on atmos_restart.hold Model crashed: U_MODEL: Illegal combination of submodels tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Sep 2011 09:36:13	1160749	13288017	hadcm3n_p2p0_1940_40_007420142_1	129,600	239,493	1.8479
05 Sep 2011 16:39:55	1160749	13288017	hadcm3n_p2p0_1940_40_007420142_1	103,680	192,741	1.8590
01 Sep 2011 03:28:50	1160749	13288017	hadcm3n_p2p0_1940_40_007420142_1	77,760	144,390	1.8569
31 Aug 2011 11:13:34	1160749	13288017	hadcm3n_p2p0_1940_40_007420142_1	51,840	95,850	1.8490
30 Aug 2011 13:54:43	1160749	13288017	hadcm3n_p2p0_1940_40_007420142_1	25,920	47,598	1.8363