Task 15868235

Name	hadcm3n_zn2g_1920_40_008361716_2
Workunit	8512575
Created	26 Jun 2013, 21:17:36 UTC
Sent	26 Jun 2013, 22:08:24 UTC
Report deadline	26 Sep 2013, 5:35:35 UTC
Received	10 Jul 2013, 9:23:36 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	1 (0x00000001) Unknown error code
Computer ID	1217936
Run time	11 days 7 hours 16 min 43 sec
CPU time	8 days 17 hours 42 min 51 sec
Validate state	Invalid
Credit	4,976.64
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.64</core_client_version> <![CDATA[ <message> Incorrect function. (0x1) - exit code 1 (0x1) </message> <stderr_txt> Ocean Restart file copy failed on zn2gko.dac1310 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Ocean Restart file copy failed on zn2gko.dac5bm0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:57:48 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:49 (6572): No heartbeat from core client for 30 sec - exiting 21:57:50 (6572): No heartbeat from core client for 30 sec - exiting 21:57:51 (6572): No heartbeat from core client for 30 sec - exiting 21:57:52 (6572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7976, iMonCtr=1 Model crash detected, will try to restart... 10:38:10 (3928): No heartbeat from core client for 30 sec - exiting 10:38:11 (3928): No heartbeat from core client for 30 sec - exiting 10:38:12 (3928): No heartbeat from core client for 30 sec - exiting 10:38:13 (3928): No heartbeat from core client for 30 sec - exiting 10:38:14 (3928): No heartbeat from core client for 30 sec - exiting 10:38:15 (3928): No heartbeat from core client for 30 sec - exiting 10:38:16 (3928): No heartbeat from core client for 30 sec - exiting 10:38:17 (3928): No heartbeat from core client for 30 sec - exiting 10:38:18 (3928): No heartbeat from core client for 30 sec - exiting 10:38:19 (3928): No heartbeat from core client for 30 sec - exiting 10:38:20 (3928): No heartbeat from core client for 30 sec - exiting 10:38:21 (3928): No heartbeat from core client for 30 sec - exiting 10:38:22 (3928): No heartbeat from core client for 30 sec - exiting 10:38:23 (3928): No heartbeat from core client for 30 sec - exiting 10:38:24 (3928): No heartbeat from core client for 30 sec - exiting 10:38:25 (3928): No heartbeat from core client for 30 sec - exiting 10:38:26 (3928): No heartbeat from core client for 30 sec - exiting 10:38:27 (3928): No heartbeat from core client for 30 sec - exiting 10:38:28 (3928): No heartbeat from core client for 30 sec - exiting 10:38:29 (3928): No heartbeat from core client for 30 sec - exiting 10:38:30 (3928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:38:31 (3928): No heartbeat from core client for 30 sec - exiting Ocean Restart file copy failed on zn2gko.dad3310 CPDN Monitor - Quit request from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3612, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2013 14:08:50	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	414,720	742,924	1.7914
08 Jul 2013 21:09:48	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	388,800	693,526	1.7838
08 Jul 2013 04:31:23	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	362,880	645,062	1.7776
07 Jul 2013 18:07:01	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	336,960	596,724	1.7709
06 Jul 2013 12:48:41	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	311,040	548,519	1.7635
06 Jul 2013 05:10:52	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	285,120	530,740	1.8615
04 Jul 2013 14:28:19	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	259,200	481,587	1.8580
03 Jul 2013 15:54:03	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	233,280	433,505	1.8583
02 Jul 2013 21:57:53	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	207,360	385,219	1.8577
02 Jul 2013 11:58:25	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	181,440	337,456	1.8599
02 Jul 2013 11:11:37	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	155,520	289,731	1.8630
02 Jul 2013 10:40:33	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	129,600	241,310	1.8620
02 Jul 2013 10:16:28	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	103,680	192,469	1.8564
02 Jul 2013 09:54:41	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	77,760	144,185	1.8542
28 Jun 2013 10:34:17	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	51,840	96,825	1.8678
27 Jun 2013 13:25:57	1217936	15868235	hadcm3n_zn2g_1920_40_008361716_2	25,920	48,260	1.8619