climateprediction.net home page
Task 14650465

Task 14650465

Name hadcm3n_o13g_2060_40_007958002_0
Workunit 8113114
Created 9 May 2012, 16:51:21 UTC
Sent 9 May 2012, 17:08:23 UTC
Report deadline 9 Aug 2012, 0:35:34 UTC
Received 19 Jun 2012, 17:03:36 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1057729
Run time 8 days 21 hours 51 min 2 sec
CPU time 8 days 11 hours 23 min 15 sec
Validate state Invalid
Credit 4,976.64
Device peak FLOPS 2.52 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.25</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1
Model crash detected, will try to restart...
18:46:56 (4744): No heartbeat from core client for 30 sec - exiting
18:46:58 (4744): No heartbeat from core client for 30 sec - exiting
18:46:59 (4744): No heartbeat from core client for 30 sec - exiting
18:47:00 (4744): No heartbeat from core client for 30 sec - exiting
18:47:01 (4744): No heartbeat from core client for 30 sec - exiting
18:47:02 (4744): No heartbeat from core client for 30 sec - exiting
18:47:03 (4744): No heartbeat from core client for 30 sec - exiting
18:47:04 (4744): No heartbeat from core client for 30 sec - exiting
18:47:05 (4744): No heartbeat from core client for 30 sec - exiting
18:47:06 (4744): No heartbeat from core client for 30 sec - exiting
18:47:07 (4744): No heartbeat from core client for 30 sec - exiting
18:47:08 (4744): No heartbeat from core client for 30 sec - exiting
18:47:10 (4744): No heartbeat from core client for 30 sec - exiting
18:47:11 (4744): No heartbeat from core client for 30 sec - exiting
18:47:12 (4744): No heartbeat from core client for 30 sec - exiting
18:47:13 (4744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
10:11:27 (5240): No heartbeat from core client for 30 sec - exiting
10:11:28 (5240): No heartbeat from core client for 30 sec - exiting
10:11:29 (5240): No heartbeat from core client for 30 sec - exiting
10:11:31 (5240): No heartbeat from core client for 30 sec - exiting
10:11:32 (5240): No heartbeat from core client for 30 sec - exiting
10:11:33 (5240): No heartbeat from core client for 30 sec - exiting
10:11:34 (5240): No heartbeat from core client for 30 sec - exiting
10:11:35 (5240): No heartbeat from core client for 30 sec - exiting
10:11:36 (5240): No heartbeat from core client for 30 sec - exiting
10:11:37 (5240): No heartbeat from core client for 30 sec - exiting
10:11:38 (5240): No heartbeat from core client for 30 sec - exiting
10:11:39 (5240): No heartbeat from core client for 30 sec - exiting
10:11:40 (5240): No heartbeat from core client for 30 sec - exiting
10:11:41 (5240): No heartbeat from core client for 30 sec - exiting
10:11:43 (5240): No heartbeat from core client for 30 sec - exiting
10:11:44 (5240): No heartbeat from core client for 30 sec - exiting
10:11:45 (5240): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:13:37 (3496): No heartbeat from core client for 30 sec - exiting
15:13:38 (3496): No heartbeat from core client for 30 sec - exiting
15:13:39 (3496): No heartbeat from core client for 30 sec - exiting
15:13:40 (3496): No heartbeat from core client for 30 sec - exiting
15:13:41 (3496): No heartbeat from core client for 30 sec - exiting
15:13:42 (3496): No heartbeat from core client for 30 sec - exiting
15:13:44 (3496): No heartbeat from core client for 30 sec - exiting
15:13:45 (3496): No heartbeat from core client for 30 sec - exiting
15:13:46 (3496): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1
Model crash detected, will try to restart...
14:20:50 (5708): No heartbeat from core client for 30 sec - exiting
14:20:51 (5708): No heartbeat from core client for 30 sec - exiting
14:20:52 (5708): No heartbeat from core client for 30 sec - exiting
14:20:53 (5708): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:13:22 (5692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:14:11 (1132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4128, iMonCtr=1
Model crash detected, will try to restart...
14:47:27 (6416): No heartbeat from core client for 30 sec - exiting
14:47:28 (6416): No heartbeat from core client for 30 sec - exiting
14:47:29 (6416): No heartbeat from core client for 30 sec - exiting
14:47:30 (6416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1
Model crash detected, will try to restart...
14:57:06 (6652): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:30:40 (5092): No heartbeat from core client for 30 sec - exiting
08:30:41 (5092): No heartbeat from core client for 30 sec - exiting
08:30:42 (5092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:30:43 (5092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:02:40 (5924): No heartbeat from core client for 30 sec - exiting
20:02:41 (5924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 Jun 2012 16:17:13 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 414,720 695,310 1.6766
11 Jun 2012 15:27:03 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 388,800 648,870 1.6689
09 Jun 2012 10:33:33 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 362,880 601,706 1.6581
07 Jun 2012 07:48:20 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 336,960 552,561 1.6398
05 Jun 2012 21:11:41 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 311,040 504,024 1.6204
31 May 2012 17:26:21 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 285,120 460,169 1.6139
28 May 2012 21:34:52 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 259,200 419,977 1.6203
28 May 2012 12:44:35 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 233,280 386,069 1.6550
27 May 2012 17:47:59 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 207,360 353,836 1.7064
24 May 2012 18:41:50 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 181,440 317,439 1.7496
22 May 2012 19:13:45 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 155,520 276,963 1.7809
20 May 2012 19:18:09 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 129,600 231,450 1.7859
19 May 2012 14:31:29 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 103,680 185,527 1.7894
18 May 2012 20:03:20 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 77,760 139,324 1.7917
17 May 2012 15:34:39 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 51,840 93,007 1.7941
12 May 2012 20:52:26 1057729 14650465 hadcm3n_o13g_2060_40_007958002_0 25,920 46,445 1.7919


©2024 cpdn.org