climateprediction.net home page
Task 15686826

Task 15686826

Name hadcm3n_o4fj_2060_40_008270680_3
Workunit 8425804
Created 27 Mar 2013, 12:20:02 UTC
Sent 27 Mar 2013, 12:20:10 UTC
Report deadline 26 Jun 2013, 19:47:21 UTC
Received 6 Apr 2013, 0:58:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1270025
Run time 9 days 5 hours 32 min 51 sec
CPU time 8 days 5 hours 21 min 6 sec
Validate state Invalid
Credit 5,287.68
Device peak FLOPS 3.25 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
23:50:08 (12428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:50:59 (15856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:52:03 (16144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:58:43 (11448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
00:05:51 (13388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:06:37 (15896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:07:09 (10232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:08:13 (4648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:40:09 (16056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:40:10 (16056): No heartbeat from core client for 30 sec - exiting
14:40:11 (16056): No heartbeat from core client for 30 sec - exiting
14:40:12 (16056): No heartbeat from core client for 30 sec - exiting
14:40:13 (16056): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Ocean Restart file copy failed on o4fjko.dar0c20
Suspended CPDN Monitor - Suspend request from BOINC...
17:32:10 (11808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:32:11 (11808): No heartbeat from core client for 30 sec - exiting
17:32:56 (22260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:34:49 (5932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:03:52 (8876): No heartbeat from core client for 30 sec - exiting
23:03:54 (8876): No heartbeat from core client for 30 sec - exiting
23:03:55 (8876): No heartbeat from core client for 30 sec - exiting
23:03:56 (8876): No heartbeat from core client for 30 sec - exiting
23:03:57 (8876): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:58:50 (3196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:46:36 (20624): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:47:09 (28852): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:54:50 (36592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:08:12 (3388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
15:09:02 (9204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Atmos Hold Restart file rename failed on atmos_restart.hold

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Apr 2013 12:56:32 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 440,640 690,916 1.5680
05 Apr 2013 02:42:19 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 414,720 652,857 1.5742
04 Apr 2013 14:45:32 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 388,800 614,812 1.5813
04 Apr 2013 02:33:19 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 362,880 577,513 1.5915
03 Apr 2013 13:07:18 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 336,960 535,545 1.5893
02 Apr 2013 22:51:31 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 311,040 493,486 1.5866
02 Apr 2013 09:38:55 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 285,120 451,178 1.5824
01 Apr 2013 20:17:53 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 259,200 410,002 1.5818
01 Apr 2013 07:39:04 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 233,280 366,397 1.5706
31 Mar 2013 16:21:01 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 207,360 322,291 1.5543
31 Mar 2013 03:02:39 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 181,440 279,920 1.5428
30 Mar 2013 14:15:22 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 155,520 237,268 1.5256
30 Mar 2013 00:31:37 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 129,600 194,497 1.5007
29 Mar 2013 11:42:01 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 103,680 152,612 1.4720
29 Mar 2013 00:01:14 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 77,760 113,696 1.4621
28 Mar 2013 12:35:34 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 51,840 75,094 1.4486
27 Mar 2013 23:40:23 1270025 15686826 hadcm3n_o4fj_2060_40_008270680_3 25,920 37,161 1.4337


©2024 cpdn.org