climateprediction.net home page
Task 15592045

Task 15592045

Name hadcm3n_48e3_1940_40_008305853_0
Workunit 8456988
Created 7 Feb 2013, 7:41:15 UTC
Sent 7 Feb 2013, 7:46:55 UTC
Report deadline 9 May 2013, 15:14:06 UTC
Received 6 Apr 2013, 16:14:49 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1253035
Run time 38 days 14 hours 3 min 30 sec
CPU time 36 days 18 hours 37 min 17 sec
Validate state Invalid
Credit 9,642.24
Device peak FLOPS 1.21 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:42:01 (3484): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:40:06 (2056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:39:06 (3248): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:27:15 (4312): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
00:38:04 (4120): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:07:45 (3248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:08:06 (604): Can't acquire lockfile (32) - waiting 35s
Suspended CPDN Monitor - Suspend request from BOINC...
14:35:58 (604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:34:54 (3076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:33:55 (5060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
21:28:22 (1704): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:31:57 (4640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
13:30:56 (5044): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:29:56 (3808): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:45:01 (3036): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:45:02 (3036): No heartbeat from core client for 30 sec - exiting
02:45:03 (3036): No heartbeat from core client for 30 sec - exiting
02:45:04 (3036): No heartbeat from core client for 30 sec - exiting
02:45:05 (3036): No heartbeat from core client for 30 sec - exiting
02:45:06 (3036): No heartbeat from core client for 30 sec - exiting
02:45:07 (3036): No heartbeat from core client for 30 sec - exiting
02:45:08 (3036): No heartbeat from core client for 30 sec - exiting
02:45:09 (3036): No heartbeat from core client for 30 sec - exiting
02:45:10 (3036): No heartbeat from core client for 30 sec - exiting
02:45:11 (3036): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
14:27:47 (4088): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
13:13:25 (2276): No heartbeat from core client for 30 sec - exiting
13:13:26 (2276): No heartbeat from core client for 30 sec - exiting
13:13:27 (2276): No heartbeat from core client for 30 sec - exiting
13:13:28 (2276): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:13:30 (2276): No heartbeat from core client for 30 sec - exiting
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/48e3ko.pjf6c10
Error converting file to netcdf: dataout/48e3ko.pif6c10
Error converting file to netcdf: dataout/48e3ko.pff6c10
Error converting file to netcdf: dataout/48e3ka.phf6c10
Error converting file to netcdf: dataout/48e3ka.pgf6c10
Error converting file to netcdf: dataout/48e3ka.pef6c10
Error converting file to netcdf: dataout/48e3ka.pdf6c10
23:04:18 (3560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:04:19 (3560): No heartbeat from core client for 30 sec - exiting
23:04:20 (3560): No heartbeat from core client for 30 sec - exiting
23:04:21 (3560): No heartbeat from core client for 30 sec - exiting
23:04:22 (3560): No heartbeat from core client for 30 sec - exiting
23:04:23 (3560): No heartbeat from core client for 30 sec - exiting
23:04:24 (3560): No heartbeat from core client for 30 sec - exiting
23:04:25 (3560): No heartbeat from core client for 30 sec - exiting
23:04:26 (3560): No heartbeat from core client for 30 sec - exiting
23:04:27 (3560): No heartbeat from core client for 30 sec - exiting
23:04:28 (3560): No heartbeat from core client for 30 sec - exiting
23:06:19 (4040): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Atmos Hold Restart file rename failed on atmos_restart.hold
22:09:44 (3556): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:11:37 (3932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:10:34 (2596): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:09:36 (4060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:08:46 (1172): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:06:18 (1144): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:05:15 (3292): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
04:04:14 (3140): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:02:33 (3736): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:01:31 (1068): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:00:31 (3412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:58:34 (1920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
07:57:31 (2568): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:56:24 (2516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:02 (2640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Apr 2013 19:50:22 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 803,520 3,190,195 3.9703
03 Apr 2013 11:41:42 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 777,600 3,077,303 3.9574
01 Apr 2013 16:51:27 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 751,680 2,968,084 3.9486
31 Mar 2013 01:27:10 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 725,760 2,859,305 3.9397
27 Mar 2013 02:45:07 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 699,840 2,749,164 3.9283
23 Mar 2013 11:54:30 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 673,920 2,639,532 3.9167
20 Mar 2013 23:26:35 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 648,000 2,529,994 3.9043
19 Mar 2013 14:56:46 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 622,080 2,420,130 3.8904
18 Mar 2013 07:28:20 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 596,160 2,310,749 3.8761
16 Mar 2013 23:41:44 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 570,240 2,202,219 3.8619
15 Mar 2013 14:20:18 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 544,320 2,090,841 3.8412
14 Mar 2013 05:38:57 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 518,400 1,979,297 3.8181
12 Mar 2013 21:25:35 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 492,480 1,868,476 3.7940
11 Mar 2013 13:25:11 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 466,560 1,758,751 3.7696
10 Mar 2013 05:25:42 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 440,640 1,648,912 3.7421
08 Mar 2013 21:18:42 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 414,720 1,539,735 3.7127
07 Mar 2013 12:22:03 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 388,800 1,429,634 3.6770
05 Mar 2013 16:45:50 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 362,880 1,332,508 3.6720
03 Mar 2013 16:40:58 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 336,960 1,238,801 3.6764
01 Mar 2013 10:07:47 1253035 15592045 hadcm3n_48e3_1940_40_008305853_0 311,040 1,145,990 3.6844


©2024 cpdn.org