Name | hadcm3n_48e3_1940_40_008305853_0 |
Workunit | 8456988 |
Created | 7 Feb 2013, 7:41:15 UTC |
Sent | 7 Feb 2013, 7:46:55 UTC |
Report deadline | 9 May 2013, 15:14:06 UTC |
Received | 6 Apr 2013, 16:14:49 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1253035 |
Run time | 38 days 14 hours 3 min 30 sec |
CPU time | 36 days 18 hours 37 min 17 sec |
Validate state | Invalid |
Credit | 9,642.24 |
Device peak FLOPS | 1.21 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:42:01 (3484): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:40:06 (2056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:39:06 (3248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:27:15 (4312): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 00:38:04 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:07:45 (3248): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:08:06 (604): Can't acquire lockfile (32) - waiting 35s Suspended CPDN Monitor - Suspend request from BOINC... 14:35:58 (604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:34:54 (3076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:33:55 (5060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:28:22 (1704): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:31:57 (4640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:30:56 (5044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:29:56 (3808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:45:01 (3036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:45:02 (3036): No heartbeat from core client for 30 sec - exiting 02:45:03 (3036): No heartbeat from core client for 30 sec - exiting 02:45:04 (3036): No heartbeat from core client for 30 sec - exiting 02:45:05 (3036): No heartbeat from core client for 30 sec - exiting 02:45:06 (3036): No heartbeat from core client for 30 sec - exiting 02:45:07 (3036): No heartbeat from core client for 30 sec - exiting 02:45:08 (3036): No heartbeat from core client for 30 sec - exiting 02:45:09 (3036): No heartbeat from core client for 30 sec - exiting 02:45:10 (3036): No heartbeat from core client for 30 sec - exiting 02:45:11 (3036): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 14:27:47 (4088): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 13:13:25 (2276): No heartbeat from core client for 30 sec - exiting 13:13:26 (2276): No heartbeat from core client for 30 sec - exiting 13:13:27 (2276): No heartbeat from core client for 30 sec - exiting 13:13:28 (2276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:30 (2276): No heartbeat from core client for 30 sec - exiting BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/48e3ko.pjf6c10 Error converting file to netcdf: dataout/48e3ko.pif6c10 Error converting file to netcdf: dataout/48e3ko.pff6c10 Error converting file to netcdf: dataout/48e3ka.phf6c10 Error converting file to netcdf: dataout/48e3ka.pgf6c10 Error converting file to netcdf: dataout/48e3ka.pef6c10 Error converting file to netcdf: dataout/48e3ka.pdf6c10 23:04:18 (3560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:19 (3560): No heartbeat from core client for 30 sec - exiting 23:04:20 (3560): No heartbeat from core client for 30 sec - exiting 23:04:21 (3560): No heartbeat from core client for 30 sec - exiting 23:04:22 (3560): No heartbeat from core client for 30 sec - exiting 23:04:23 (3560): No heartbeat from core client for 30 sec - exiting 23:04:24 (3560): No heartbeat from core client for 30 sec - exiting 23:04:25 (3560): No heartbeat from core client for 30 sec - exiting 23:04:26 (3560): No heartbeat from core client for 30 sec - exiting 23:04:27 (3560): No heartbeat from core client for 30 sec - exiting 23:04:28 (3560): No heartbeat from core client for 30 sec - exiting 23:06:19 (4040): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 22:09:44 (3556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:11:37 (3932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:34 (2596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:09:36 (4060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:08:46 (1172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:18 (1144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:05:15 (3292): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:04:14 (3140): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:02:33 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:01:31 (1068): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:00:31 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:58:34 (1920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:57:31 (2568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:56:24 (2516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:02 (2640): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
05 Apr 2013 19:50:22 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 803,520 | 3,190,195 | 3.9703 |
03 Apr 2013 11:41:42 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 777,600 | 3,077,303 | 3.9574 |
01 Apr 2013 16:51:27 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 751,680 | 2,968,084 | 3.9486 |
31 Mar 2013 01:27:10 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 725,760 | 2,859,305 | 3.9397 |
27 Mar 2013 02:45:07 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 699,840 | 2,749,164 | 3.9283 |
23 Mar 2013 11:54:30 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 673,920 | 2,639,532 | 3.9167 |
20 Mar 2013 23:26:35 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 648,000 | 2,529,994 | 3.9043 |
19 Mar 2013 14:56:46 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 622,080 | 2,420,130 | 3.8904 |
18 Mar 2013 07:28:20 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 596,160 | 2,310,749 | 3.8761 |
16 Mar 2013 23:41:44 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 570,240 | 2,202,219 | 3.8619 |
15 Mar 2013 14:20:18 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 544,320 | 2,090,841 | 3.8412 |
14 Mar 2013 05:38:57 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 518,400 | 1,979,297 | 3.8181 |
12 Mar 2013 21:25:35 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 492,480 | 1,868,476 | 3.7940 |
11 Mar 2013 13:25:11 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 466,560 | 1,758,751 | 3.7696 |
10 Mar 2013 05:25:42 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 440,640 | 1,648,912 | 3.7421 |
08 Mar 2013 21:18:42 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 414,720 | 1,539,735 | 3.7127 |
07 Mar 2013 12:22:03 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 388,800 | 1,429,634 | 3.6770 |
05 Mar 2013 16:45:50 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 362,880 | 1,332,508 | 3.6720 |
03 Mar 2013 16:40:58 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 336,960 | 1,238,801 | 3.6764 |
01 Mar 2013 10:07:47 | 1253035 | 15592045 | hadcm3n_48e3_1940_40_008305853_0 | 311,040 | 1,145,990 | 3.6844 |
©2024 cpdn.org