Task 12836797

Name	hadcm3n_p5mi_1900_40_007224874_2
Workunit	7423114
Created	28 Apr 2011, 1:24:15 UTC
Sent	28 Apr 2011, 1:30:23 UTC
Report deadline	28 Jul 2011, 8:57:34 UTC
Received	1 Jun 2011, 19:23:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	525042
Run time
CPU time	10 days 5 hours 17 min 17 sec
Validate state	Invalid
Credit	2,488.32
Device peak FLOPS	1.86 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>5.4.11</core_client_version> <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... 09:13:04 (5072): No heartbeat from core client for 30 sec - exiting 09:13:05 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:11:11 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:11:13 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/p5miko.pja2c10 Error converting file to netcdf: dataout/p5miko.pia2c10 Error converting file to netcdf: dataout/p5miko.pfa2c10 Error converting file to netcdf: dataout/p5mika.pha2c10 Error converting file to netcdf: dataout/p5mika.pga2c10 Error converting file to netcdf: dataout/p5mika.pea2c10 Error converting file to netcdf: dataout/p5mika.pda2c10 14:56:34 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:56:37 (5252): No heartbeat from core client for 30 sec - exiting 14:56:38 (5252): No heartbeat from core client for 30 sec - exiting 14:56:39 (5252): No heartbeat from core client for 30 sec - exiting 14:56:40 (5252): No heartbeat from core client for 30 sec - exiting 14:56:41 (5252): No heartbeat from core client for 30 sec - exiting 14:56:42 (5252): No heartbeat from core client for 30 sec - exiting 14:56:43 (5252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:49:34 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:49:35 (3272): No heartbeat from core client for 30 sec - exiting 11:38:35 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:38:37 (1680): No heartbeat from core client for 30 sec - exiting 11:38:38 (1680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 14:26:14 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:16 (4976): No heartbeat from core client for 30 sec - exiting 14:26:17 (4976): No heartbeat from core client for 30 sec - exiting 14:26:18 (4976): No heartbeat from core client for 30 sec - exiting 14:26:19 (4976): No heartbeat from core client for 30 sec - exiting 14:26:20 (4976): No heartbeat from core client for 30 sec - exiting 14:26:21 (4976): No heartbeat from core client for 30 sec - exiting 14:26:22 (4976): No heartbeat from core client for 30 sec - exiting 14:26:23 (4976): No heartbeat from core client for 30 sec - exiting 14:26:24 (4976): No heartbeat from core client for 30 sec - exiting 14:26:25 (4976): No heartbeat from core client for 30 sec - exiting 14:26:26 (4976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 21:41:50 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:51 (5188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:19 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:21 (2312): No heartbeat from core client for 30 sec - exiting 16:35:22 (2312): No heartbeat from core client for 30 sec - exiting 16:35:23 (2312): No heartbeat from core client for 30 sec - exiting 16:35:24 (2312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 07:22:45 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:22:46 (4644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 01:35:18 (4188): No heartbeat from core client for 30 sec - exiting 01:35:19 (4188): No heartbeat from core client for 30 sec - exiting 01:35:20 (4188): No heartbeat from core client for 30 sec - exiting 01:35:21 (4188): No heartbeat from core client for 30 sec - exiting 01:35:22 (4188): No heartbeat from core client for 30 sec - exiting 01:35:23 (4188): No heartbeat from core client for 30 sec - exiting 01:35:24 (4188): No heartbeat from core client for 30 sec - exiting 01:35:25 (4188): No heartbeat from core client for 30 sec - exiting 01:35:26 (4188): No heartbeat from core client for 30 sec - exiting 01:35:27 (4188): No heartbeat from core client for 30 sec - exiting 01:35:28 (4188): No heartbeat from core client for 30 sec - exiting 01:35:29 (4188): No heartbeat from core client for 30 sec - exiting 01:35:30 (4188): No heartbeat from core client for 30 sec - exiting 01:35:31 (4188): No heartbeat from core client for 30 sec - exiting 01:35:32 (4188): No heartbeat from core client for 30 sec - exiting 01:35:33 (4188): No heartbeat from core client for 30 sec - exiting 01:35:34 (4188): No heartbeat from core client for 30 sec - exiting 01:35:35 (4188): No heartbeat from core client for 30 sec - exiting 01:35:36 (4188): No heartbeat from core client for 30 sec - exiting 01:35:37 (4188): No heartbeat from core client for 30 sec - exiting 01:35:38 (4188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:57:24 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:26 (2900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:16:05 (5368): No heartbeat from core client for 30 sec - exiting 10:16:07 (5368): No heartbeat from core client for 30 sec - exiting 10:16:08 (5368): No heartbeat from core client for 30 sec - exiting 10:16:09 (5368): No heartbeat from core client for 30 sec - exiting 10:16:10 (5368): No heartbeat from core client for 30 sec - exiting 10:16:11 (5368): No heartbeat from core client for 30 sec - exiting 10:16:12 (5368): No heartbeat from core client for 30 sec - exiting 10:16:13 (5368): No heartbeat from core client for 30 sec - exiting 10:16:14 (5368): No heartbeat from core client for 30 sec - exiting 10:16:15 (5368): No heartbeat from core client for 30 sec - exiting 10:16:16 (5368): No heartbeat from core client for 30 sec - exiting 10:16:17 (5368): No heartbeat from core client for 30 sec - exiting 10:16:18 (5368): No heartbeat from core client for 30 sec - exiting 10:16:19 (5368): No heartbeat from core client for 30 sec - exiting 10:16:20 (5368): No heartbeat from core client for 30 sec - exiting 10:16:21 (5368): No heartbeat from core client for 30 sec - exiting 10:16:22 (5368): No heartbeat from core client for 30 sec - exiting 10:16:23 (5368): No heartbeat from core client for 30 sec - exiting 10:16:24 (5368): No heartbeat from core client for 30 sec - exiting 10:16:25 (5368): No heartbeat from core client for 30 sec - exiting 10:16:26 (5368): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 May 2011 20:20:58	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	207,360	784,576	3.7836
19 May 2011 07:37:52	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	181,440	682,289	3.7604
13 May 2011 00:47:32	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	155,520	585,237	3.7631
11 May 2011 17:43:46	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	129,600	486,876	3.7568
10 May 2011 10:57:38	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	103,680	390,003	3.7616
08 May 2011 05:31:30	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	77,760	294,067	3.7817
06 May 2011 19:11:37	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	51,840	189,212	3.6499
04 May 2011 15:22:37	525042	12836797	hadcm3n_p5mi_1900_40_007224874_2	25,920	94,583	3.6490