Task 13291400

Name	hadcm3n_p6rx_1940_40_007421514_0
Workunit	7619149
Created	25 Aug 2011, 2:33:04 UTC
Sent	25 Aug 2011, 2:33:51 UTC
Report deadline	24 Nov 2011, 10:01:02 UTC
Received	14 Sep 2011, 16:02:34 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1120510
Run time	16 days 12 hours 49 min 24 sec
CPU time	7 days 14 hours 16 min 44 sec
Validate state	Invalid
Credit	10,264.32
Device peak FLOPS	3.28 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 07:33:00 (195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:50:40 (214): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 Model crashed: TEMPHIST: Failed in OPEN of history file tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... execl(/Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin, 136750) failed! Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=948, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2011 09:29:01	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	855,360	643,730	0.7526
13 Sep 2011 22:00:43	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	829,440	619,193	0.7465
13 Sep 2011 09:51:10	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	803,520	606,387	0.7547
12 Sep 2011 22:22:03	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	777,600	590,886	0.7599
12 Sep 2011 09:26:51	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	751,680	572,860	0.7621
11 Sep 2011 22:16:30	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	725,760	534,967	0.7371
11 Sep 2011 11:25:34	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	699,840	649,645	0.9283
11 Sep 2011 00:28:54	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	673,920	612,491	0.9088
10 Sep 2011 13:28:27	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	648,000	575,180	0.8876
10 Sep 2011 02:26:11	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	622,080	537,686	0.8643
09 Sep 2011 13:20:50	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	596,160	507,771	0.8517
09 Sep 2011 01:40:39	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	570,240	496,759	0.8711
08 Sep 2011 12:51:40	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	544,320	480,245	0.8823
08 Sep 2011 00:46:34	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	518,400	474,009	0.9144
07 Sep 2011 11:10:32	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	492,480	460,025	0.9341
06 Sep 2011 23:09:25	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	466,560	467,195	1.0014
06 Sep 2011 09:25:56	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	440,640	453,961	1.0302
05 Sep 2011 21:36:58	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	414,720	640,104	1.5435
05 Sep 2011 09:43:13	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	388,800	600,555	1.5446
04 Sep 2011 21:45:58	1120510	13291400	hadcm3n_p6rx_1940_40_007421514_0	362,880	561,095	1.5462