Task 18820339

Name	hadcm3n_xdpf_1940_40_010021546_3
Workunit	10019617
Created	12 Aug 2015, 23:57:27 UTC
Sent	13 Aug 2015, 1:14:02 UTC
Report deadline	12 Nov 2015, 8:41:13 UTC
Received	27 Sep 2015, 6:04:02 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1231328
Run time	22 days 2 hours 52 min 44 sec
CPU time	20 days 5 hours 20 min 20 sec
Validate state	Invalid
Credit	11,819.52
Device peak FLOPS	3.52 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.6.10</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xdpf_1940_40_010021546/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=56987, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: severe (17): syntax error in NAMELIST input, unit 5, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xdpf_1940_40_010021546/jobs/climate.cpdc, line 393, position 19 Image PC Routine Line Source hadcm3n_um_6.07_i 0042E622 Unknown Unknown Unknown hadcm3n_um_6.07_i 0042D0EB Unknown Unknown Unknown hadcm3n_um_6.07_i 003EF4DD Unknown Unknown Unknown hadcm3n_um_6.07_i 003A66F5 Unknown Unknown Unknown hadcm3n_um_6.07_i 003A5E57 Unknown Unknown Unknown hadcm3n_um_6.07_i 003CACB0 Unknown Unknown Unknown hadcm3n_um_6.07_i 00261D1E Unknown Unknown Unknown hadcm3n_um_6.07_i 0016269A Unknown Unknown Unknown hadcm3n_um_6.07_i 00164453 Unknown Unknown Unknown hadcm3n_um_6.07_i 0038CE7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0038A1ED Unknown Unknown Unknown hadcm3n_um_6.07_i 000048E1 Unknown Unknown Unknown hadcm3n_um_6.07_i 000027FB Unknown Unknown Unknown hadcm3n_um_6.07_i 00002729 Unknown Unknown Unknown Unknown 00000003 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=85540, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
27 Sep 2015 05:07:54	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	984,960	1,759,547	1.7864
26 Sep 2015 09:27:27	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	959,040	1,728,383	1.8022
25 Sep 2015 09:20:28	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	933,120	1,679,680	1.8001
24 Sep 2015 08:24:15	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	907,200	1,631,091	1.7979
23 Sep 2015 07:52:39	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	881,280	1,582,481	1.7957
22 Sep 2015 16:55:12	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	855,360	1,533,950	1.7933
17 Sep 2015 06:14:38	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	829,440	1,485,543	1.7910
16 Sep 2015 05:13:09	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	803,520	1,437,067	1.7885
15 Sep 2015 04:09:09	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	777,600	1,388,646	1.7858
14 Sep 2015 03:26:59	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	751,680	1,340,237	1.7830
13 Sep 2015 03:06:17	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	725,760	1,291,598	1.7796
12 Sep 2015 02:41:22	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	699,840	1,243,018	1.7761
11 Sep 2015 02:15:08	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	673,920	1,194,286	1.7721
10 Sep 2015 01:52:24	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	648,000	1,145,816	1.7682
07 Sep 2015 14:31:48	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	622,080	1,097,431	1.7641
06 Sep 2015 14:32:46	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	596,160	1,049,080	1.7597
05 Sep 2015 12:54:21	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	570,240	1,002,331	1.7577
04 Sep 2015 12:36:35	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	544,320	953,909	1.7525
03 Sep 2015 12:05:02	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	518,400	905,186	1.7461
03 Sep 2015 05:01:28	1231328	18820339	hadcm3n_xdpf_1940_40_010021546_3	492,480	881,293	1.7895