climateprediction.net home page
Task 16292742

Task 16292742

Name hadcm3n_7y45_1980_40_008455496_3
Workunit 8606352
Created 22 Feb 2014, 19:03:23 UTC
Sent 22 Feb 2014, 19:03:29 UTC
Report deadline 25 May 2014, 2:30:40 UTC
Received 27 Mar 2014, 17:21:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1055843
Run time 23 days 20 hours 48 min 27 sec
CPU time 14 days 11 hours 51 min 53 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.96 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.2.33</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
18:37:57 (45356): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:09:47 (79417): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
23:07:05 (1279): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:10:19 (1288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:10:20 (1288): No heartbeat from core client for 30 sec - exiting
23:10:21 (1288): No heartbeat from core client for 30 sec - exiting
23:10:22 (1288): No heartbeat from core client for 30 sec - exiting
23:10:23 (1288): No heartbeat from core client for 30 sec - exiting
23:10:24 (1288): No heartbeat from core client for 30 sec - exiting
23:10:25 (1288): No heartbeat from core client for 30 sec - exiting
23:10:26 (1288): No heartbeat from core client for 30 sec - exiting
23:10:27 (1288): No heartbeat from core client for 30 sec - exiting
23:10:28 (1288): No heartbeat from core client for 30 sec - exiting
23:10:30 (1288): No heartbeat from core client for 30 sec - exiting
23:10:31 (1288): No heartbeat from core client for 30 sec - exiting
23:10:32 (1288): No heartbeat from core client for 30 sec - exiting
23:10:33 (1288): No heartbeat from core client for 30 sec - exiting
23:10:34 (1288): No heartbeat from core client for 30 sec - exiting
23:10:35 (1288): No heartbeat from core client for 30 sec - exiting
23:10:36 (1288): No heartbeat from core client for 30 sec - exiting
23:10:37 (1288): No heartbeat from core client for 30 sec - exiting
23:10:38 (1288): No heartbeat from core client for 30 sec - exiting
23:10:39 (1288): No heartbeat from core client for 30 sec - exiting
23:10:40 (1288): No heartbeat from core client for 30 sec - exiting
23:10:41 (1288): No heartbeat from core client for 30 sec - exiting
23:10:42 (1288): No heartbeat from core client for 30 sec - exiting
23:10:43 (1288): No heartbeat from core client for 30 sec - exiting
23:10:44 (1288): No heartbeat from core client for 30 sec - exiting
23:10:45 (1288): No heartbeat from core client for 30 sec - exiting
23:10:46 (1288): No heartbeat from core client for 30 sec - exiting
23:10:47 (1288): No heartbeat from core client for 30 sec - exiting
23:10:48 (1288): No heartbeat from core client for 30 sec - exiting
23:10:49 (1288): No heartbeat from core client for 30 sec - exiting
23:10:50 (1288): No heartbeat from core client for 30 sec - exiting
23:10:51 (1288): No heartbeat from core client for 30 sec - exiting
23:10:52 (1288): No heartbeat from core client for 30 sec - exiting
23:10:53 (1288): No heartbeat from core client for 30 sec - exiting
23:10:54 (1288): No heartbeat from core client for 30 sec - exiting
23:10:55 (1288): No heartbeat from core client for 30 sec - exiting
23:10:56 (1288): No heartbeat from core client for 30 sec - exiting
23:10:57 (1288): No heartbeat from core client for 30 sec - exiting
23:10:58 (1288): No heartbeat from core client for 30 sec - exiting
23:10:59 (1288): No heartbeat from core client for 30 sec - exiting
23:11:00 (1288): No heartbeat from core client for 30 sec - exiting
23:11:01 (1288): No heartbeat from core client for 30 sec - exiting
23:11:02 (1288): No heartbeat from core client for 30 sec - exiting
23:11:03 (1288): No heartbeat from core client for 30 sec - exiting
23:11:04 (1288): No heartbeat from core client for 30 sec - exiting
23:11:05 (1288): No heartbeat from core client for 30 sec - exiting
23:11:06 (1288): No heartbeat from core client for 30 sec - exiting
23:11:07 (1288): No heartbeat from core client for 30 sec - exiting
23:11:08 (1288): No heartbeat from core client for 30 sec - exiting
23:11:09 (1288): No heartbeat from core client for 30 sec - exiting
23:11:10 (1288): No heartbeat from core client for 30 sec - exiting
23:11:11 (1288): No heartbeat from core client for 30 sec - exiting
23:11:12 (1288): No heartbeat from core client for 30 sec - exiting
23:11:13 (1288): No heartbeat from core client for 30 sec - exiting
23:11:14 (1288): No heartbeat from core client for 30 sec - exiting
23:11:15 (1288): No heartbeat from core client for 30 sec - exiting
23:11:16 (1288): No heartbeat from core client for 30 sec - exiting
23:11:17 (1288): No heartbeat from core client for 30 sec - exiting
23:11:18 (1288): No heartbeat from core client for 30 sec - exiting
23:11:19 (1288): No heartbeat from core client for 30 sec - exiting
23:11:20 (1288): No heartbeat from core client for 30 sec - exiting
23:11:21 (1288): No heartbeat from core client for 30 sec - exiting
23:11:22 (1288): No heartbeat from core client for 30 sec - exiting
23:11:23 (1288): No heartbeat from core client for 30 sec - exiting
23:11:24 (1288): No heartbeat from core client for 30 sec - exiting
23:11:25 (1288): No heartbeat from core client for 30 sec - exiting
23:11:26 (1288): No heartbeat from core client for 30 sec - exiting
23:11:27 (1288): No heartbeat from core client for 30 sec - exiting
23:11:28 (1288): No heartbeat from core client for 30 sec - exiting
23:11:29 (1288): No heartbeat from core client for 30 sec - exiting
23:11:30 (1288): No heartbeat from core client for 30 sec - exiting
23:11:31 (1288): No heartbeat from core client for 30 sec - exiting
23:11:32 (1288): No heartbeat from core client for 30 sec - exiting
23:11:33 (1288): No heartbeat from core client for 30 sec - exiting
23:11:34 (1288): No heartbeat from core client for 30 sec - exiting
23:11:35 (1288): No heartbeat from core client for 30 sec - exiting
23:13:38 (1512): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:23:04 (1541): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:31:18 (1626): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:25:53 (1666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:29:41 (2626): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:19:59 (38035): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:53:42 (99139): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:04:56 (651): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:06:27 (665): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:32 (682): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:14:34 (682): No heartbeat from core client for 30 sec - exiting
20:14:35 (682): No heartbeat from core client for 30 sec - exiting
20:14:36 (682): No heartbeat from core client for 30 sec - exiting
20:20:03 (962): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:09:06 (73076): No heartbeat from core client for 30 sec - exiting
07:09:07 (73076): No heartbeat from core client for 30 sec - exiting
07:09:08 (73076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_7y45_1980_40_008455496/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
27 Mar 2014 06:13:52 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 777,600 1,252,355 1.6105
26 Mar 2014 08:55:05 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 751,680 1,211,547 1.6118
25 Mar 2014 20:13:03 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 725,760 1,170,776 1.6132
24 Mar 2014 22:54:47 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 699,840 1,129,691 1.6142
24 Mar 2014 06:17:25 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 673,920 1,088,398 1.6150
23 Mar 2014 10:24:06 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 648,000 1,047,152 1.6160
22 Mar 2014 05:49:34 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 622,080 1,005,125 1.6157
21 Mar 2014 06:40:06 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 596,160 963,430 1.6161
20 Mar 2014 00:04:08 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 570,240 921,966 1.6168
18 Mar 2014 04:57:50 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 544,320 880,272 1.6172
16 Mar 2014 21:17:36 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 518,400 838,172 1.6168
15 Mar 2014 03:54:57 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 492,480 796,099 1.6165
14 Mar 2014 03:53:07 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 466,560 753,582 1.6152
13 Mar 2014 00:56:24 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 440,640 710,960 1.6135
12 Mar 2014 04:11:46 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 414,720 668,205 1.6112
11 Mar 2014 08:09:38 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 388,800 625,701 1.6093
09 Mar 2014 18:24:15 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 362,880 583,398 1.6077
08 Mar 2014 19:51:41 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 336,960 541,443 1.6068
07 Mar 2014 14:15:45 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 311,040 499,533 1.6060
06 Mar 2014 18:22:54 1055843 16292742 hadcm3n_7y45_1980_40_008455496_3 285,120 457,149 1.6034


©2024 climateprediction.net