climateprediction.net home page
Task 15515816

Task 15515816

Name hadcm3n_3i3y_1940_40_008265538_2
Workunit 8420662
Created 29 Dec 2012, 11:48:46 UTC
Sent 29 Dec 2012, 11:48:47 UTC
Report deadline 30 Mar 2013, 19:15:58 UTC
Received 19 Jan 2013, 8:21:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 940519
Run time 8 days 23 hours 46 min 20 sec
CPU time 8 days 7 hours 0 min 51 sec
Validate state Invalid
Credit 6,842.88
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
cpdnmonitor: error reading file dataout/ocean_restart.day
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:42:32 (36733): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:42:43 (36733): No heartbeat from core client for 30 sec - exiting
12:42:44 (36733): No heartbeat from core client for 30 sec - exiting
12:42:45 (36733): No heartbeat from core client for 30 sec - exiting
12:42:46 (36733): No heartbeat from core client for 30 sec - exiting
12:42:47 (36733): No heartbeat from core client for 30 sec - exiting
12:42:48 (36733): No heartbeat from core client for 30 sec - exiting
12:42:49 (36733): No heartbeat from core client for 30 sec - exiting
12:42:50 (36733): No heartbeat from core client for 30 sec - exiting
12:42:51 (36733): No heartbeat from core client for 30 sec - exiting
12:42:52 (36733): No heartbeat from core client for 30 sec - exiting
12:42:53 (36733): No heartbeat from core client for 30 sec - exiting
12:42:54 (36733): No heartbeat from core client for 30 sec - exiting
12:42:55 (36733): No heartbeat from core client for 30 sec - exiting
12:42:56 (36733): No heartbeat from core client for 30 sec - exiting
12:42:57 (36733): No heartbeat from core client for 30 sec - exiting
12:42:58 (36733): No heartbeat from core client for 30 sec - exiting
12:42:59 (36733): No heartbeat from core client for 30 sec - exiting
12:43:00 (36733): No heartbeat from core client for 30 sec - exiting
12:43:01 (36733): No heartbeat from core client for 30 sec - exiting
12:43:02 (36733): No heartbeat from core client for 30 sec - exiting
12:43:03 (36733): No heartbeat from core client for 30 sec - exiting
12:43:04 (36733): No heartbeat from core client for 30 sec - exiting
12:43:05 (36733): No heartbeat from core client for 30 sec - exiting
12:43:06 (36733): No heartbeat from core client for 30 sec - exiting
12:43:07 (36733): No heartbeat from core client for 30 sec - exiting
12:43:08 (36733): No heartbeat from core client for 30 sec - exiting
12:43:09 (36733): No heartbeat from core client for 30 sec - exiting
12:43:10 (36733): No heartbeat from core client for 30 sec - exiting
12:43:11 (36733): No heartbeat from core client for 30 sec - exiting
12:43:12 (36733): No heartbeat from core client for 30 sec - exiting
12:43:13 (36733): No heartbeat from core client for 30 sec - exiting
12:43:14 (36733): No heartbeat from core client for 30 sec - exiting
12:43:15 (36733): No heartbeat from core client for 30 sec - exiting
12:43:16 (36733): No heartbeat from core client for 30 sec - exiting
12:43:17 (36733): No heartbeat from core client for 30 sec - exiting
12:43:18 (36733): No heartbeat from core client for 30 sec - exiting
12:43:19 (36733): No heartbeat from core client for 30 sec - exiting
12:43:20 (36733): No heartbeat from core client for 30 sec - exiting
12:43:21 (36733): No heartbeat from core client for 30 sec - exiting
12:43:22 (36733): No heartbeat from core client for 30 sec - exiting
12:43:23 (36733): No heartbeat from core client for 30 sec - exiting
12:43:24 (36733): No heartbeat from core client for 30 sec - exiting
12:44:10 (78077): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:12:35 (78092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:20:01 (78586): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
cpdnmonitor: error reading file dataout/atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
cpdnmonitor: error reading file dataout/atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
09:39:11 (11584): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
09:39:26 (11584): No heartbeat from core client for 30 sec - exiting
09:39:27 (11584): No heartbeat from core client for 30 sec - exiting
09:39:28 (11584): No heartbeat from core client for 30 sec - exiting
09:39:29 (11584): No heartbeat from core client for 30 sec - exiting
09:39:30 (11584): No heartbeat from core client for 30 sec - exiting
09:39:31 (11584): No heartbeat from core client for 30 sec - exiting
09:39:32 (11584): No heartbeat from core client for 30 sec - exiting
09:39:33 (11584): No heartbeat from core client for 30 sec - exiting
09:39:34 (11584): No heartbeat from core client for 30 sec - exiting
09:39:35 (11584): No heartbeat from core client for 30 sec - exiting
09:39:36 (11584): No heartbeat from core client for 30 sec - exiting
09:39:37 (11584): No heartbeat from core client for 30 sec - exiting
09:39:38 (11584): No heartbeat from core client for 30 sec - exiting
09:39:39 (11584): No heartbeat from core client for 30 sec - exiting
09:39:40 (11584): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file dataout/atmos_restart.hold
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
03:17:41 (76425): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:17:45 (76425): No heartbeat from core client for 30 sec - exiting
03:17:46 (76425): No heartbeat from core client for 30 sec - exiting
03:17:47 (76425): No heartbeat from core client for 30 sec - exiting
03:17:48 (76425): No heartbeat from core client for 30 sec - exiting
03:17:49 (76425): No heartbeat from core client for 30 sec - exiting
03:17:50 (76425): No heartbeat from core client for 30 sec - exiting
03:17:51 (76425): No heartbeat from core client for 30 sec - exiting
03:17:52 (76425): No heartbeat from core client for 30 sec - exiting
03:17:53 (76425): No heartbeat from core client for 30 sec - exiting
03:17:54 (76425): No heartbeat from core client for 30 sec - exiting
03:17:55 (76425): No heartbeat from core client for 30 sec - exiting
03:17:56 (76425): No heartbeat from core client for 30 sec - exiting
03:17:57 (76425): No heartbeat from core client for 30 sec - exiting
03:17:58 (76425): No heartbeat from core client for 30 sec - exiting
03:17:59 (76425): No heartbeat from core client for 30 sec - exiting
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
cpdnmonitor: error reading file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_3i3y_1940_40_008265538/dataout/ocean_restart.day

BUFFIN: Read Failed: Input/output error
BUFFIN: C I/O Error ferror - Unit 41 - Return code = 1

Model crashed: READDUMP: BAD BUFFIN OF DATA                                                                                                                                                                                                                                    tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jan 2013 11:09:22 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 570,240 691,615 1.2128
14 Jan 2013 01:31:58 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 544,320 659,752 1.2121
12 Jan 2013 05:43:47 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 518,400 627,389 1.2102
11 Jan 2013 19:55:00 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 492,480 595,944 1.2101
09 Jan 2013 15:40:40 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 466,560 564,115 1.2091
09 Jan 2013 06:24:40 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 440,640 532,679 1.2089
08 Jan 2013 20:50:51 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 414,720 500,705 1.2073
06 Jan 2013 20:21:46 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 388,800 469,338 1.2071
06 Jan 2013 08:36:02 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 362,880 437,684 1.2061
05 Jan 2013 22:23:42 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 336,960 406,123 1.2053
05 Jan 2013 11:36:25 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 311,040 374,748 1.2048
05 Jan 2013 00:59:00 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 285,120 343,545 1.2049
04 Jan 2013 13:20:16 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 259,200 311,515 1.2018
04 Jan 2013 00:58:21 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 233,280 279,419 1.1978
03 Jan 2013 10:41:22 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 207,360 248,198 1.1969
02 Jan 2013 20:05:22 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 181,440 216,854 1.1952
01 Jan 2013 23:48:02 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 155,520 186,602 1.1999
01 Jan 2013 02:04:56 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 129,600 156,003 1.2037
31 Dec 2012 12:45:13 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 103,680 125,120 1.2068
31 Dec 2012 02:52:14 940519 15515816 hadcm3n_3i3y_1940_40_008265538_2 77,760 93,531 1.2028


©2024 climateprediction.net