Name | hadcm3n_zd98_1960_40_008358550_1 |
Workunit | 8509409 |
Created | 14 Aug 2013, 11:30:47 UTC |
Sent | 14 Aug 2013, 17:08:02 UTC |
Report deadline | 14 Nov 2013, 0:35:13 UTC |
Received | 23 Aug 2013, 20:31:59 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1099117 |
Run time | 6 days 16 hours 20 min 22 sec |
CPU time | 5 days 19 hours 47 min 36 sec |
Validate state | Invalid |
Credit | 3,110.40 |
Device peak FLOPS | 2.85 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/zd98ko.pjh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pjh0c10 Error: Input file: dataout/zd98ko.pih0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pih0c10 Error: Input file: dataout/zd98ko.pfh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pfh0c10 Error: Input file: dataout/zd98ko.pch0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pch0c10 Error: Input file: dataout/zd98ko.pbh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pbh0c10 Error: Input file: dataout/zd98ko.pah0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pah0c10 Error: Input file: dataout/zd98ka.phh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.phh0c10 Error: Input file: dataout/zd98ka.pgh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.pgh0c10 Error: Input file: dataout/zd98ka.peh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.peh0c10 Error: Input file: dataout/zd98ka.pdh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.pdh0c10 CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 62 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/zd98ko.pjh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pjh0c10 Error: Input file: dataout/zd98ko.pih0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pih0c10 Error: Input file: dataout/zd98ko.pfh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pfh0c10 Error: Input file: dataout/zd98ko.pch0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pch0c10 Error: Input file: dataout/zd98ko.pbh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pbh0c10 Error: Input file: dataout/zd98ko.pah0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ko.pah0c10 Error: Input file: dataout/zd98ka.phh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.phh0c10 Error: Input file: dataout/zd98ka.pgh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.pgh0c10 Error: Input file: dataout/zd98ka.peh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.peh0c10 Error: Input file: dataout/zd98ka.pdh0c10 is not a valid UM file. Error converting file to netcdf: dataout/zd98ka.pdh0c10 hadcm3n_6.07_i686-apple-darwin(46470,0xa0976540) malloc: *** error for object 0x2019e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46470,0xa0976540) malloc: *** error for object 0x2019e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46470,0xa0976540) malloc: *** error for object 0x2019e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=46478, selfPID=46478, iMonCtr=1 hadcm3n_6.07_i686-apple-darwin(46492,0xa0976540) malloc: *** error for object 0x815c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(46597,0xa0976540) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46597,0xa0976540) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46597,0xa0976540) malloc: *** error for object 0x1005e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(46803,0xa0976540) malloc: *** error for object 0x282de04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46803,0xa0976540) malloc: *** error for object 0x282de00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(46803,0xa0976540) malloc: *** error for object 0x1015e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation Crashed executable name: hadcm3n_6.07_i686-apple-darwin built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) hadcm3n_6.07_i686-apple-darwin(245,0xa0976540) malloc: *** error for object 0x825e00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug SIGSEGV: segmentation violation hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1000e04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1001c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1802204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x1810804: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x181ee04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(4496,0xa0976540) malloc: *** error for object 0x181ee00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_zd98_1960_40_008358550/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
23 Aug 2013 10:11:34 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 259,200 | 503,311 | 1.9418 |
22 Aug 2013 08:24:27 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 233,280 | 452,853 | 1.9412 |
21 Aug 2013 15:18:15 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 207,360 | 402,309 | 1.9401 |
20 Aug 2013 21:22:05 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 181,440 | 351,831 | 1.9391 |
20 Aug 2013 03:46:56 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 155,520 | 301,544 | 1.9389 |
19 Aug 2013 10:40:06 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 129,600 | 251,682 | 1.9420 |
17 Aug 2013 18:31:36 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 103,680 | 201,246 | 1.9410 |
16 Aug 2013 15:35:56 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 77,760 | 150,262 | 1.9324 |
16 Aug 2013 00:22:29 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 51,840 | 99,796 | 1.9251 |
15 Aug 2013 08:40:38 | 1099117 | 15911916 | hadcm3n_zd98_1960_40_008358550_1 | 25,920 | 49,050 | 1.8924 |
©2024 climateprediction.net