Task 12750521

Name	hadcm3n_o76r_1900_40_007204646_1
Workunit	7402926
Created	28 Mar 2011, 14:19:31 UTC
Sent	28 Mar 2011, 18:31:56 UTC
Report deadline	28 Jun 2011, 1:59:07 UTC
Received	9 Apr 2011, 9:10:56 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1057567
Run time	7 days 17 hours 43 min 17 sec
CPU time	5 days 13 hours 14 min 8 sec
Validate state	Invalid
Credit	2,799.36
Device peak FLOPS	1.75 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb7fbc420] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805067e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xdc)[0xb7d30e9c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file stdout Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 083009BD Unknown Unknown Unknown hadcm3n_um_6.07_i 0838EDB1 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 007A1E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3441, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: WritUnable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) CPDN Monitor - Quit request from BOINC... Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Signal 15 received, exiting... Called boinc_finish Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) Unable to load library hadcm3n_se_6.07_i686-pc-linux-gnu.so dlopen error: /usr/lib/libstdc++.so.6: version `GLIBCXX_3.4.9' not found (required by /u02/BOINC/projects/climateprediction.net/hadcm3n_se_6.07_i686-pc-linux-gnu.so) BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file stdout Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 083009BD Unknown Unknown Unknown hadcm3n_um_6.07_i 0838EDB1 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 007A1E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3441, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file stdout Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 083009BD Unknown Unknown Unknown hadcm3n_um_6.07_i 0838EDB1 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 007A1E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3441, iMonCtr=1 Model crash detected, will try to restart... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 forrtl: No space left on device forrtl: severe (38): error during write, unit -1, file stdout Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 083009BD Unknown Unknown Unknown hadcm3n_um_6.07_i 0838EDB1 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 007A1E9C UnknCalled boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Apr 2011 17:29:55	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	233,280	480,814	2.0611
07 Apr 2011 14:34:50	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	207,360	424,049	2.0450
06 Apr 2011 15:31:37	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	181,440	357,280	1.9691
06 Apr 2011 15:31:37	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	155,520	330,591	2.1257
04 Apr 2011 17:00:04	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	129,600	216,012	1.6668
03 Apr 2011 11:57:33	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	103,680	138,942	1.3401
02 Apr 2011 12:17:58	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	77,760	199,819	2.5697
01 Apr 2011 15:51:07	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	51,840	134,207	2.5889
31 Mar 2011 15:05:00	1057567	12750521	hadcm3n_o76r_1900_40_007204646_1	25,920	68,727	2.6515