Task 13023444

Name	hadcm3n_t3mu_1940_40_007315261_1
Workunit	7512691
Created	28 Jun 2011, 20:30:35 UTC
Sent	28 Jun 2011, 20:51:55 UTC
Report deadline	28 Sep 2011, 4:19:06 UTC
Received	9 Jul 2011, 16:10:32 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1155662
Run time	4 days 9 hours 19 min 1 sec
CPU time	4 days 8 hours 31 min 51 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.88 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09d9ce08 *** ======= Backtrace: ========= /lib/libc.so.6[0x3ab041] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xc33592] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xc335ee] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x352cc6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00101000-00118000 r-xp 00000000 fd:00 1477304 /lib/libpthread-2.12.so 00118000-00119000 r-xp 00016000 fd:00 1477304 /lib/libpthread-2.12.so 00119000-0011a000 rwxp 00017000 fd:00 1477304 /lib/libpthread-2.12.so 0011a000-0011c000 rwxp 00000000 00:00 0 0031a000-00338000 r-xp 00000000 fd:00 1444982 /lib/ld-2.12.so 00338000-00339000 r-xp 0001d000 fd:00 1444982 /lib/ld-2.12.so 00339000-0033a000 rwxp 0001e000 fd:00 1444982 /lib/ld-2.12.so 0033c000-004c6000 r-xp 00000000 fd:00 1445120 /lib/libc-2.12.so 004c6000-004c8000 r-xp 0018a000 fd:00 1445120 /lib/libc-2.12.so 004c8000-004c9000 rwxp 0018c000 fd:00 1445120 /lib/libc-2.12.so 004c9000-004cc000 rwxp 00000000 00:00 0 009c3000-009c6000 r-xp 00000000 fd:00 1481308 /lib/libdl-2.12.so 009c6000-009c7000 r-xp 00002000 fd:00 1481308 /lib/libdl-2.12.so 009c7000-009c8000 rwxp 00003000 fd:00 1481308 /lib/libdl-2.12.so 00ab9000-00ae1000 r-xp 00000000 fd:00 1455159 /lib/libm-2.12.so 00ae1000-00ae2000 r-xp 00027000 fd:00 1455159 /lib/libm-2.12.so 00ae2000-00ae3000 rwxp 00028000 fd:00 1455159 /lib/libm-2.12.so 00b44000-00b61000 r-xp 00000000 fd:00 1481310 /lib/libgcc_s-4.4.5-20110214.so.1 00b61000-00b62000 rwxp 0001d000 fd:00 1481310 /lib/libgcc_s-4.4.5-20110214.so.1 00b84000-00c65000 r-xp 00000000 fd:00 1081303 /usr/lib/libstdc++.so.6.0.13 00c65000-00c69000 r-xp 000e0000 fd:00 1081303 /usr/lib/libstdc++.so.6.0.13 00c69000-00c6b000 rwxp 000e4000 fd:00 1081303 /usr/lib/libstdc++.so.6.0.13 00c6b000-00c71000 rwxp 00000000 00:00 0 08048000-080e3000 r-xp 00000000 fd:00 13279 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 fd:00 13279 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rwxp 00000000 00:00 0 09d47000-09dcd000 rwxp 00000000 00:00 0 [heap] f7200000-f7221000 rwxp 00000000 00:00 0 f7221000-f7300000 ---p 00000000 00:00 0 f7351000-f77cc000 rwxs 00000000 fd:00 35521 /var/lib/boinc/slots/11/136495 f77cc000-f77cf000 rwxp 00000000 00:00 0 f77e8000-f77e9000 rwxp 00000000 00:00 0 f77e9000-f77ea000 ---p 00000000 00:00 0 f77ea000-f77ed000 rwxp 00000000 00:00 0 f77ed000-f77ef000 rwxs 00000000 fd:00 35414 /var/lib/boinc/slots/11/boinc_mmap_file f77ef000-f77f0000 rwxp 00000000 00:00 0 f77f0000-f77f1000 r-xp 00000000 00:00 0 [vdso] ff7d7000-ff847000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77f0400] [0xf77f0430] /lib/libc.so.6(gsignal+0x51)[0x366d71] /lib/libc.so.6(abort+0x17a)[0x36864a] /lib/libc.so.6[0x3a4bfd] /lib/libc.so.6[0x3ab041] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xc33592] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xc335ee] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x352cc6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
09 Jul 2011 14:37:20	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	259,200	376,308	1.4518
09 Jul 2011 04:53:27	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	233,280	337,912	1.4485
08 Jul 2011 18:12:23	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	207,360	299,596	1.4448
08 Jul 2011 06:27:51	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	181,440	261,265	1.4400
07 Jul 2011 17:52:03	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	155,520	222,965	1.4337
07 Jul 2011 15:40:45	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	129,600	185,673	1.4327
05 Jul 2011 05:27:31	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	103,680	148,425	1.4316
04 Jul 2011 18:45:41	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	77,760	110,526	1.4214
30 Jun 2011 17:36:37	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	51,840	74,864	1.4441
29 Jun 2011 08:13:25	1155662	13023444	hadcm3n_t3mu_1940_40_007315261_1	25,920	37,493	1.4465