Task 13018903

Name	hadcm3n_t4tq_1940_40_007312939_2
Workunit	7510369
Created	28 Jun 2011, 8:59:05 UTC
Sent	28 Jun 2011, 8:59:11 UTC
Report deadline	27 Sep 2011, 16:26:22 UTC
Received	16 Jul 2011, 6:31:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	431363
Run time	8 days 7 hours 36 min 40 sec
CPU time	7 days 20 hours 16 min 1 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.80 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.26</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08190f78 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6de2b)[0xf74a0e2b] /lib/libc.so.6(+0x6ebab)[0xf74a1bab] /lib/libc.so.6(cfree+0x6d)[0xf74a5a6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76976e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf769773d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7449c2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:03 4859381 /home/harry/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:03 4859381 /home/harry/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-081a0000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fb6000-f7431000 rw-s 00000000 08:03 6041440 /home/harry/boinc/slots/2/137965 f7431000-f7433000 rw-p 00000000 00:00 0 f7433000-f7599000 r-xp 00000000 08:02 920480 /lib/libc-2.11.3.so f7599000-f759a000 ---p 00166000 08:02 920480 /lib/libc-2.11.3.so f759a000-f759c000 r--p 00166000 08:02 920480 /lib/libc-2.11.3.so f759c000-f759d000 rw-p 00168000 08:02 920480 /lib/libc-2.11.3.so f759d000-f75a0000 rw-p 00000000 00:00 0 f75a0000-f75bc000 r-xp 00000000 08:02 922561 /lib/libgcc_s.so.1 f75bc000-f75bd000 r--p 0001b000 08:02 922561 /lib/libgcc_s.so.1 f75bd000-f75be000 rw-p 0001c000 08:02 922561 /lib/libgcc_s.so.1 f75be000-f75bf000 rw-p 00000000 00:00 0 f75bf000-f75e7000 r-xp 00000000 08:02 920558 /lib/libm-2.11.3.so f75e7000-f75e8000 r--p 00027000 08:02 920558 /lib/libm-2.11.3.so f75e8000-f75e9000 rw-p 00028000 08:02 920558 /lib/libm-2.11.3.so f75e9000-f76cc000 r-xp 00000000 08:02 800313 /usr/lib/libstdc++.so.6.0.14 f76cc000-f76d0000 r--p 000e2000 08:02 800313 /usr/lib/libstdc++.so.6.0.14 f76d0000-f76d1000 rw-p 000e6000 08:02 800313 /usr/lib/libstdc++.so.6.0.14 f76d1000-f76d8000 rw-p 00000000 00:00 0 f76d8000-f76db000 r-xp 00000000 08:02 920704 /lib/libdl-2.11.3.so f76db000-f76dc000 r--p 00002000 08:02 920704 /lib/libdl-2.11.3.so f76dc000-f76dd000 rw-p 00003000 08:02 920704 /lib/libdl-2.11.3.so f76dd000-f76f4000 r-xp 00000000 08:02 920699 /lib/libpthread-2.11.3.so f76f4000-f76f5000 r--p 00016000 08:02 920699 /lib/libpthread-2.11.3.so f76f5000-f76f6000 rw-p 00017000 08:02 920699 /lib/libpthread-2.11.3.so f76f6000-f76f8000 rw-p 00000000 00:00 0 f7711000-f7712000 rw-p 00000000 00:00 0 f7712000-f7713000 ---p 00000000 00:00 0 f7713000-f7716000 rw-p 00000000 00:00 0 f7716000-f7718000 rw-s 00000000 08:03 6041437 /home/harry/boinc/slots/2/boinc_mmap_file f7718000-f7719000 rw-p 00000000 00:00 0 f7719000-f7738000 r-xp 00000000 08:02 920483 /lib/ld-2.11.3.so f7738000-f7739000 r--p 0001e000 08:02 920483 /lib/ld-2.11.3.so f7739000-f773a000 rw-p 0001f000 08:02 920483 /lib/ld-2.11.3.so ff7b0000-ff820000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe425] /lib/libc.so.6(gsignal+0x4f)[0xf745e8df] /lib/libc.so.6(abort+0x180)[0xf7460220] /lib/libc.so.6(+0x67e07)[0xf749ae07] /lib/libc.so.6(+0x6de2b)[0xf74a0e2b] /lib/libc.so.6(+0x6ebab)[0xf74a1bab] /lib/libc.so.6(cfree+0x6d)[0xf74a5a6d] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf76976e1] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf769773d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7449c2e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Jul 2011 15:03:27	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	259,200	677,751	2.6148
25 Jul 2011 15:03:27	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	233,280	606,500	2.5999
25 Jul 2011 15:03:27	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	207,360	535,291	2.5815
10 Jul 2011 07:51:22	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	181,440	464,399	2.5595
09 Jul 2011 11:51:22	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	155,520	397,128	2.5535
05 Jul 2011 14:26:34	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	129,600	330,322	2.5488
04 Jul 2011 19:00:55	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	103,680	263,634	2.5428
03 Jul 2011 10:55:47	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	77,760	197,922	2.5453
02 Jul 2011 07:45:28	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	51,840	132,270	2.5515
01 Jul 2011 11:14:42	431363	13018903	hadcm3n_t4tq_1940_40_007312939_2	25,920	66,200	2.5540