Task 13622508

Name	hadcm3n_ydt5_1940_40_007424237_2
Workunit	7621872
Created	9 Nov 2011, 14:33:14 UTC
Sent	9 Nov 2011, 15:10:04 UTC
Report deadline	8 Feb 2012, 22:37:15 UTC
Received	8 Jan 2012, 2:23:28 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1120353
Run time	5 days 20 hours 41 min 1 sec
CPU time	5 days 18 hours 51 min 2 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09cfae70 *** ======= Backtrace: ========= /lib/libc.so.6[0x415792b5] /usr/lib/libstdc++.so.6(_ZdlPv+0x20)[0x42732460] /usr/lib/libstdc++.so.6(_ZdaPv+0x1c)[0x427324bc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x41521413] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00ce1000-00ce2000 r-xp 00000000 00:00 0 [vdso] 08048000-080e3000 r-xp 00000000 fd:00 263354 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:00 263354 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09ca5000-09d2c000 rw-p 00000000 00:00 0 [heap] 414e7000-41504000 r-xp 00000000 fd:00 27214 /lib/ld-2.14.so 41504000-41505000 r--p 0001d000 fd:00 27214 /lib/ld-2.14.so 41505000-41506000 rw-p 0001e000 fd:00 27214 /lib/ld-2.14.so 41508000-4168d000 r-xp 00000000 fd:00 27215 /lib/libc-2.14.so 4168d000-4168f000 r--p 00184000 fd:00 27215 /lib/libc-2.14.so 4168f000-41690000 rw-p 00186000 fd:00 27215 /lib/libc-2.14.so 41690000-41693000 rw-p 00000000 00:00 0 41695000-416ab000 r-xp 00000000 fd:00 28152 /lib/libpthread-2.14.so 416ab000-416ac000 r--p 00015000 fd:00 28152 /lib/libpthread-2.14.so 416ac000-416ad000 rw-p 00016000 fd:00 28152 /lib/libpthread-2.14.so 416ad000-416af000 rw-p 00000000 00:00 0 416b1000-416b4000 r-xp 00000000 fd:00 27216 /lib/libdl-2.14.so 416b4000-416b5000 r--p 00002000 fd:00 27216 /lib/libdl-2.14.so 416b5000-416b6000 rw-p 00003000 fd:00 27216 /lib/libdl-2.14.so 416c9000-416f1000 r-xp 00000000 fd:00 28475 /lib/libm-2.14.so 416f1000-416f2000 r--p 00028000 fd:00 28475 /lib/libm-2.14.so 416f2000-416f3000 rw-p 00029000 fd:00 28475 /lib/libm-2.14.so 41a1b000-41a37000 r-xp 00000000 fd:00 27685 /lib/libgcc_s-4.6.0-20110530.so.1 41a37000-41a38000 rw-p 0001b000 fd:00 27685 /lib/libgcc_s-4.6.0-20110530.so.1 42681000-42763000 r-xp 00000000 fd:00 26144 /usr/lib/libstdc++.so.6.0.16 42763000-42767000 r--p 000e1000 fd:00 26144 /usr/lib/libstdc++.so.6.0.16 42767000-42769000 rw-p 000e5000 fd:00 26144 /usr/lib/libstdc++.so.6.0.16 42769000-4276f000 rw-p 00000000 00:00 0 f70ff000-f7100000 rw-p 00000000 00:00 0 f7100000-f7121000 rw-p 00000000 00:00 0 f7121000-f7200000 ---p 00000000 00:00 0 f72c1000-f773c000 rw-s 00000000 fd:00 405301 /var/lib/boinc/slots/2/136295 f773c000-f773f000 rw-p 00000000 00:00 0 f7758000-f7759000 rw-p 00000000 00:00 0 f7759000-f775a000 ---p 00000000 00:00 0 f775a000-f775d000 rw-p 00000000 00:00 0 f775d000-f775f000 rw-s 00000000 fd:00 394151 /var/lib/boinc/slots/2/boinc_mmap_file f775f000-f7760000 rw-p 00000000 00:00 0 ff88b000-ff8fb000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xce1400] [0xce1430] /lib/libc.so.6(gsignal+0x4f)[0x4153626f] /lib/libc.so.6(abort+0x175)[0x41537ba5] /lib/libc.so.6[0x4157239a] /lib/libc.so.6[0x415792b5] /usr/lib/libstdc++.so.6(_ZdlPv+0x20)[0x42732460] /usr/lib/libstdc++.so.6(_ZdaPv+0x1c)[0x427324bc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x41521413] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
08 Jan 2012 02:23:37	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	259,200	499,857	1.9285
04 Jan 2012 12:27:01	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	233,280	449,900	1.9286
31 Dec 2011 03:40:09	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	207,360	400,349	1.9307
28 Dec 2011 02:43:32	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	181,440	350,344	1.9309
02 Dec 2011 23:53:57	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	155,520	300,185	1.9302
25 Nov 2011 13:07:06	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	129,600	250,814	1.9353
24 Nov 2011 22:53:09	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	103,680	201,321	1.9418
24 Nov 2011 08:56:38	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	77,760	151,315	1.9459
23 Nov 2011 18:50:37	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	51,840	101,071	1.9497
10 Nov 2011 05:46:19	1120353	13622508	hadcm3n_ydt5_1940_40_007424237_2	25,920	50,609	1.9525