Task 13132840

Name	hadcm3n_yk58_1900_40_007358966_2
Workunit	7556396
Created	8 Jul 2011, 4:00:31 UTC
Sent	8 Jul 2011, 4:02:17 UTC
Report deadline	7 Oct 2011, 11:29:28 UTC
Received	1 Aug 2011, 18:46:58 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1157546
Run time	11 days 23 hours 4 min 12 sec
CPU time	11 days 12 hours 0 min 29 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.73 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09081bd0 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6cc9e)[0xf7520c9e] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf7705161] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf77051bd] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf74caca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:19 32899791 /home/tbj/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:19 32899791 /home/tbj/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 0902c000-090b3000 rw-p 00000000 00:00 0 [heap] f7037000-f74b2000 rw-s 00000000 08:19 32900197 /home/tbj/BOINC/slots/8/135320 f74b2000-f74b4000 rw-p 00000000 00:00 0 f74b4000-f7613000 r-xp 00000000 08:15 5505033 /lib/libc-2.12.1.so f7613000-f7614000 ---p 0015f000 08:15 5505033 /lib/libc-2.12.1.so f7614000-f7616000 r--p 0015f000 08:15 5505033 /lib/libc-2.12.1.so f7616000-f7617000 rw-p 00161000 08:15 5505033 /lib/libc-2.12.1.so f7617000-f761a000 rw-p 00000000 00:00 0 f761a000-f7633000 r-xp 00000000 08:15 5505067 /lib/libgcc_s-4.5.2.so.1 f7633000-f7634000 rw-p 00018000 08:15 5505067 /lib/libgcc_s-4.5.2.so.1 f7634000-f7635000 rw-p 00000000 00:00 0 f7635000-f7658000 r-xp 00000000 08:15 5505041 /lib/libm-2.12.1.so f7658000-f7659000 r--p 00022000 08:15 5505041 /lib/libm-2.12.1.so f7659000-f765a000 rw-p 00023000 08:15 5505041 /lib/libm-2.12.1.so f765a000-f7739000 r-xp 00000000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f7739000-f773d000 r--p 000df000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f773d000-f773e000 rw-p 000e3000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f773e000-f7745000 rw-p 00000000 00:00 0 f7745000-f7747000 r-xp 00000000 08:15 5505039 /lib/libdl-2.12.1.so f7747000-f7748000 r--p 00001000 08:15 5505039 /lib/libdl-2.12.1.so f7748000-f7749000 rw-p 00002000 08:15 5505039 /lib/libdl-2.12.1.so f7749000-f775e000 r-xp 00000000 08:15 5505057 /lib/libpthread-2.12.1.so f775e000-f775f000 r--p 00014000 08:15 5505057 /lib/libpthread-2.12.1.so f775f000-f7760000 rw-p 00015000 08:15 5505057 /lib/libpthread-2.12.1.so f7760000-f7762000 rw-p 00000000 00:00 0 f7775000-f7776000 rw-p 00000000 00:00 0 f7776000-f7777000 ---p 00000000 00:00 0 f7777000-f777a000 rw-p 00000000 00:00 0 f777a000-f777c000 rw-s 00000000 08:19 32900073 /home/tbj/BOINC/slots/8/boinc_mmap_file f777c000-f777d000 rw-p 00000000 00:00 0 f777d000-f7798000 r-xp 00000000 08:15 5505026 /lib/ld-2.12.1.so f7798000-f7799000 r--p 0001a000 08:15 5505026 /lib/ld-2.12.1.so f7799000-f779a000 rw-p 0001b000 08:15 5505026 /lib/ld-2.12.1.so ffb4a000-ffbba000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x51)[0xf74de3e1] /lib/libc.so.6(abort+0x17e)[0xf74dff0e] /lib/libc.so.6(+0x656dd)[0xf75196dd] /lib/libc.so.6(+0x6cc9e)[0xf7520c9e] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf7705161] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf77051bd] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf74caca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
01 Aug 2011 17:57:40	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	518,400	993,625	1.9167
31 Jul 2011 11:25:56	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	492,480	941,797	1.9124
30 Jul 2011 17:49:34	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	466,560	892,419	1.9128
29 Jul 2011 17:53:53	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	440,640	843,600	1.9145
28 Jul 2011 09:13:56	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	414,720	792,898	1.9119
27 Jul 2011 11:47:24	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	388,800	742,940	1.9109
25 Jul 2011 23:00:38	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	362,880	692,553	1.9085
25 Jul 2011 21:55:41	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	336,960	642,631	1.9071
25 Jul 2011 20:43:41	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	311,040	593,216	1.9072
25 Jul 2011 20:40:19	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	285,120	544,102	1.9083
25 Jul 2011 20:40:19	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	259,200	494,858	1.9092
25 Jul 2011 19:33:11	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	233,280	445,656	1.9104
25 Jul 2011 18:09:46	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	207,360	395,568	1.9076
25 Jul 2011 16:17:42	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	181,440	345,974	1.9068
25 Jul 2011 15:39:54	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	155,520	297,560	1.9133
25 Jul 2011 14:31:52	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	129,600	248,882	1.9204
25 Jul 2011 12:59:53	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	103,680	200,345	1.9323
25 Jul 2011 12:59:53	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	77,760	150,075	1.9300
10 Jul 2011 09:47:02	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	51,840	99,543	1.9202
09 Jul 2011 11:21:12	1157546	13132840	hadcm3n_yk58_1900_40_007358966_2	25,920	49,432	1.9071