Task 13952217

Name	hadcm3n_y7ya_1940_40_007547480_3
Workunit	7744712
Created	21 Jan 2012, 21:01:49 UTC
Sent	21 Jan 2012, 21:02:16 UTC
Report deadline	22 Apr 2012, 4:29:27 UTC
Received	21 Feb 2012, 20:28:33 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1157546
Run time	11 days 6 hours 4 min 10 sec
CPU time	10 days 21 hours 47 min 35 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.68 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Signal 1 received, exiting... Called boinc_finish Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b45dd8 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6cb7e)[0xf7486b7e] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf766b161] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf766b1bd] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf7430ca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:19 32899791 /home/tbj/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:19 32899791 /home/tbj/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09af0000-09b77000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f9d000-f7418000 rw-s 00000000 08:19 33031657 /home/tbj/BOINC/slots/10/137655 f7418000-f741a000 rw-p 00000000 00:00 0 f741a000-f7579000 r-xp 00000000 08:15 5505031 /lib/libc-2.12.1.so f7579000-f757a000 ---p 0015f000 08:15 5505031 /lib/libc-2.12.1.so f757a000-f757c000 r--p 0015f000 08:15 5505031 /lib/libc-2.12.1.so f757c000-f757d000 rw-p 00161000 08:15 5505031 /lib/libc-2.12.1.so f757d000-f7580000 rw-p 00000000 00:00 0 f7580000-f7599000 r-xp 00000000 08:15 5505067 /lib/libgcc_s-4.5.2.so.1 f7599000-f759a000 rw-p 00018000 08:15 5505067 /lib/libgcc_s-4.5.2.so.1 f759a000-f759b000 rw-p 00000000 00:00 0 f759b000-f75be000 r-xp 00000000 08:15 5505039 /lib/libm-2.12.1.so f75be000-f75bf000 r--p 00022000 08:15 5505039 /lib/libm-2.12.1.so f75bf000-f75c0000 rw-p 00023000 08:15 5505039 /lib/libm-2.12.1.so f75c0000-f769f000 r-xp 00000000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f769f000-f76a3000 r--p 000df000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f76a3000-f76a4000 rw-p 000e3000 08:15 8392193 /usr/lib/libstdc++.so.6.0.14 f76a4000-f76ab000 rw-p 00000000 00:00 0 f76ab000-f76ad000 r-xp 00000000 08:15 5505037 /lib/libdl-2.12.1.so f76ad000-f76ae000 r--p 00001000 08:15 5505037 /lib/libdl-2.12.1.so f76ae000-f76af000 rw-p 00002000 08:15 5505037 /lib/libdl-2.12.1.so f76af000-f76c3000 r-xp 00000000 08:15 5505055 /lib/libpthread-2.12.1.so f76c3000-f76c4000 ---p 00014000 08:15 5505055 /lib/libpthread-2.12.1.so f76c4000-f76c5000 r--p 00014000 08:15 5505055 /lib/libpthread-2.12.1.so f76c5000-f76c6000 rw-p 00015000 08:15 5505055 /lib/libpthread-2.12.1.so f76c6000-f76c8000 rw-p 00000000 00:00 0 f76dd000-f76de000 rw-p 00000000 00:00 0 f76de000-f76df000 ---p 00000000 00:00 0 f76df000-f76e2000 rw-p 00000000 00:00 0 f76e2000-f76e4000 rw-s 00000000 08:19 33031559 /home/tbj/BOINC/slots/10/boinc_mmap_file f76e4000-f76e5000 rw-p 00000000 00:00 0 f76e5000-f7700000 r-xp 00000000 08:15 5511164 /lib/ld-2.12.1.so f7700000-f7701000 r--p 0001a000 08:15 5511164 /lib/ld-2.12.1.so f7701000-f7702000 rw-p 0001b000 08:15 5511164 /lib/ld-2.12.1.so ff7f2000-ff862000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe430] /lib/libc.so.6(gsignal+0x51)[0xf7444351] /lib/libc.so.6(abort+0x17e)[0xf7445e7e] /lib/libc.so.6(+0x655bd)[0xf747f5bd] /lib/libc.so.6(+0x6cb7e)[0xf7486b7e] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf766b161] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf766b1bd] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf7430ca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
21 Feb 2012 19:30:19	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	518,400	942,450	1.8180
19 Feb 2012 08:53:15	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	492,480	893,175	1.8136
17 Feb 2012 16:13:48	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	466,560	844,411	1.8099
15 Feb 2012 05:32:21	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	440,640	794,615	1.8033
13 Feb 2012 16:28:20	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	414,720	744,963	1.7963
11 Feb 2012 15:27:08	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	388,800	706,329	1.8167
11 Feb 2012 06:21:14	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	362,880	673,644	1.8564
08 Feb 2012 05:04:10	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	336,960	632,581	1.8773
05 Feb 2012 13:29:28	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	311,040	587,737	1.8896
04 Feb 2012 16:39:09	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	285,120	538,142	1.8874
03 Feb 2012 19:35:40	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	259,200	487,868	1.8822
02 Feb 2012 13:22:54	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	233,280	437,921	1.8772
31 Jan 2012 22:16:26	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	207,360	395,662	1.9081
29 Jan 2012 07:31:58	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	181,440	346,931	1.9121
28 Jan 2012 09:53:55	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	155,520	296,560	1.9069
26 Jan 2012 21:05:45	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	129,600	246,206	1.8997
26 Jan 2012 06:44:48	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	103,680	196,070	1.8911
25 Jan 2012 17:16:15	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	77,760	147,007	1.8905
23 Jan 2012 23:44:44	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	51,840	98,192	1.8941
22 Jan 2012 17:12:59	1157546	13952217	hadcm3n_y7ya_1940_40_007547480_3	25,920	49,227	1.8992