Task 15883515

Name	hadcm3n_zf7i_1960_40_008393640_1
Workunit	8544499
Created	7 Jul 2013, 8:25:25 UTC
Sent	7 Jul 2013, 8:25:34 UTC
Report deadline	6 Oct 2013, 15:52:45 UTC
Received	18 Jul 2013, 11:08:23 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1284045
Run time	6 days 23 hours 53 min 53 sec
CPU time	6 days 10 hours 30 min 5 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.30 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 23:42:28 (1333): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 17:47:05 (1584): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:47:09 (1584): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 13:00:05 (1651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:03:13 (438): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish * Error in `../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu': double free or corruption (out): 0x08e11b20 * ======= Backtrace: ========= /lib/libc.so.6[0x42b3acf2] /lib/libstdc++.so.6(_ZdlPv+0x20)[0x43277160] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0x432771bc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x42ade963] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:23 656456 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:23 656456 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08dbc000-08e43000 rw-p 00000000 00:00 0 [heap] 42aa2000-42ac1000 r-xp 00000000 08:23 1182407 /usr/lib/ld-2.17.so 42ac1000-42ac2000 r--p 0001e000 08:23 1182407 /usr/lib/ld-2.17.so 42ac2000-42ac3000 rw-p 0001f000 08:23 1182407 /usr/lib/ld-2.17.so 42ac5000-42c7c000 r-xp 00000000 08:23 1182416 /usr/lib/libc-2.17.so 42c7c000-42c7e000 r--p 001b6000 08:23 1182416 /usr/lib/libc-2.17.so 42c7e000-42c7f000 rw-p 001b8000 08:23 1182416 /usr/lib/libc-2.17.so 42c7f000-42c82000 rw-p 00000000 00:00 0 42c84000-42cc5000 r-xp 00000000 08:23 1182432 /usr/lib/libm-2.17.so 42cc5000-42cc6000 r--p 00040000 08:23 1182432 /usr/lib/libm-2.17.so 42cc6000-42cc7000 rw-p 00041000 08:23 1182432 /usr/lib/libm-2.17.so 42cc9000-42ccc000 r-xp 00000000 08:23 1182424 /usr/lib/libdl-2.17.so 42ccc000-42ccd000 r--p 00002000 08:23 1182424 /usr/lib/libdl-2.17.so 42ccd000-42cce000 rw-p 00003000 08:23 1182424 /usr/lib/libdl-2.17.so 42cd0000-42ce6000 r-xp 00000000 08:23 1182423 /usr/lib/libpthread-2.17.so 42ce6000-42ce7000 r--p 00015000 08:23 1182423 /usr/lib/libpthread-2.17.so 42ce7000-42ce8000 rw-p 00016000 08:23 1182423 /usr/lib/libpthread-2.17.so 42ce8000-42cea000 rw-p 00000000 00:00 0 42d05000-42d20000 r-xp 00000000 08:23 1184661 /usr/lib/libgcc_s-4.8.1-20130603.so.1 42d20000-42d21000 r--p 0001a000 08:23 1184661 /usr/lib/libgcc_s-4.8.1-20130603.so.1 42d21000-42d22000 rw-p 0001b000 08:23 1184661 /usr/lib/libgcc_s-4.8.1-20130603.so.1 4322c000-4330d000 r-xp 00000000 08:23 1184663 /usr/lib/libstdc++.so.6.0.18 4330d000-43311000 r--p 000e0000 08:23 1184663 /usr/lib/libstdc++.so.6.0.18 43311000-43313000 rw-p 000e4000 08:23 1184663 /usr/lib/libstdc++.so.6.0.18 43313000-43319000 rw-p 00000000 00:00 0 b7200000-b7221000 rw-p 00000000 00:00 0 b7221000-b7300000 ---p 00000000 00:00 0 b734b000-b77c6000 rw-s 00000000 08:23 424240 /var/lib/boinc/slots/3/136790 b77c6000-b77ca000 rw-p 00000000 00:00 0 b77e5000-b77e7000 rw-p 00000000 00:00 0 b77e7000-b77e8000 ---p 00000000 00:00 0 b77e8000-b77eb000 rw-p 00000000 00:00 0 [stack:1847] b77eb000-b77ed000 rw-s 00000000 08:23 424237 /var/lib/boinc/slots/3/boinc_mmap_file b77ed000-b77ee000 rw-p 00000000 00:00 0 b77ee000-b77ef000 r-xp 00000000 00:00 0 [vdso] bf8fb000-bf96b000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb77ee400] [0xb77ee424] /lib/libc.so.6(gsignal+0x46)[0x42af3936] /lib/libc.so.6(abort+0x143)[0x42af5173] /lib/libc.so.6[0x42b330c5] /lib/libc.so.6[0x42b3acf2] /lib/libstdc++.so.6(_ZdlPv+0x20)[0x43277160] /lib/libstdc++.so.6(_ZdaPv+0x1c)[0x432771bc] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xf3)[0x42ade963] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
23 Jul 2013 14:37:10	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	259,200	556,202	2.1458
23 Jul 2013 14:37:10	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	233,280	517,203	2.2171
23 Jul 2013 14:37:10	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	207,360	473,788	2.2849
23 Jul 2013 14:37:10	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	181,440	418,178	2.3048
23 Jul 2013 14:37:10	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	155,520	369,413	2.3753
11 Jul 2013 08:56:12	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	129,600	302,608	2.3349
10 Jul 2013 17:48:56	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	103,680	250,147	2.4127
09 Jul 2013 20:36:50	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	77,760	189,474	2.4367
09 Jul 2013 00:28:35	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	51,840	125,398	2.4189
08 Jul 2013 06:21:42	1284045	15883515	hadcm3n_zf7i_1960_40_008393640_1	25,920	64,196	2.4767