Task 16347752

Name	hadcm3n_86go_1980_40_008514879_4
Workunit	8662391
Created	6 Mar 2014, 9:34:42 UTC
Sent	6 Mar 2014, 9:34:49 UTC
Report deadline	5 Jun 2014, 17:02:00 UTC
Received	25 Mar 2014, 12:41:13 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1171203
Run time	7 days 14 hours 14 min 59 sec
CPU time	6 days 12 hours 30 min 35 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	3.01 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 18:01:14 (24257): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:01:19 (24257): No heartbeat from core client for 30 sec - exiting 18:01:20 (24257): No heartbeat from core client for 30 sec - exiting 18:01:21 (24257): No heartbeat from core client for 30 sec - exiting 18:04:14 (24396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:04:16 (24396): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:04:19 (28797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:00:47 (19651): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:34:08 (19804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:08:55 (32301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:56 (32301): No heartbeat from core client for 30 sec - exiting 09:21:25 (1557): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:33:58 (1705): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:03 (1857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:44:06 (1857): No heartbeat from core client for 30 sec - exiting 09:49:01 (1969): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:49:04 (1969): No heartbeat from core client for 30 sec - exiting 09:54:01 (2066): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:22 (2156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:59:26 (2156): No heartbeat from core client for 30 sec - exiting 09:59:27 (2156): No heartbeat from core client for 30 sec - exiting 10:03:18 (2262): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:27 (2354): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:09:32 (2354): No heartbeat from core client for 30 sec - exiting 10:09:33 (2354): No heartbeat from core client for 30 sec - exiting 10:24:28 (2474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:24:41 (2474): No heartbeat from core client for 30 sec - exiting 11:28:17 (3194): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:44:42 (3696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:59:44 (3864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:34:48 (4044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:09:52 (4821): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:07 (5118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:55:22 (8567): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 02:06:17 (13463): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 07:51:47 (18544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:51:52 (18544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 09:02:05 (20272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:09 (20366): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:42:11 (20366): No heartbeat from core client for 30 sec - exiting 09:42:12 (20366): No heartbeat from core client for 30 sec - exiting 10:22:34 (20682): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:36:15 (21026): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:46 (21155): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:02:13 (21739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:07:19 (21875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:11 (21936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:21:52 (21995): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:00:04 (22361): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:13:18 (22412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:47 (22548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:33:17 (23132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:38:17 (23204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:43:17 (23260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:18 (23318): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:53:20 (23318): No heartbeat from core client for 30 sec - exiting 12:58:21 (23408): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:58:23 (23408): No heartbeat from core client for 30 sec - exiting 13:18:22 (23462): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:23 (23625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:28:29 (23625): No heartbeat from core client for 30 sec - exiting 13:33:23 (23709): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:43:24 (23774): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:28:25 (23860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:13 (24673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:45:00 (24673): No heartbeat from core client for 30 sec - exiting 14:45:01 (24673): No heartbeat from core client for 30 sec - exiting 14:45:02 (24673): No heartbeat from core client for 30 sec - exiting 15:44:12 (24817): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:46:32 (25232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=25281, iMonCtr=1 Model crash detected, will try to restart... 15:51:29 (25281): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:54:33 (25329): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:59:28 (25359): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:54:31 (25403): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:09:40 (27205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:44 (27313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:18 (28029): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=28075, iMonCtr=1 Model crash detected, will try to restart... 20:44:56 (28075): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:06 (29658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:55:07 (29658): No heartbeat from core client for 30 sec - exiting 21:00:00 (29741): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:01 (29814): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:51 (29874): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:15:20 (31895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:15:34 (32158): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:58:18 (1045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:33 (1961): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 18:00:31 (30089): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:58:16 (30131): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:07:46 (31470): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:38 (32505): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:21:49 (32505): No heartbeat from core client for 30 sec - exiting 21:21:50 (32505): No heartbeat from core client for 30 sec - exiting 21:21:51 (32505): No heartbeat from core client for 30 sec - exiting 21:23:44 (32634): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:33:48 (32683): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:58 (316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=477, iMonCtr=1 Model crash detected, will try to restart... 21:56:16 (477): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=556, iMonCtr=1 Model crash detected, will try to restart... 21:59:07 (556): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=614, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=614, iMonCtr=1 Model crash detected, will try to restart... 22:09:14 (614): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=710, iMonCtr=1 Model crash detected, will try to restart... 22:20:32 (710): No heartbeat from core client for 30 sec - exiting 22:20:34 (710): No heartbeat from core client for 30 sec - exiting 22:20:35 (710): No heartbeat from core client for 30 sec - exiting 22:20:36 (710): No heartbeat from core client for 30 sec - exiting 22:20:37 (710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1391, iMonCtr=1 Model crash detected, will try to restart... 22:26:49 (1391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:23 (1453): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:38:56 (1510): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:45:09 (1579): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:55:12 (1645): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:58:07 (1740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:02:14 (1756): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:04:26 (1818): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:05:21 (1818): No heartbeat from core client for 30 sec - exiting 23:20:45 (1875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:35:48 (2016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:40:48 (2157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:51:33 (2219): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2341, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2341, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2341, iMonCtr=1 Model crash detected, will try to restart... 00:02:59 (2341): No heartbeat from core client for 30 sec - exiting 00:03:01 (2341): No heartbeat from core client for 30 sec - exiting 00:03:02 (2341): No heartbeat from core client for 30 sec - exiting 00:03:03 (2341): No heartbeat from core client for 30 sec - exiting 00:03:04 (2341): No heartbeat from core client for 30 sec - exiting 00:03:05 (2341): No heartbeat from core client for 30 sec - exiting 00:03:06 (2341): No heartbeat from core client for 30 sec - exiting 00:03:07 (2341): No heartbeat from core client for 30 sec - exiting 00:03:08 (2341): No heartbeat from core client for 30 sec - exiting 00:03:09 (2341): No heartbeat from core client for 30 sec - exiting 00:03:10 (2341): No heartbeat from core client for 30 sec - exiting 00:03:11 (2341): No heartbeat from core client for 30 sec - exiting 00:03:12 (2341): No heartbeat from core client for 30 sec - exiting 00:03:13 (2341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:05:07 (2486): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:53 (2539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:14:02 (3101): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:16:52 (3209): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:23:40 (3272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=1 Model crash detected, will try to restart... 00:32:33 (3356): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:15 (3463): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:34:17 (3463): No heartbeat from core client for 30 sec - exiting 00:37:34 (3500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:39:26 (3543): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:24 (3583): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3625, iMonCtr=1 Model crash detected, will try to restart... 00:49:40 (3625): No heartbeat from core client for 30 sec - exiting 00:49:41 (3625): No heartbeat from core client for 30 sec - exiting 00:49:42 (3625): No heartbeat from core client for 30 sec - exiting 00:49:43 (3625): No heartbeat from core client for 30 sec - exiting 00:49:44 (3625): No heartbeat from core client for 30 sec - exiting 00:49:45 (3625): No heartbeat from core client for 30 sec - exiting 00:49:46 (3625): No heartbeat from core client for 30 sec - exiting 00:49:47 (3625): No heartbeat from core client for 30 sec - exiting 00:49:48 (3625): No heartbeat from core client for 30 sec - exiting 00:49:49 (3625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:52:35 (3697): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:58:53 (3736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:47:41 (3794): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:49:31 (4167): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:33:32 (4205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:04 (4205): No heartbeat from core client for 30 sec - exiting 02:34:05 (4205): No heartbeat from core client for 30 sec - exiting 02:38:28 (5085): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:19 (5085): No heartbeat from core client for 30 sec - exiting 02:43:52 (5135): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:13:33 (5187): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:18:34 (5413): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:40 (5483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:23:44 (5483): No heartbeat from core client for 30 sec - exiting 03:25:42 (5546): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:40 (5587): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:28:43 (5587): No heartbeat from core client for 30 sec - exiting 03:30:46 (5627): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:40:12 (5677): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:42 (5758): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... * glibc detected * ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: free(): invalid next size (normal): 0x09968e88 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6efe1)[0xf7570fe1] /lib32/libc.so.6(+0x70868)[0xf7572868] /lib32/libc.so.6(cfree+0x6d)[0xf75759ad] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7763a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7763aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7518bf6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 09:01 262689 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 09:01 262689 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 098ab000-099a5000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7085000-f7500000 rw-s 00000000 09:01 131937 /var/lib/boinc-client/slots/7/136235 f7500000-f7502000 rw-p 00000000 00:00 0 f7502000-f765c000 r-xp 00000000 09:01 262916 /lib32/libc-2.11.1.so f765c000-f765d000 ---p 0015a000 09:01 262916 /lib32/libc-2.11.1.so f765d000-f765f000 r--p 0015a000 09:01 262916 /lib32/libc-2.11.1.so f765f000-f7660000 rw-p 0015c000 09:01 262916 /lib32/libc-2.11.1.so f7660000-f7663000 rw-p 00000000 00:00 0 f7663000-f7680000 r-xp 00000000 09:01 821291 /usr/lib32/libgcc_s.so.1 f7680000-f7681000 r--p 0001c000 09:01 821291 /usr/lib32/libgcc_s.so.1 f7681000-f7682000 rw-p 0001d000 09:01 821291 /usr/lib32/libgcc_s.so.1 f7682000-f76a6000 r-xp 00000000 09:01 262921 /lib32/libm-2.11.1.so f76a6000-f76a7000 r--p 00023000 09:01 262921 /lib32/libm-2.11.1.so f76a7000-f76a8000 rw-p 00024000 09:01 262921 /lib32/libm-2.11.1.so f76a8000-f7791000 r-xp 00000000 09:01 821289 /usr/lib32/libstdc++.so.6.0.13 f7791000-f7795000 r--p 000e9000 09:01 821289 /usr/lib32/libstdc++.so.6.0.13 f7795000-f7796000 rw-p 000ed000 09:01 821289 /usr/lib32/libstdc++.so.6.0.13 f7796000-f779d000 rw-p 00000000 00:00 0 f779d000-f779f000 r-xp 00000000 09:01 262911 /lib32/libdl-2.11.1.so f779f000-f77a0000 r--p 00001000 09:01 262911 /lib32/libdl-2.11.1.so f77a0000-f77a1000 rw-p 00002000 09:01 262911 /lib32/libdl-2.11.1.so f77a1000-f77a2000 rw-p 00000000 00:00 0 f77a2000-f77b7000 r-xp 00000000 09:01 262907 /lib32/libpthread-2.11.1.so f77b7000-f77b8000 r--p 00014000 09:01 262907 /lib32/libpthread-2.11.1.so f77b8000-f77b9000 rw-p 00015000 09:01 262907 /lib32/libpthread-2.11.1.so f77b9000-f77bb000 rw-p 00000000 00:00 0 f77cf000-f77d0000 rw-p 00000000 00:00 0 f77d0000-f77d1000 ---p 00000000 00:00 0 f77d1000-f77d4000 rw-p 00000000 00:00 0 f77d4000-f77d6000 rw-s 00000000 09:01 135472 /var/lib/boinc-client/slots/7/boinc_mmap_file f77d6000-f77d8000 rw-p 00000000 00:00 0 f77d8000-f77d9000 r-xp 00000000 00:00 0 [vdso] f77d9000-f77f5000 r-xp 00000000 09:01 262912 /lib32/ld-2.11.1.so f77f5000-f77f6000 r--p 0001b000 09:01 262912 /lib32/ld-2.11.1.so f77f6000-f77f7000 rw-p 0001c000 09:01 262912 /lib32/ld-2.11.1.so ffd5b000-ffdcb000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77d8400] [0xf77d8430] /lib32/libc.so.6(gsignal+0x51)[0xf752c971] /lib32/libc.so.6(abort+0x182)[0xf752fda2] /lib32/libc.so.6(+0x64eed)[0xf7566eed] /lib32/libc.so.6(+0x6efe1)[0xf7570fe1] /lib32/libc.so.6(+0x70868)[0xf7572868] /lib32/libc.so.6(cfree+0x6d)[0xf75759ad] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf7763a91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf7763aed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7518bf6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
25 Mar 2014 11:36:35	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	259,200	563,434	2.1737
24 Mar 2014 01:01:41	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	233,280	513,959	2.2032
22 Mar 2014 21:32:10	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	207,360	464,278	2.2390
21 Mar 2014 06:20:02	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	181,440	407,763	2.2474
19 Mar 2014 12:02:07	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	155,520	348,669	2.2420
17 Mar 2014 08:55:25	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	129,600	290,612	2.2424
16 Mar 2014 06:46:46	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	103,680	231,932	2.2370
12 Mar 2014 12:38:49	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	77,760	174,027	2.2380
11 Mar 2014 10:45:23	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	51,840	117,166	2.2601
08 Mar 2014 12:25:59	1171203	16347752	hadcm3n_86go_1980_40_008514879_4	25,920	59,035	2.2776