Task 15773331

Name	hadcm3n_n53o_1920_40_008323582_3
Workunit	8474717
Created	10 May 2013, 18:50:14 UTC
Sent	10 May 2013, 18:59:29 UTC
Report deadline	10 Aug 2013, 2:26:40 UTC
Received	3 Sep 2013, 16:13:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1291528
Run time	2 days 17 hours 39 min 12 sec
CPU time	2 days 14 hours 35 min 37 sec
Validate state	Invalid
Credit	933.12
Device peak FLOPS	2.00 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.27</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> 00:59:35 (11560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:44 (11946): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:45 (11946): No heartbeat from core client for 30 sec - exiting 01:03:46 (11946): No heartbeat from core client for 30 sec - exiting 01:03:47 (11946): No heartbeat from core client for 30 sec - exiting 01:07:31 (12067): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:07 (12162): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:12:08 (12162): No heartbeat from core client for 30 sec - exiting 01:12:09 (12162): No heartbeat from core client for 30 sec - exiting 01:12:10 (12162): No heartbeat from core client for 30 sec - exiting 01:12:11 (12162): No heartbeat from core client for 30 sec - exiting 01:12:12 (12162): No heartbeat from core client for 30 sec - exiting 01:12:13 (12162): No heartbeat from core client for 30 sec - exiting 01:12:14 (12162): No heartbeat from core client for 30 sec - exiting 01:16:15 (12268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:16:16 (12268): No heartbeat from core client for 30 sec - exiting 01:16:17 (12268): No heartbeat from core client for 30 sec - exiting 01:16:18 (12268): No heartbeat from core client for 30 sec - exiting 01:16:19 (12268): No heartbeat from core client for 30 sec - exiting 01:16:20 (12268): No heartbeat from core client for 30 sec - exiting 01:16:21 (12268): No heartbeat from core client for 30 sec - exiting 01:20:14 (12358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:20:15 (12358): No heartbeat from core client for 30 sec - exiting 01:20:16 (12358): No heartbeat from core client for 30 sec - exiting 01:20:17 (12358): No heartbeat from core client for 30 sec - exiting 01:20:18 (12358): No heartbeat from core client for 30 sec - exiting 01:20:19 (12358): No heartbeat from core client for 30 sec - exiting 01:20:20 (12358): No heartbeat from core client for 30 sec - exiting 01:20:21 (12358): No heartbeat from core client for 30 sec - exiting 01:20:22 (12358): No heartbeat from core client for 30 sec - exiting 01:20:23 (12358): No heartbeat from core client for 30 sec - exiting 03:22:16 (12461): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:25 (12611): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:26 (12611): No heartbeat from core client for 30 sec - exiting 03:34:08 (12717): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:34:09 (12717): No heartbeat from core client for 30 sec - exiting 03:34:10 (12717): No heartbeat from core client for 30 sec - exiting 03:41:30 (12877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:45:27 (12962): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:26 (13045): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:27 (13045): No heartbeat from core client for 30 sec - exiting 03:49:28 (13045): No heartbeat from core client for 30 sec - exiting 03:49:29 (13045): No heartbeat from core client for 30 sec - exiting 03:49:30 (13045): No heartbeat from core client for 30 sec - exiting 03:49:31 (13045): No heartbeat from core client for 30 sec - exiting 03:49:32 (13045): No heartbeat from core client for 30 sec - exiting 03:49:33 (13045): No heartbeat from core client for 30 sec - exiting 03:49:34 (13045): No heartbeat from core client for 30 sec - exiting 03:49:35 (13045): No heartbeat from core client for 30 sec - exiting 03:49:36 (13045): No heartbeat from core client for 30 sec - exiting 03:49:37 (13045): No heartbeat from core client for 30 sec - exiting 03:49:38 (13045): No heartbeat from core client for 30 sec - exiting 03:53:27 (13129): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:28 (13129): No heartbeat from core client for 30 sec - exiting 03:53:29 (13129): No heartbeat from core client for 30 sec - exiting 03:53:30 (13129): No heartbeat from core client for 30 sec - exiting 03:53:31 (13129): No heartbeat from core client for 30 sec - exiting 04:20:45 (13209): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:36 (13340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:28:37 (13340): No heartbeat from core client for 30 sec - exiting 04:28:38 (13340): No heartbeat from core client for 30 sec - exiting 04:28:39 (13340): No heartbeat from core client for 30 sec - exiting 04:28:40 (13340): No heartbeat from core client for 30 sec - exiting 04:28:41 (13340): No heartbeat from core client for 30 sec - exiting 04:28:42 (13340): No heartbeat from core client for 30 sec - exiting 04:28:43 (13340): No heartbeat from core client for 30 sec - exiting 04:28:44 (13340): No heartbeat from core client for 30 sec - exiting 04:28:45 (13340): No heartbeat from core client for 30 sec - exiting 04:28:46 (13340): No heartbeat from core client for 30 sec - exiting 04:28:47 (13340): No heartbeat from core client for 30 sec - exiting 04:28:48 (13340): No heartbeat from core client for 30 sec - exiting 04:28:49 (13340): No heartbeat from core client for 30 sec - exiting 04:28:50 (13340): No heartbeat from core client for 30 sec - exiting 04:28:51 (13340): No heartbeat from core client for 30 sec - exiting 04:28:52 (13340): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 04:33:08 (13460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:09 (13460): No heartbeat from core client for 30 sec - exiting 04:33:10 (13460): No heartbeat from core client for 30 sec - exiting 04:33:11 (13460): No heartbeat from core client for 30 sec - exiting 04:33:12 (13460): No heartbeat from core client for 30 sec - exiting 04:33:13 (13460): No heartbeat from core client for 30 sec - exiting 04:33:14 (13460): No heartbeat from core client for 30 sec - exiting 04:33:15 (13460): No heartbeat from core client for 30 sec - exiting 04:36:45 (13552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:30 (13655): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:44:31 (13655): No heartbeat from core client for 30 sec - exiting 04:44:32 (13655): No heartbeat from core client for 30 sec - exiting 04:44:33 (13655): No heartbeat from core client for 30 sec - exiting 04:44:34 (13655): No heartbeat from core client for 30 sec - exiting 04:44:35 (13655): No heartbeat from core client for 30 sec - exiting 04:44:36 (13655): No heartbeat from core client for 30 sec - exiting 04:44:37 (13655): No heartbeat from core client for 30 sec - exiting 04:44:38 (13655): No heartbeat from core client for 30 sec - exiting 04:44:39 (13655): No heartbeat from core client for 30 sec - exiting 04:44:40 (13655): No heartbeat from core client for 30 sec - exiting 04:44:41 (13655): No heartbeat from core client for 30 sec - exiting 04:44:42 (13655): No heartbeat from core client for 30 sec - exiting 04:44:43 (13655): No heartbeat from core client for 30 sec - exiting 06:47:10 (13739): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:47:11 (13739): No heartbeat from core client for 30 sec - exiting 06:47:12 (13739): No heartbeat from core client for 30 sec - exiting 06:47:13 (13739): No heartbeat from core client for 30 sec - exiting 06:47:14 (13739): No heartbeat from core client for 30 sec - exiting 06:47:15 (13739): No heartbeat from core client for 30 sec - exiting 06:47:16 (13739): No heartbeat from core client for 30 sec - exiting 00:12:18 (13890): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:19 (13890): No heartbeat from core client for 30 sec - exiting 00:12:20 (13890): No heartbeat from core client for 30 sec - exiting 00:12:21 (13890): No heartbeat from core client for 30 sec - exiting 05:59:35 (14826): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:59:36 (14826): No heartbeat from core client for 30 sec - exiting 05:59:37 (14826): No heartbeat from core client for 30 sec - exiting 06:03:29 (15097): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:30 (15097): No heartbeat from core client for 30 sec - exiting 06:03:31 (15097): No heartbeat from core client for 30 sec - exiting 06:03:32 (15097): No heartbeat from core client for 30 sec - exiting 06:07:42 (15205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:18 (15336): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:58 (16000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:43 (16076): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:13:44 (16076): No heartbeat from core client for 30 sec - exiting 18:13:45 (16076): No heartbeat from core client for 30 sec - exiting 18:13:46 (16076): No heartbeat from core client for 30 sec - exiting 18:17:25 (16156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:17:26 (16156): No heartbeat from core client for 30 sec - exiting 18:17:27 (16156): No heartbeat from core client for 30 sec - exiting 18:17:28 (16156): No heartbeat from core client for 30 sec - exiting 18:17:29 (16156): No heartbeat from core client for 30 sec - exiting 18:17:30 (16156): No heartbeat from core client for 30 sec - exiting 18:17:31 (16156): No heartbeat from core client for 30 sec - exiting 18:17:32 (16156): No heartbeat from core client for 30 sec - exiting 18:17:33 (16156): No heartbeat from core client for 30 sec - exiting 18:17:34 (16156): No heartbeat from core client for 30 sec - exiting 18:17:35 (16156): No heartbeat from core client for 30 sec - exiting 18:17:36 (16156): No heartbeat from core client for 30 sec - exiting 18:17:37 (16156): No heartbeat from core client for 30 sec - exiting 18:17:38 (16156): No heartbeat from core client for 30 sec - exiting 18:17:39 (16156): No heartbeat from core client for 30 sec - exiting 18:17:40 (16156): No heartbeat from core client for 30 sec - exiting 18:17:41 (16156): No heartbeat from core client for 30 sec - exiting 18:17:42 (16156): No heartbeat from core client for 30 sec - exiting 18:21:14 (16239): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:15 (16239): No heartbeat from core client for 30 sec - exiting 18:21:16 (16239): No heartbeat from core client for 30 sec - exiting 18:21:17 (16239): No heartbeat from core client for 30 sec - exiting 18:21:18 (16239): No heartbeat from core client for 30 sec - exiting 18:21:19 (16239): No heartbeat from core client for 30 sec - exiting 18:21:20 (16239): No heartbeat from core client for 30 sec - exiting 18:21:21 (16239): No heartbeat from core client for 30 sec - exiting 18:21:22 (16239): No heartbeat from core client for 30 sec - exiting 18:21:23 (16239): No heartbeat from core client for 30 sec - exiting 18:21:24 (16239): No heartbeat from core client for 30 sec - exiting 18:21:25 (16239): No heartbeat from core client for 30 sec - exiting 18:21:26 (16239): No heartbeat from core client for 30 sec - exiting 18:25:12 (16319): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:25:13 (16319): No heartbeat from core client for 30 sec - exiting 18:25:14 (16319): No heartbeat from core client for 30 sec - exiting 18:25:15 (16319): No heartbeat from core client for 30 sec - exiting 18:25:16 (16319): No heartbeat from core client for 30 sec - exiting 18:25:17 (16319): No heartbeat from core client for 30 sec - exiting 18:25:18 (16319): No heartbeat from core client for 30 sec - exiting 18:25:19 (16319): No heartbeat from core client for 30 sec - exiting 18:25:20 (16319): No heartbeat from core client for 30 sec - exiting 18:25:21 (16319): No heartbeat from core client for 30 sec - exiting 18:25:22 (16319): No heartbeat from core client for 30 sec - exiting 18:25:23 (16319): No heartbeat from core client for 30 sec - exiting 18:25:24 (16319): No heartbeat from core client for 30 sec - exiting 18:25:25 (16319): No heartbeat from core client for 30 sec - exiting 18:25:26 (16319): No heartbeat from core client for 30 sec - exiting 18:25:27 (16319): No heartbeat from core client for 30 sec - exiting 18:25:28 (16319): No heartbeat from core client for 30 sec - exiting 18:25:29 (16319): No heartbeat from core client for 30 sec - exiting 18:25:30 (16319): No heartbeat from core client for 30 sec - exiting 18:25:31 (16319): No heartbeat from core client for 30 sec - exiting 18:25:32 (16319): No heartbeat from core client for 30 sec - exiting 18:25:33 (16319): No heartbeat from core client for 30 sec - exiting 18:25:34 (16319): No heartbeat from core client for 30 sec - exiting 18:29:06 (16399): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:55 (16479): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:32:56 (16479): No heartbeat from core client for 30 sec - exiting 18:32:57 (16479): No heartbeat from core client for 30 sec - exiting 18:32:58 (16479): No heartbeat from core client for 30 sec - exiting 18:32:59 (16479): No heartbeat from core client for 30 sec - exiting 18:33:00 (16479): No heartbeat from core client for 30 sec - exiting 18:33:01 (16479): No heartbeat from core client for 30 sec - exiting 18:33:02 (16479): No heartbeat from core client for 30 sec - exiting 18:33:03 (16479): No heartbeat from core client for 30 sec - exiting 18:33:04 (16479): No heartbeat from core client for 30 sec - exiting 18:33:05 (16479): No heartbeat from core client for 30 sec - exiting 18:33:06 (16479): No heartbeat from core client for 30 sec - exiting 18:33:07 (16479): No heartbeat from core client for 30 sec - exiting 18:33:08 (16479): No heartbeat from core client for 30 sec - exiting 18:33:09 (16479): No heartbeat from core client for 30 sec - exiting 18:33:10 (16479): No heartbeat from core client for 30 sec - exiting 18:33:11 (16479): No heartbeat from core client for 30 sec - exiting 18:33:12 (16479): No heartbeat from core client for 30 sec - exiting 18:33:13 (16479): No heartbeat from core client for 30 sec - exiting 18:36:45 (16569): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:33 (16649): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:19:55 (16709): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:21 (16870): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:23:22 (16870): No heartbeat from core client for 30 sec - exiting 22:23:23 (16870): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... 15:48:56 (3912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:48:58 (3912): No heartbeat from core client for 30 sec - exiting 15:48:59 (3912): No heartbeat from core client for 30 sec - exiting 16:23:11 (4294): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:23:12 (4294): No heartbeat from core client for 30 sec - exiting 16:23:13 (4294): No heartbeat from core client for 30 sec - exiting 16:23:14 (4294): No heartbeat from core client for 30 sec - exiting 16:23:15 (4294): No heartbeat from core client for 30 sec - exiting 16:39:50 (4821): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:09 (4931): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:10 (4931): No heartbeat from core client for 30 sec - exiting 16:42:11 (4931): No heartbeat from core client for 30 sec - exiting 16:42:12 (4931): No heartbeat from core client for 30 sec - exiting 16:42:13 (4931): No heartbeat from core client for 30 sec - exiting 16:42:14 (4931): No heartbeat from core client for 30 sec - exiting 16:42:15 (4931): No heartbeat from core client for 30 sec - exiting 16:42:16 (4931): No heartbeat from core client for 30 sec - exiting 16:42:17 (4931): No heartbeat from core client for 30 sec - exiting 16:42:18 (4931): No heartbeat from core client for 30 sec - exiting 16:42:19 (4931): No heartbeat from core client for 30 sec - exiting 16:42:20 (4931): No heartbeat from core client for 30 sec - exiting 16:42:21 (4931): No heartbeat from core client for 30 sec - exiting 16:42:22 (4931): No heartbeat from core client for 30 sec - exiting 16:42:23 (4931): No heartbeat from core client for 30 sec - exiting 16:42:24 (4931): No heartbeat from core client for 30 sec - exiting 16:42:25 (4931): No heartbeat from core client for 30 sec - exiting 16:48:20 (5041): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:50:59 (5143): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77b5400] [0xf77b5430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75d21df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75d5825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75bd4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf77ce400] [0xf77ce430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75eb1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75ee825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75d64d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf7754400] [0xf7754430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75711df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf7574825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf755c4d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf779b400] [0xf779b430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75b81df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75bb825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75a34d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf778f400] [0xf778f430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75ac1df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf75af825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75974d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] [0xf775b400] [0xf775b430] /lib/i386-linux-gnu/libc.so.6(gsignal+0x4f)[0xf75781df] /lib/i386-linux-gnu/libc.so.6(abort+0x175)[0xf757b825] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0xf75634d3] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5260, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 May 2013 05:01:28	1281428	15773331	hadcm3n_n53o_1920_40_008323582_3	77,760	182,920	2.3524
12 May 2013 10:46:42	1281428	15773331	hadcm3n_n53o_1920_40_008323582_3	51,840	123,740	2.3870
11 May 2013 15:45:50	1281428	15773331	hadcm3n_n53o_1920_40_008323582_3	25,920	61,816	2.3849