Name | hadcm3n_3f1m_1940_40_008258495_0 |
Workunit | 8413619 |
Created | 20 Dec 2012, 11:05:55 UTC |
Sent | 20 Dec 2012, 11:06:02 UTC |
Report deadline | 21 Mar 2013, 18:33:13 UTC |
Received | 29 Jan 2013, 14:19:46 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1087624 |
Run time | 16 days 2 hours 41 min 45 sec |
CPU time | 15 days 20 hours 5 min 19 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 3.13 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> 19:31:38 (8104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7892, iMonCtr=1 Model crash detected, will try to restart... 10:42:28 (7804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6336, iMonCtr=1 Model crash detected, will try to restart... 22:19:21 (5964): No heartbeat from core client for 30 sec - exiting 22:19:22 (5964): No heartbeat from core client for 30 sec - exiting 22:19:23 (5964): No heartbeat from core client for 30 sec - exiting 22:19:24 (5964): No heartbeat from core client for 30 sec - exiting 22:19:25 (5964): No heartbeat from core client for 30 sec - exiting 22:19:26 (5964): No heartbeat from core client for 30 sec - exiting 22:19:27 (5964): No heartbeat from core client for 30 sec - exiting 22:19:28 (5964): No heartbeat from core client for 30 sec - exiting 22:19:29 (5964): No heartbeat from core client for 30 sec - exiting 22:19:30 (5964): No heartbeat from core client for 30 sec - exiting 22:19:31 (5964): No heartbeat from core client for 30 sec - exiting 22:19:32 (5964): No heartbeat from core client for 30 sec - exiting 22:19:33 (5964): No heartbeat from core client for 30 sec - exiting 22:19:34 (5964): No heartbeat from core client for 30 sec - exiting 22:19:35 (5964): No heartbeat from core client for 30 sec - exiting 22:19:36 (5964): No heartbeat from core client for 30 sec - exiting 22:19:37 (5964): No heartbeat from core client for 30 sec - exiting 22:19:38 (5964): No heartbeat from core client for 30 sec - exiting 22:19:39 (5964): No heartbeat from core client for 30 sec - exiting 22:19:40 (5964): No heartbeat from core client for 30 sec - exiting 22:19:41 (5964): No heartbeat from core client for 30 sec - exiting 22:19:42 (5964): No heartbeat from core client for 30 sec - exiting 22:19:43 (5964): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:56:00 (8056): No heartbeat from core client for 30 sec - exiting 13:56:01 (8056): No heartbeat from core client for 30 sec - exiting 13:56:02 (8056): No heartbeat from core client for 30 sec - exiting 13:56:03 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:39:45 (6312): No heartbeat from core client for 30 sec - exiting 18:39:46 (6312): No heartbeat from core client for 30 sec - exiting 18:39:47 (6312): No heartbeat from core client for 30 sec - exiting 18:39:48 (6312): No heartbeat from core client for 30 sec - exiting 18:39:49 (6312): No heartbeat from core client for 30 sec - exiting 18:39:50 (6312): No heartbeat from core client for 30 sec - exiting 18:39:51 (6312): No heartbeat from core client for 30 sec - exiting 18:39:52 (6312): No heartbeat from core client for 30 sec - exiting 18:39:53 (6312): No heartbeat from core client for 30 sec - exiting 18:39:54 (6312): No heartbeat from core client for 30 sec - exiting 18:39:55 (6312): No heartbeat from core client for 30 sec - exiting 18:39:56 (6312): No heartbeat from core client for 30 sec - exiting 18:39:57 (6312): No heartbeat from core client for 30 sec - exiting 18:39:58 (6312): No heartbeat from core client for 30 sec - exiting 18:39:59 (6312): No heartbeat from core client for 30 sec - exiting 18:40:00 (6312): No heartbeat from core client for 30 sec - exiting 18:40:01 (6312): No heartbeat from core client for 30 sec - exiting 18:40:02 (6312): No heartbeat from core client for 30 sec - exiting 18:40:03 (6312): No heartbeat from core client for 30 sec - exiting 18:40:04 (6312): No heartbeat from core client for 30 sec - exiting 18:40:05 (6312): No heartbeat from core client for 30 sec - exiting 18:40:06 (6312): No heartbeat from core client for 30 sec - exiting 18:40:07 (6312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:40:08 (6312): No heartbeat from core client for 30 sec - exiting 13:46:41 (4036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:32:54 (6908): No heartbeat from core client for 30 sec - exiting 17:32:55 (6908): No heartbeat from core client for 30 sec - exiting 17:32:56 (6908): No heartbeat from core client for 30 sec - exiting 17:32:57 (6908): No heartbeat from core client for 30 sec - exiting 17:32:58 (6908): No heartbeat from core client for 30 sec - exiting 17:32:59 (6908): No heartbeat from core client for 30 sec - exiting 17:33:00 (6908): No heartbeat from core client for 30 sec - exiting 17:33:01 (6908): No heartbeat from core client for 30 sec - exiting 17:33:02 (6908): No heartbeat from core client for 30 sec - exiting 17:33:03 (6908): No heartbeat from core client for 30 sec - exiting 17:33:04 (6908): No heartbeat from core client for 30 sec - exiting 17:33:05 (6908): No heartbeat from core client for 30 sec - exiting 17:33:06 (6908): No heartbeat from core client for 30 sec - exiting 17:33:07 (6908): No heartbeat from core client for 30 sec - exiting 17:33:08 (6908): No heartbeat from core client for 30 sec - exiting 17:33:09 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:33:10 (6908): No heartbeat from core client for 30 sec - exiting 19:15:25 (2340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:02:30 (7932): No heartbeat from core client for 30 sec - exiting 11:02:31 (7932): No heartbeat from core client for 30 sec - exiting 11:02:32 (7932): No heartbeat from core client for 30 sec - exiting 11:02:33 (7932): No heartbeat from core client for 30 sec - exiting 11:02:34 (7932): No heartbeat from core client for 30 sec - exiting 11:02:35 (7932): No heartbeat from core client for 30 sec - exiting 11:02:36 (7932): No heartbeat from core client for 30 sec - exiting 11:02:37 (7932): No heartbeat from core client for 30 sec - exiting 11:02:38 (7932): No heartbeat from core client for 30 sec - exiting 11:02:39 (7932): No heartbeat from core client for 30 sec - exiting 11:02:40 (7932): No heartbeat from core client for 30 sec - exiting 11:02:41 (7932): No heartbeat from core client for 30 sec - exiting 11:02:42 (7932): No heartbeat from core client for 30 sec - exiting 11:02:43 (7932): No heartbeat from core client for 30 sec - exiting 11:02:44 (7932): No heartbeat from core client for 30 sec - exiting 11:02:45 (7932): No heartbeat from core client for 30 sec - exiting 11:02:46 (7932): No heartbeat from core client for 30 sec - exiting 11:02:47 (7932): No heartbeat from core client for 30 sec - exiting 11:02:48 (7932): No heartbeat from core client for 30 sec - exiting 11:02:49 (7932): No heartbeat from core client for 30 sec - exiting 11:02:50 (7932): No heartbeat from core client for 30 sec - exiting 11:02:51 (7932): No heartbeat from core client for 30 sec - exiting 11:02:52 (7932): No heartbeat from core client for 30 sec - exiting 11:02:53 (7932): No heartbeat from core client for 30 sec - exiting 11:02:54 (7932): No heartbeat from core client for 30 sec - exiting 11:02:55 (7932): No heartbeat from core client for 30 sec - exiting 11:02:56 (7932): No heartbeat from core client for 30 sec - exiting 11:02:57 (7932): No heartbeat from core client for 30 sec - exiting 11:02:58 (7932): No heartbeat from core client for 30 sec - exiting 11:02:59 (7932): No heartbeat from core client for 30 sec - exiting 11:03:00 (7932): No heartbeat from core client for 30 sec - exiting 11:03:01 (7932): No heartbeat from core client for 30 sec - exiting 11:03:02 (7932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:14:48 (8056): No heartbeat from core client for 30 sec - exiting 11:14:49 (8056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:26:29 (2840): No heartbeat from core client for 30 sec - exiting 14:26:30 (2840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:04 (6812): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:31:45 (2436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:02 (7560): No heartbeat from core client for 30 sec - exiting 11:12:03 (7560): No heartbeat from core client for 30 sec - exiting 11:12:04 (7560): No heartbeat from core client for 30 sec - exiting 11:12:05 (7560): No heartbeat from core client for 30 sec - exiting 11:12:06 (7560): No heartbeat from core client for 30 sec - exiting 11:12:07 (7560): No heartbeat from core client for 30 sec - exiting 11:12:08 (7560): No heartbeat from core client for 30 sec - exiting 11:12:09 (7560): No heartbeat from core client for 30 sec - exiting 11:12:10 (7560): No heartbeat from core client for 30 sec - exiting 11:12:11 (7560): No heartbeat from core client for 30 sec - exiting 11:12:12 (7560): No heartbeat from core client for 30 sec - exiting 11:12:13 (7560): No heartbeat from core client for 30 sec - exiting 11:12:14 (7560): No heartbeat from core client for 30 sec - exiting 11:12:15 (7560): No heartbeat from core client for 30 sec - exiting 11:12:16 (7560): No heartbeat from core client for 30 sec - exiting 11:12:17 (7560): No heartbeat from core client for 30 sec - exiting 11:12:18 (7560): No heartbeat from core client for 30 sec - exiting 11:12:19 (7560): No heartbeat from core client for 30 sec - exiting 11:12:20 (7560): No heartbeat from core client for 30 sec - exiting 11:12:21 (7560): No heartbeat from core client for 30 sec - exiting 11:12:22 (7560): No heartbeat from core client for 30 sec - exiting 11:12:23 (7560): No heartbeat from core client for 30 sec - exiting 11:12:24 (7560): No heartbeat from core client for 30 sec - exiting 11:12:25 (7560): No heartbeat from core client for 30 sec - exiting 11:12:26 (7560): No heartbeat from core client for 30 sec - exiting 11:12:27 (7560): No heartbeat from core client for 30 sec - exiting 11:12:28 (7560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:53 (7092): No heartbeat from core client for 30 sec - exiting 19:32:54 (7092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:34:28 (6596): No heartbeat from core client for 30 sec - exiting 17:34:29 (6596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:40 (6276): No heartbeat from core client for 30 sec - exiting 10:22:41 (6276): No heartbeat from core client for 30 sec - exiting 10:22:42 (6276): No heartbeat from core client for 30 sec - exiting 10:22:43 (6276): No heartbeat from core client for 30 sec - exiting 10:22:44 (6276): No heartbeat from core client for 30 sec - exiting 10:22:45 (6276): No heartbeat from core client for 30 sec - exiting 10:22:46 (6276): No heartbeat from core client for 30 sec - exiting 10:22:47 (6276): No heartbeat from core client for 30 sec - exiting 10:22:48 (6276): No heartbeat from core client for 30 sec - exiting 10:22:49 (6276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:23:56 (7704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:17 (4264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:49:18 (4264): No heartbeat from core client for 30 sec - exiting 19:37:30 (8148): No heartbeat from core client for 30 sec - exiting 19:37:31 (8148): No heartbeat from core client for 30 sec - exiting 19:37:32 (8148): No heartbeat from core client for 30 sec - exiting 19:37:33 (8148): No heartbeat from core client for 30 sec - exiting 19:37:34 (8148): No heartbeat from core client for 30 sec - exiting 19:37:35 (8148): No heartbeat from core client for 30 sec - exiting 19:37:36 (8148): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:29:05 (6760): No heartbeat from core client for 30 sec - exiting 09:29:06 (6760): No heartbeat from core client for 30 sec - exiting 09:29:07 (6760): No heartbeat from core client for 30 sec - exiting 09:29:08 (6760): No heartbeat from core client for 30 sec - exiting 09:29:09 (6760): No heartbeat from core client for 30 sec - exiting 09:29:10 (6760): No heartbeat from core client for 30 sec - exiting 09:29:11 (6760): No heartbeat from core client for 30 sec - exiting 09:29:12 (6760): No heartbeat from core client for 30 sec - exiting 09:29:13 (6760): No heartbeat from core client for 30 sec - exiting 09:29:14 (6760): No heartbeat from core client for 30 sec - exiting 09:29:15 (6760): No heartbeat from core client for 30 sec - exiting 09:29:16 (6760): No heartbeat from core client for 30 sec - exiting 09:29:17 (6760): No heartbeat from core client for 30 sec - exiting 09:29:18 (6760): No heartbeat from core client for 30 sec - exiting 09:29:19 (6760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:51 (4268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:56 (7036): No heartbeat from core client for 30 sec - exiting 11:24:57 (7036): No heartbeat from core client for 30 sec - exiting 11:24:58 (7036): No heartbeat from core client for 30 sec - exiting 11:24:59 (7036): No heartbeat from core client for 30 sec - exiting 11:25:00 (7036): No heartbeat from core client for 30 sec - exiting 11:25:01 (7036): No heartbeat from core client for 30 sec - exiting 11:25:02 (7036): No heartbeat from core client for 30 sec - exiting 11:25:03 (7036): No heartbeat from core client for 30 sec - exiting 11:25:04 (7036): No heartbeat from core client for 30 sec - exiting 11:25:05 (7036): No heartbeat from core client for 30 sec - exiting 11:25:06 (7036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3172, iMonCtr=1 Model crash detected, will try to restart... 17:40:47 (6632): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:16 (4864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:51:26 (4864): No heartbeat from core client for 30 sec - exiting 00:52:17 (10284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6168, iMonCtr=1 Model crash detected, will try to restart... 18:30:06 (4728): No heartbeat from core client for 30 sec - exiting 18:30:07 (4728): No heartbeat from core client for 30 sec - exiting 18:30:08 (4728): No heartbeat from core client for 30 sec - exiting 18:30:09 (4728): No heartbeat from core client for 30 sec - exiting 18:30:10 (4728): No heartbeat from core client for 30 sec - exiting 18:30:11 (4728): No heartbeat from core client for 30 sec - exiting 18:30:12 (4728): No heartbeat from core client for 30 sec - exiting 18:30:13 (4728): No heartbeat from core client for 30 sec - exiting 18:30:14 (4728): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:20 (6380): No heartbeat from core client for 30 sec - exiting 09:48:21 (6380): No heartbeat from core client for 30 sec - exiting 09:48:22 (6380): No heartbeat from core client for 30 sec - exiting 09:48:23 (6380): No heartbeat from core client for 30 sec - exiting 09:48:24 (6380): No heartbeat from core client for 30 sec - exiting 09:48:25 (6380): No heartbeat from core client for 30 sec - exiting 09:48:26 (6380): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 11:40:26 (8120): No heartbeat from core client for 30 sec - exiting 11:40:27 (8120): No heartbeat from core client for 30 sec - exiting 11:40:28 (8120): No heartbeat from core client for 30 sec - exiting 11:40:29 (8120): No heartbeat from core client for 30 sec - exiting 11:40:30 (8120): No heartbeat from core client for 30 sec - exiting 11:40:31 (8120): No heartbeat from core client for 30 sec - exiting 11:40:32 (8120): No heartbeat from core client for 30 sec - exiting 11:40:33 (8120): No heartbeat from core client for 30 sec - exiting 11:40:34 (8120): No heartbeat from core client for 30 sec - exiting 11:40:35 (8120): No heartbeat from core client for 30 sec - exiting 11:40:36 (8120): No heartbeat from core client for 30 sec - exiting 11:40:37 (8120): No heartbeat from core client for 30 sec - exiting 11:40:38 (8120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:40:07 (29988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:59:34 (900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:27 (3996): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:44:28 (3996): No heartbeat from core client for 30 sec - exiting 20:17:23 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3348, iMonCtr=1 Model crash detected, will try to restart... 08:56:51 (7400): No heartbeat from core client for 30 sec - exiting 08:56:52 (7400): No heartbeat from core client for 30 sec - exiting 08:56:53 (7400): No heartbeat from core client for 30 sec - exiting 08:56:54 (7400): No heartbeat from core client for 30 sec - exiting 08:56:55 (7400): No heartbeat from core client for 30 sec - exiting 08:56:56 (7400): No heartbeat from core client for 30 sec - exiting 08:56:57 (7400): No heartbeat from core client for 30 sec - exiting 08:56:58 (7400): No heartbeat from core client for 30 sec - exiting 08:56:59 (7400): No heartbeat from core client for 30 sec - exiting 08:57:00 (7400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:57:01 (7400): No heartbeat from core client for 30 sec - exiting 08:57:02 (7400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 09:07:37 (7044): No heartbeat from core client for 30 sec - exiting 09:07:39 (7044): No heartbeat from core client for 30 sec - exiting 09:07:40 (7044): No heartbeat from core client for 30 sec - exiting 09:07:41 (7044): No heartbeat from core client for 30 sec - exiting 09:07:42 (7044): No heartbeat from core client for 30 sec - exiting 09:07:43 (7044): No heartbeat from core client for 30 sec - exiting 09:07:44 (7044): No heartbeat from core client for 30 sec - exiting 09:07:45 (7044): No heartbeat from core client for 30 sec - exiting 09:07:46 (7044): No heartbeat from core client for 30 sec - exiting 09:07:47 (7044): No heartbeat from core client for 30 sec - exiting 09:07:48 (7044): No heartbeat from core client for 30 sec - exiting 09:07:49 (7044): No heartbeat from core client for 30 sec - exiting 09:07:50 (7044): No heartbeat from core client for 30 sec - exiting 09:07:51 (7044): No heartbeat from core client for 30 sec - exiting 09:07:52 (7044): No heartbeat from core client for 30 sec - exiting 09:07:53 (7044): No heartbeat from core client for 30 sec - exiting 09:07:54 (7044): No heartbeat from core client for 30 sec - exiting 09:07:55 (7044): No heartbeat from core client for 30 sec - exiting 09:07:56 (7044): No heartbeat from core client for 30 sec - exiting 09:07:57 (7044): No heartbeat from core client for 30 sec - exiting 09:07:58 (7044): No heartbeat from core client for 30 sec - exiting 09:07:59 (7044): No heartbeat from core client for 30 sec - exiting 09:08:00 (7044): No heartbeat from core client for 30 sec - exiting 09:08:01 (7044): No heartbeat from core client for 30 sec - exiting 09:08:02 (7044): No heartbeat from core client for 30 sec - exiting 09:08:03 (7044): No heartbeat from core client for 30 sec - exiting 09:08:04 (7044): No heartbeat from core client for 30 sec - exiting 09:08:05 (7044): No heartbeat from core client for 30 sec - exiting 09:08:06 (7044): No heartbeat from core client for 30 sec - exiting 09:08:07 (7044): No heartbeat from core client for 30 sec - exiting 09:08:08 (7044): No heartbeat from core client for 30 sec - exiting 09:08:09 (7044): No heartbeat from core client for 30 sec - exiting 09:08:10 (7044): No heartbeat from core client for 30 sec - exiting 09:08:11 (7044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:08:12 (7044): No heartbeat from core client for 30 sec - exiting Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5264, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2892, iMonCtr=1 Model crash detected, will try to restart... 08:56:32 (7800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4264, iMonCtr=1 Model crash detected, will try to restart... 13:26:48 (7660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8116, iMonCtr=1 Model crash detected, will try to restart... 00:25:30 (8116): No heartbeat from core client for 30 sec - exiting 12:23:34 (8080): No heartbeat from core client for 30 sec - exiting 12:23:35 (8080): No heartbeat from core client for 30 sec - exiting 12:23:36 (8080): No heartbeat from core client for 30 sec - exiting 12:23:37 (8080): No heartbeat from core client for 30 sec - exiting 12:23:38 (8080): No heartbeat from core client for 30 sec - exiting 12:23:39 (8080): No heartbeat from core client for 30 sec - exiting 12:23:40 (8080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:45 (7100): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:48:09 (7720): No heartbeat from core client for 30 sec - exiting 13:48:10 (7720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8164, iMonCtr=1 Model crash detected, will try to restart... 16:04:31 (7924): No heartbeat from core client for 30 sec - exiting 16:04:33 (7924): No heartbeat from core client for 30 sec - exiting 16:04:34 (7924): No heartbeat from core client for 30 sec - exiting 16:04:35 (7924): No heartbeat from core client for 30 sec - exiting 16:04:36 (7924): No heartbeat from core client for 30 sec - exiting 16:04:37 (7924): No heartbeat from core client for 30 sec - exiting 16:04:38 (7924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:04:39 (7924): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:22:01 (2880): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:26:32 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:42 (7416): No heartbeat from core client for 30 sec - exiting 08:11:43 (7416): No heartbeat from core client for 30 sec - exiting 08:11:44 (7416): No heartbeat from core client for 30 sec - exiting 08:11:45 (7416): No heartbeat from core client for 30 sec - exiting 08:11:46 (7416): No heartbeat from core client for 30 sec - exiting 08:11:47 (7416): No heartbeat from core client for 30 sec - exiting 08:11:48 (7416): No heartbeat from core client for 30 sec - exiting 08:11:49 (7416): No heartbeat from core client for 30 sec - exiting 08:11:50 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:17 (6252): No heartbeat from core client for 30 sec - exiting 14:13:18 (6252): No heartbeat from core client for 30 sec - exiting 14:13:19 (6252): No heartbeat from core client for 30 sec - exiting 14:13:20 (6252): No heartbeat from core client for 30 sec - exiting 14:13:21 (6252): No heartbeat from core client for 30 sec - exiting 14:13:22 (6252): No heartbeat from core client for 30 sec - exiting 14:13:23 (6252): No heartbeat from core client for 30 sec - exiting 14:13:24 (6252): No heartbeat from core client for 30 sec - exiting 14:13:26 (6252): No heartbeat from core client for 30 sec - exiting 14:13:27 (6252): No heartbeat from core client for 30 sec - exiting 14:13:28 (6252): No heartbeat from core client for 30 sec - exiting 14:13:29 (6252): No heartbeat from core client for 30 sec - exiting 14:13:30 (6252): No heartbeat from core client for 30 sec - exiting 14:13:31 (6252): No heartbeat from core client for 30 sec - exiting 14:13:32 (6252): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:33 (6252): No heartbeat from core client for 30 sec - exiting 12:04:12 (7552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:17 (7140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:40:14 (5476): No heartbeat from core client for 30 sec - exiting 12:40:15 (5476): No heartbeat from core client for 30 sec - exiting 12:40:16 (5476): No heartbeat from core client for 30 sec - exiting 12:40:17 (5476): No heartbeat from core client for 30 sec - exiting 12:40:18 (5476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:25:14 (7236): No heartbeat from core client for 30 sec - exiting 12:25:15 (7236): No heartbeat from core client for 30 sec - exiting 12:25:16 (7236): No heartbeat from core client for 30 sec - exiting 12:25:17 (7236): No heartbeat from core client for 30 sec - exiting 12:25:18 (7236): No heartbeat from core client for 30 sec - exiting 12:25:19 (7236): No heartbeat from core client for 30 sec - exiting 12:25:20 (7236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:22 (8068): No heartbeat from core client for 30 sec - exiting 14:25:23 (8068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:42:44 (7572): No heartbeat from core client for 30 sec - exiting 15:42:45 (7572): No heartbeat from core client for 30 sec - exiting 15:42:46 (7572): No heartbeat from core client for 30 sec - exiting 15:42:47 (7572): No heartbeat from core client for 30 sec - exiting 15:42:48 (7572): No heartbeat from core client for 30 sec - exiting 15:42:49 (7572): No heartbeat from core client for 30 sec - exiting 15:42:50 (7572): No heartbeat from core client for 30 sec - exiting 15:42:51 (7572): No heartbeat from core client for 30 sec - exiting 15:42:52 (7572): No heartbeat from core client for 30 sec - exiting 15:42:53 (7572): No heartbeat from core client for 30 sec - exiting 15:42:54 (7572): No heartbeat from core client for 30 sec - exiting 15:42:55 (7572): No heartbeat from core client for 30 sec - exiting 15:42:56 (7572): No heartbeat from core client for 30 sec - exiting 15:42:57 (7572): No heartbeat from core client for 30 sec - exiting 15:42:58 (7572): No heartbeat from core client for 30 sec - exiting 15:42:59 (7572): No heartbeat from core client for 30 sec - exiting 15:43:00 (7572): No heartbeat from core client for 30 sec - exiting 15:43:01 (7572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:39:27 (7760): No heartbeat from core client for 30 sec - exiting 19:39:28 (7760): No heartbeat from core client for 30 sec - exiting 19:39:29 (7760): No heartbeat from core client for 30 sec - exiting 19:39:30 (7760): No heartbeat from core client for 30 sec - exiting 19:39:31 (7760): No heartbeat from core client for 30 sec - exiting 19:39:32 (7760): No heartbeat from core client for 30 sec - exiting 19:39:33 (7760): No heartbeat from core client for 30 sec - exiting 19:39:34 (7760): No heartbeat from core client for 30 sec - exiting 19:39:35 (7760): No heartbeat from core client for 30 sec - exiting 19:39:36 (7760): No heartbeat from core client for 30 sec - exiting 19:39:37 (7760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:01 (2240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4392, iMonCtr=1 Model crash detected, will try to restart... 19:20:33 (4120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:31:49 (5884): No heartbeat from core client for 30 sec - exiting 23:31:50 (5884): No heartbeat from core client for 30 sec - exiting 23:31:51 (5884): No heartbeat from core client for 30 sec - exiting 23:31:52 (5884): No heartbeat from core client for 30 sec - exiting 23:31:53 (5884): No heartbeat from core client for 30 sec - exiting 23:31:54 (5884): No heartbeat from core client for 30 sec - exiting 23:31:55 (5884): No heartbeat from core client for 30 sec - exiting 23:31:56 (5884): No heartbeat from core client for 30 sec - exiting 23:31:57 (5884): No heartbeat from core client for 30 sec - exiting 23:31:58 (5884): No heartbeat from core client for 30 sec - exiting 23:31:59 (5884): No heartbeat from core client for 30 sec - exiting 23:32:00 (5884): No heartbeat from core client for 30 sec - exiting 23:32:01 (5884): No heartbeat from core client for 30 sec - exiting 23:32:02 (5884): No heartbeat from core client for 30 sec - exiting 23:32:03 (5884): No heartbeat from core client for 30 sec - exiting 23:32:04 (5884): No heartbeat from core client for 30 sec - exiting 23:32:05 (5884): No heartbeat from core client for 30 sec - exiting 23:32:06 (5884): No heartbeat from core client for 30 sec - exiting 23:32:07 (5884): No heartbeat from core client for 30 sec - exiting 23:32:08 (5884): No heartbeat from core client for 30 sec - exiting 23:32:09 (5884): No heartbeat from core client for 30 sec - exiting 23:32:10 (5884): No heartbeat from core client for 30 sec - exiting 23:32:11 (5884): No heartbeat from core client for 30 sec - exiting 23:32:12 (5884): No heartbeat from core client for 30 sec - exiting 23:32:13 (5884): No heartbeat from core client for 30 sec - exiting 23:32:14 (5884): No heartbeat from core client for 30 sec - exiting 23:32:15 (5884): No heartbeat from core client for 30 sec - exiting 23:32:16 (5884): No heartbeat from core client for 30 sec - exiting 23:32:18 (5884): No heartbeat from core client for 30 sec - exiting 23:32:19 (5884): No heartbeat from core client for 30 sec - exiting 23:32:20 (5884): No heartbeat from core client for 30 sec - exiting 23:32:21 (5884): No heartbeat from core client for 30 sec - exiting 23:32:22 (5884): No heartbeat from core client for 30 sec - exiting 23:32:23 (5884): No heartbeat from core client for 30 sec - exiting 23:32:24 (5884): No heartbeat from core client for 30 sec - exiting 23:32:25 (5884): No heartbeat from core client for 30 sec - exiting 23:32:26 (5884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:32:27 (5884): No heartbeat from core client for 30 sec - exiting 23:32:28 (5884): No heartbeat from core client for 30 sec - exiting 23:32:29 (5884): No heartbeat from core client for 30 sec - exiting 23:33:22 (4364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:37:00 (8572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:39 (8144): No heartbeat from core client for 30 sec - exiting 09:10:40 (8144): No heartbeat from core client for 30 sec - exiting 09:10:41 (8144): No heartbeat from core client for 30 sec - exiting 09:10:42 (8144): No heartbeat from core client for 30 sec - exiting 09:10:43 (8144): No heartbeat from core client for 30 sec - exiting 09:10:44 (8144): No heartbeat from core client for 30 sec - exiting 09:10:45 (8144): No heartbeat from core client for 30 sec - exiting 09:10:46 (8144): No heartbeat from core client for 30 sec - exiting 09:10:47 (8144): No heartbeat from core client for 30 sec - exiting 09:10:48 (8144): No heartbeat from core client for 30 sec - exiting 09:10:49 (8144): No heartbeat from core client for 30 sec - exiting 09:10:50 (8144): No heartbeat from core client for 30 sec - exiting 09:10:51 (8144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5904, iMonCtr=1 Model crash detected, will try to restart... 12:46:17 (5868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 20:32:07 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 09:12:05 (7320): No heartbeat from core client for 30 sec - exiting 09:12:06 (7320): No heartbeat from core client for 30 sec - exiting 09:12:07 (7320): No heartbeat from core client for 30 sec - exiting 09:12:08 (7320): No heartbeat from core client for 30 sec - exiting 09:12:09 (7320): No heartbeat from core client for 30 sec - exiting 09:12:10 (7320): No heartbeat from core client for 30 sec - exiting 09:12:11 (7320): No heartbeat from core client for 30 sec - exiting 09:12:12 (7320): No heartbeat from core client for 30 sec - exiting 09:12:13 (7320): No heartbeat from core client for 30 sec - exiting 09:12:14 (7320): No heartbeat from core client for 30 sec - exiting 09:12:15 (7320): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 15:43:36 (2828): No heartbeat from core client for 30 sec - exiting 15:43:37 (2828): No heartbeat from core client for 30 sec - exiting 15:43:38 (2828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1120, iMonCtr=1 Model crash detected, will try to restart... 16:33:41 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:09:42 (5920): No heartbeat from core client for 30 sec - exiting 21:09:43 (5920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:24:52 (8144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:08 (8116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:51:49 (3460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:24:36 (7840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5708, iMonCtr=1 Model crash detected, will try to restart... 13:40:44 (5544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:00:38 (6460): No heartbeat from core client for 30 sec - exiting 17:00:40 (6460): No heartbeat from core client for 30 sec - exiting 17:00:41 (6460): No heartbeat from core client for 30 sec - exiting 17:00:42 (6460): No heartbeat from core client for 30 sec - exiting 17:00:43 (6460): No heartbeat from core client for 30 sec - exiting 17:00:44 (6460): No heartbeat from core client for 30 sec - exiting 17:00:45 (6460): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:28 (2544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:30:48 (3844): No heartbeat from core client for 30 sec - exiting 22:30:49 (3844): No heartbeat from core client for 30 sec - exiting 22:30:50 (3844): No heartbeat from core client for 30 sec - exiting 22:30:51 (3844): No heartbeat from core client for 30 sec - exiting 22:30:52 (3844): No heartbeat from core client for 30 sec - exiting 22:30:53 (3844): No heartbeat from core client for 30 sec - exiting 22:30:54 (3844): No heartbeat from core client for 30 sec - exiting 22:30:55 (3844): No heartbeat from core client for 30 sec - exiting 22:30:56 (3844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:07:12 (8084): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:21:55 (8128): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:24:27 (4260): No heartbeat from core client for 30 sec - exiting 11:24:28 (4260): No heartbeat from core client for 30 sec - exiting 11:24:29 (4260): No heartbeat from core client for 30 sec - exiting 11:24:30 (4260): No heartbeat from core client for 30 sec - exiting 11:24:31 (4260): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:27:30 (6436): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:13:56 (3884): No heartbeat from core client for 30 sec - exiting 19:13:57 (3884): No heartbeat from core client for 30 sec - exiting 19:13:58 (3884): No heartbeat from core client for 30 sec - exiting 19:13:59 (3884): No heartbeat from core client for 30 sec - exiting 19:14:00 (3884): No heartbeat from core client for 30 sec - exiting 19:14:01 (3884): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:22:43 (1316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:25:44 (5772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:01:05 (7684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:09:48 (7576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:10:02 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:22:45 (7848): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:12:48 (1308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
29 Jan 2013 14:20:22 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 518,400 | 1,368,316 | 2.6395 |
07 Jan 2013 13:46:08 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 492,480 | 647,477 | 1.3147 |
06 Jan 2013 14:07:19 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 466,560 | 612,764 | 1.3134 |
04 Jan 2013 20:15:05 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 440,640 | 578,845 | 1.3136 |
04 Jan 2013 10:45:44 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 414,720 | 545,384 | 1.3151 |
03 Jan 2013 14:30:41 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 388,800 | 510,298 | 1.3125 |
02 Jan 2013 16:57:06 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 362,880 | 476,323 | 1.3126 |
01 Jan 2013 21:37:08 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 336,960 | 443,048 | 1.3148 |
31 Dec 2012 20:32:13 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 311,040 | 409,054 | 1.3151 |
30 Dec 2012 23:16:19 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 285,120 | 375,367 | 1.3165 |
30 Dec 2012 10:59:59 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 259,200 | 341,539 | 1.3177 |
29 Dec 2012 09:05:27 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 233,280 | 307,837 | 1.3196 |
27 Dec 2012 17:27:24 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 207,360 | 274,269 | 1.3227 |
26 Dec 2012 22:57:13 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 181,440 | 240,526 | 1.3257 |
25 Dec 2012 19:33:58 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 155,520 | 206,272 | 1.3263 |
24 Dec 2012 13:05:20 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 129,600 | 171,394 | 1.3225 |
23 Dec 2012 17:20:12 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 103,680 | 137,432 | 1.3255 |
22 Dec 2012 17:56:31 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 77,760 | 102,557 | 1.3189 |
21 Dec 2012 16:37:28 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 51,840 | 68,941 | 1.3299 |
20 Dec 2012 21:04:49 | 1087624 | 15486039 | hadcm3n_3f1m_1940_40_008258495_0 | 25,920 | 34,586 | 1.3343 |
©2024 cpdn.org