Name | hadcm3n_39id_2020_40_008390168_0 |
Workunit | 8541027 |
Created | 4 Jun 2013, 3:02:05 UTC |
Sent | 4 Jun 2013, 11:24:15 UTC |
Report deadline | 3 Sep 2013, 18:51:26 UTC |
Received | 3 Dec 2013, 21:14:24 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1269200 |
Run time | 12 days 20 hours 26 min 57 sec |
CPU time | 12 days 12 hours 4 min 16 sec |
Validate state | Invalid |
Credit | 7,153.92 |
Device peak FLOPS | 2.69 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:24:37 (25554): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:26:19 (5225): No heartbeat from core client for 30 sec - exiting 16:26:21 (5225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:44 (5292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:34:10 (5369): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:38:33 (5410): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:42:21 (5446): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:11 (5486): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:52:17 (5541): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:55:33 (5617): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:55:43 (5617): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 16:59:42 (5652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:05 (5734): No heartbeat from core client for 30 sec - exiting 17:02:11 (5734): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:12:22 (5781): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:44 (5888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:16:45 (5888): No heartbeat from core client for 30 sec - exiting 17:16:46 (5888): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 17:40:25 (5966): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:00:17 (6130): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:06:49 (6297): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:08:25 (6341): No heartbeat from core client for 30 sec - exiting 18:08:26 (6341): No heartbeat from core client for 30 sec - exiting 18:08:27 (6341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:01 (6370): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:32 (6370): No heartbeat from core client for 30 sec - exiting 18:15:45 (6370): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:18:53 (6471): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:18:54 (6471): No heartbeat from core client for 30 sec - exiting 18:20:17 (6515): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:18 (6515): No heartbeat from core client for 30 sec - exiting 18:20:19 (6515): No heartbeat from core client for 30 sec - exiting 18:20:20 (6515): No heartbeat from core client for 30 sec - exiting 18:20:21 (6515): No heartbeat from core client for 30 sec - exiting 18:20:22 (6515): No heartbeat from core client for 30 sec - exiting 18:20:23 (6515): No heartbeat from core client for 30 sec - exiting 18:20:24 (6515): No heartbeat from core client for 30 sec - exiting 18:20:25 (6515): No heartbeat from core client for 30 sec - exiting 18:20:26 (6515): No heartbeat from core client for 30 sec - exiting 18:20:27 (6515): No heartbeat from core client for 30 sec - exiting 18:20:28 (6515): No heartbeat from core client for 30 sec - exiting 18:20:29 (6515): No heartbeat from core client for 30 sec - exiting 18:20:30 (6515): No heartbeat from core client for 30 sec - exiting 18:20:31 (6515): No heartbeat from core client for 30 sec - exiting 18:20:32 (6515): No heartbeat from core client for 30 sec - exiting 18:20:33 (6515): No heartbeat from core client for 30 sec - exiting 18:20:34 (6515): No heartbeat from core client for 30 sec - exiting 18:20:35 (6515): No heartbeat from core client for 30 sec - exiting 18:20:36 (6515): No heartbeat from core client for 30 sec - exiting 18:20:37 (6515): No heartbeat from core client for 30 sec - exiting 18:20:38 (6515): No heartbeat from core client for 30 sec - exiting 18:20:39 (6515): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 18:29:20 (6564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:31:51 (6650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:43:56 (25593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:48:26 (18531): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:34 (18594): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:53:35 (18594): No heartbeat from core client for 30 sec - exiting 20:53:36 (18594): No heartbeat from core client for 30 sec - exiting 20:53:37 (18594): No heartbeat from core client for 30 sec - exiting 20:53:38 (18594): No heartbeat from core client for 30 sec - exiting 20:53:39 (18594): No heartbeat from core client for 30 sec - exiting 20:53:40 (18594): No heartbeat from core client for 30 sec - exiting 20:53:41 (18594): No heartbeat from core client for 30 sec - exiting 20:53:42 (18594): No heartbeat from core client for 30 sec - exiting 20:53:43 (18594): No heartbeat from core client for 30 sec - exiting 20:53:44 (18594): No heartbeat from core client for 30 sec - exiting 20:53:45 (18594): No heartbeat from core client for 30 sec - exiting 20:53:46 (18594): No heartbeat from core client for 30 sec - exiting 20:53:47 (18594): No heartbeat from core client for 30 sec - exiting 20:53:48 (18594): No heartbeat from core client for 30 sec - exiting 20:53:49 (18594): No heartbeat from core client for 30 sec - exiting 20:53:50 (18594): No heartbeat from core client for 30 sec - exiting 20:53:51 (18594): No heartbeat from core client for 30 sec - exiting 20:53:52 (18594): No heartbeat from core client for 30 sec - exiting 20:53:53 (18594): No heartbeat from core client for 30 sec - exiting 20:53:54 (18594): No heartbeat from core client for 30 sec - exiting 20:53:55 (18594): No heartbeat from core client for 30 sec - exiting 20:53:56 (18594): No heartbeat from core client for 30 sec - exiting 20:53:57 (18594): No heartbeat from core client for 30 sec - exiting 20:53:58 (18594): No heartbeat from core client for 30 sec - exiting 20:53:59 (18594): No heartbeat from core client for 30 sec - exiting 20:54:00 (18594): No heartbeat from core client for 30 sec - exiting 20:54:01 (18594): No heartbeat from core client for 30 sec - exiting 20:54:02 (18594): No heartbeat from core client for 30 sec - exiting 20:54:03 (18594): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 20:56:56 (18655): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:57:10 (18655): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 21:01:41 (18710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:01:44 (18710): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 21:05:14 (18777): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:13 (7494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:35:00 (29494): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:19 (29494): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:40:15 (29682): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:16:16 (29784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:20:28 (30618): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:23:09 (30668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:25:44 (30753): No heartbeat from core client for 30 sec - exiting 02:25:45 (30753): No heartbeat from core client for 30 sec - exiting 02:25:46 (30753): No heartbeat from core client for 30 sec - exiting 02:25:47 (30753): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:29:42 (30771): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:34:06 (31035): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:34:08 (31035): No heartbeat from core client for 30 sec - exiting 02:34:09 (31035): No heartbeat from core client for 30 sec - exiting 02:34:10 (31035): No heartbeat from core client for 30 sec - exiting 02:34:11 (31035): No heartbeat from core client for 30 sec - exiting 02:34:12 (31035): No heartbeat from core client for 30 sec - exiting 02:34:25 (31035): No heartbeat from core client for 30 sec - exiting 02:34:26 (31035): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 02:35:55 (31079): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 02:38:07 (31111): No heartbeat from core client for 30 sec - exiting 02:38:08 (31111): No heartbeat from core client for 30 sec - exiting 02:38:09 (31111): No heartbeat from core client for 30 sec - exiting 02:38:10 (31111): No heartbeat from core client for 30 sec - exiting 02:38:11 (31111): No heartbeat from core client for 30 sec - exiting 02:38:12 (31111): No heartbeat from core client for 30 sec - exiting 02:38:13 (31111): No heartbeat from core client for 30 sec - exiting 02:38:14 (31111): No heartbeat from core client for 30 sec - exiting 02:38:15 (31111): No heartbeat from core client for 30 sec - exiting 02:38:16 (31111): No heartbeat from core client for 30 sec - exiting 02:38:17 (31111): No heartbeat from core client for 30 sec - exiting 02:38:18 (31111): No heartbeat from core client for 30 sec - exiting 02:38:19 (31111): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:38:21 (31111): No heartbeat from core client for 30 sec - exiting Signal 2 received, exiting... Signal 2 received, exiting... Called boinc_finish 18:20:11 (9939): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:20:14 (9939): No heartbeat from core client for 30 sec - exiting 19:08:18 (31529): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:25:06 (31935): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:47:01 (32087): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:05:23 (32292): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/39idko.pjo2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idko.pjo2c10 Error: Input file: dataout/39idko.pio2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idko.pio2c10 Error: Input file: dataout/39idko.pfo2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idko.pfo2c10 Error: Input file: dataout/39idka.pho2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idka.pho2c10 Error: Input file: dataout/39idka.pgo2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idka.pgo2c10 Error: Input file: dataout/39idka.peo2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idka.peo2c10 Error: Input file: dataout/39idka.pdo2c10 is not a valid UM file. Error converting file to netcdf: dataout/39idka.pdo2c10 20:45:12 (32717): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:45:57 (590): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:05 (609): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:40:03 (893): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:43:56 (1089): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:45:23 (1114): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:46 (1220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:20:27 (1465): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:03 (1716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:29:05 (1716): No heartbeat from core client for 30 sec - exiting 22:29:06 (1716): No heartbeat from core client for 30 sec - exiting 22:29:07 (1716): No heartbeat from core client for 30 sec - exiting 22:29:08 (1716): No heartbeat from core client for 30 sec - exiting 22:29:09 (1716): No heartbeat from core client for 30 sec - exiting 22:29:10 (1716): No heartbeat from core client for 30 sec - exiting Atmos Hold Restart file rename failed on atmos_restart.hold 22:35:48 (1805): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:41:40 (1917): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:43:47 (1985): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:43:49 (1985): No heartbeat from core client for 30 sec - exiting 22:43:56 (1985): No heartbeat from core client for 30 sec - exiting 22:43:57 (1985): No heartbeat from core client for 30 sec - exiting 22:43:58 (1985): No heartbeat from core client for 30 sec - exiting 22:43:59 (1985): No heartbeat from core client for 30 sec - exiting 22:49:55 (2012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:00:52 (2118): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:10:26 (2268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:13:47 (2375): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:19:22 (2421): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:34:46 (2514): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:54:10 (2708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:56:37 (2928): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:59:40 (2967): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:11:20 (3005): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:43 (3172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:27:47 (3172): No heartbeat from core client for 30 sec - exiting 00:30:59 (3412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:44:52 (3493): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:45:12 (3493): No heartbeat from core client for 30 sec - exiting 00:45:13 (3493): No heartbeat from core client for 30 sec - exiting 01:00:50 (3698): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:00:55 (3698):01:18:48 (3950): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:34:14 (4180): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:51:15 (4389): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:52:30 (4655): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:08:19 (4686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:13 (4971): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:23:14 (4971): No heartbeat from core client for 30 sec - exiting 02:23:15 (4971): No heartbeat from core client for 30 sec - exiting 02:23:16 (4971): No heartbeat from core client for 30 sec - exiting 02:23:17 (4971): No heartbeat from core client for 30 sec - exiting 02:23:26 (4971): No heartbeat from core client for 30 sec - exiting 02:23:27 (4971): No heartbeat from core client for 30 sec - exiting 02:23:28 (4971): No heartbeat from core client for 30 sec - exiting 02:23:29 (4971): No heartbeat from core client for 30 sec - exiting 02:23:30 (4971): No heartbeat from core client for 30 sec - exiting 02:23:31 (4971): No heartbeat from core client for 30 sec - exiting 02:23:34 (4971): No heartbeat from core client for 30 sec - exiting 02:23:35 (4971): No heartbeat from core client for 30 sec - exiting 02:23:36 (4971): No heartbeat from core client for 30 sec - exiting 02:23:37 (4971): No heartbeat from core client for 30 sec - exiting 02:23:38 (4971): No heartbeat from core client for 30 sec - exiting 02:23:39 (4971): No heartbeat from core client for 30 sec - exiting 02:40:03 (5242): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:40:06 (5242): No heartbeat from core client for 30 sec - exiting 02:40:07 (5242): No heartbeat from core client for 30 sec - exiting 02:40:08 (5242): No heartbeat from core client for 30 sec - exiting 02:40:09 (5242): No heartbeat from core client for 30 sec - exiting 02:40:10 (5242): No heartbeat from core client for 30 sec - exiting 02:40:11 (5242): No heartbeat from core client for 30 sec - exiting 02:40:12 (5242): No heartbeat from core client for 30 sec - exiting 02:40:13 (5242): No heartbeat from core client for 30 sec - exiting 02:40:14 (5242): No heartbeat from core client for 30 sec - exiting 02:40:15 (5242): No heartbeat from core client for 30 sec - exiting 02:40:16 (5242): No heartbeat from core client for 30 sec - exiting 02:40:17 (5242): No heartbeat from core client for 30 sec - exiting 02:40:18 (5242): No heartbeat from core client for 30 sec - exiting 02:40:19 (5242): No heartbeat from core client for 30 sec - exiting 02:40:20 (5242): No heartbeat from core client for 30 sec - exiting 02:40:21 (5242): No heartbeat from core client for 30 sec - exiting 02:40:22 (5242): No heartbeat from core client for 30 sec - exiting 02:40:23 (5242): No heartbeat from core client for 30 sec - exiting 02:42:00 (5735): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold 11:20:06 (5775): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:22 (5775): No heartbeat from core client for 30 sec - exiting 12:45:25 (12791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:08:22 (13504): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:25:29 (14264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:43:26 (14536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:46:10 (14784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:00:33 (14840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:20:02 (15059): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:33:39 (15315): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:35:36 (15484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:38:22 (15516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:40:31 (15550): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:08:50 (15589): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:25:39 (15920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:01 (16166): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:29:06 (16166): No heartbeat from core client for 30 sec - exiting 16:29:08 (16166): No heartbeat from core client for 30 sec - exiting 16:35:29 (16213): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:35:40 (16213): No heartbeat from core client for 30 sec - exiting 16:45:40 (16345): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:47:09 (16517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:25 (16552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:04:36 (16790): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:19:18 (16809): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:21:19 (17010): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:36:55 (17051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:51 (17256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:08 (17487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:09 (17487): No heartbeat from core client for 30 sec - exiting 18:03:13 (17515): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:12:02 (17868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:15:26 (17973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:27:42 (18044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:18 (18225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:20 (18225): No heartbeat from core client for 30 sec - exiting 18:31:38 (18284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:47:31 (18313): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:49:11 (18524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:19 (18560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:50:22 (18560): No heartbeat from core client for 30 sec - exiting 18:54:07 (18590): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:09:17 (18641): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:11:55 (18869): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:18:52 (18915): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:22:16 (19027): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:27:14 (19090): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:56 (19149): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:30:08 (19149): No heartbeat from core client for 30 sec - exiting 19:46:21 (19229): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:03:28 (19483): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:19:29 (19692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:23:47 (19886): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:38:41 (19958): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:01 (20157): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:42:16 (20157): No heartbeat from core client for 30 sec - exiting 20:43:26 (20207): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:43:27 (20207): No heartbeat from core client for 30 sec - exiting 20:45:11 (20227): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:59:08 (20279): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:26 (20448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:05:27 (20517): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:52 (20568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:16:55 (20568): No heartbeat from core client for 30 sec - exiting 21:35:14 (20721): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:06 (20922): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:51:08 (20922): No heartbeat from core client for 30 sec - exiting 21:51:09 (20922): No heartbeat from core client for 30 sec - exiting 21:51:10 (20922): No heartbeat from core client for 30 sec - exiting 21:51:11 (20922): No heartbeat from core client for 30 sec - exiting 22:07:20 (21122): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:10:41 (21355): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e9400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf76e9425] /lib/libc.so.6(gsignal+0x4f)[0xf752331f] /lib/libc.so.6(abort+0x143)[0xf7524c03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf750e3d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7799400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7799425] /lib/libc.so.6(gsignal+0x4f)[0xf75d331f] /lib/libc.so.6(abort+0x143)[0xf75d4c03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75be3d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf772d400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf772d425] /lib/libc.so.6(gsignal+0x4f)[0xf756731f] /lib/libc.so.6(abort+0x143)[0xf7568c03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75523d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7715400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf7715425] /lib/libc.so.6(gsignal+0x4f)[0xf754f31f] /lib/libc.so.6(abort+0x143)[0xf7550c03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf753a3d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e2400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf76e2425] /lib/libc.so.6(gsignal+0x4f)[0xf751c31f] /lib/libc.so.6(abort+0x143)[0xf751dc03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75073d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf775e400] linux-gate.so.1(__kernel_vsyscall+0x5)[0xf775e425] /lib/libc.so.6(gsignal+0x4f)[0xf759831f] /lib/libc.so.6(abort+0x143)[0xf7599c03] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/cognac/bin/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75833d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21401, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
03 Dec 2013 15:19:47 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 596,160 | 1,070,099 | 1.7950 |
02 Dec 2013 19:15:25 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 570,240 | 1,027,142 | 1.8012 |
29 Nov 2013 18:30:54 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 544,320 | 981,757 | 1.8036 |
29 Nov 2013 05:43:35 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 518,400 | 936,341 | 1.8062 |
28 Nov 2013 17:09:29 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 492,480 | 891,283 | 1.8098 |
28 Nov 2013 04:31:19 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 466,560 | 846,202 | 1.8137 |
17 Oct 2013 13:01:19 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 440,640 | 798,848 | 1.8129 |
16 Oct 2013 23:23:30 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 414,720 | 750,122 | 1.8087 |
16 Oct 2013 09:54:46 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 388,800 | 701,959 | 1.8055 |
15 Oct 2013 20:30:43 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 362,880 | 654,248 | 1.8029 |
15 Oct 2013 06:59:28 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 336,960 | 605,888 | 1.7981 |
14 Oct 2013 17:06:25 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 311,040 | 556,265 | 1.7884 |
10 Jul 2013 13:21:55 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 285,120 | 509,858 | 1.7882 |
06 Jul 2013 16:59:55 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 259,200 | 463,948 | 1.7899 |
06 Jul 2013 04:59:20 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 233,280 | 418,170 | 1.7926 |
06 Jul 2013 04:16:30 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 207,360 | 373,115 | 1.7994 |
26 Jun 2013 15:58:08 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 181,440 | 327,099 | 1.8028 |
26 Jun 2013 02:46:55 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 155,520 | 280,130 | 1.8012 |
07 Jun 2013 05:34:04 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 129,600 | 233,206 | 1.7994 |
06 Jun 2013 16:23:14 | 1269200 | 15827502 | hadcm3n_39id_2020_40_008390168_0 | 103,680 | 186,534 | 1.7991 |
©2024 cpdn.org