Name | hadcm3n_488z_1980_40_008324969_0 |
Workunit | 8476104 |
Created | 7 Mar 2013, 0:17:49 UTC |
Sent | 7 Mar 2013, 0:20:08 UTC |
Report deadline | 6 Jun 2013, 7:47:19 UTC |
Received | 19 Jun 2013, 13:51:24 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1026511 |
Run time | 26 days 10 hours 34 min 18 sec |
CPU time | 26 days 4 hours 49 min 55 sec |
Validate state | Invalid |
Credit | 12,441.60 |
Device peak FLOPS | 1.96 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>7.0.65</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> orruption (out): 0x09e798e8 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x089758e8 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c5c8e8 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08de38e8 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c1e8e8 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called 19:29:57 (2361): No heartbeat from core client for 30 sec - exiting 19:29:58 (2361): No heartbeat from core client for 30 sec - exiting 19:29:59 (2361): No heartbeat from core client for 30 sec - exiting 19:30:00 (2361): No heartbeat from core client for 30 sec - exiting 19:30:01 (2361): No heartbeat from core client for 30 sec - exiting 19:30:02 (2361): No heartbeat from core client for 30 sec - exiting 19:30:03 (2361): No heartbeat from core client for 30 sec - exiting 19:30:04 (2361): No heartbeat from core client for 30 sec - exiting 19:30:05 (2361): No heartbeat from core client for 30 sec - exiting 19:30:06 (2361): No heartbeat from core client for 30 sec - exiting 19:30:07 (2361): No heartbeat from core client for 30 sec - exiting 19:30:08 (2361): No heartbeat from core client for 30 sec - exiting 19:30:09 (2361): No heartbeat from core client for 30 sec - exiting 19:30:10 (2361): No heartbeat from core client for 30 sec - exiting 19:30:11 (2361): No heartbeat from core client for 30 sec - exiting 19:30:12 (2361): No heartbeat from core client for 30 sec - exiting 19:30:13 (2361): No heartbeat from core client for 30 sec - exiting 19:30:14 (2361): No heartbeat from core client for 30 sec - exiting 19:30:15 (2361): No heartbeat from core client for 30 sec - exiting 19:30:16 (2361): No heartbeat from core client for 30 sec - exiting 19:30:17 (2361): No heartbeat from core client for 30 sec - exiting 19:30:18 (2361): No heartbeat from core client for 30 sec - exiting 19:30:19 (2361): No heartbeat from core client for 30 sec - exiting 19:30:20 (2361): No heartbeat from core client for 30 sec - exiting 19:30:21 (2361): No heartbeat from core client for 30 sec - exiting 19:30:22 (2361): No heartbeat from core client for 30 sec - exiting 19:30:23 (2361): No heartbeat from core client for 30 sec - exiting 19:30:24 (2361): No heartbeat from core client for 30 sec - exiting 19:30:25 (2361): No heartbeat from core client for 30 sec - exiting 19:30:26 (2361): No heartbeat from core client for 30 sec - exiting 19:30:27 (2361): No heartbeat from core client for 30 sec - exiting 19:30:28 (2361): No heartbeat from core client for 30 sec - exiting 19:30:29 (2361): No heartbeat from core client for 30 sec - exiting 19:30:30 (2361): No heartbeat from core client for 30 sec - exiting 19:30:31 (2361): No heartbeat from core client for 30 sec - exiting 19:30:32 (2361): No heartbeat from core client for 30 sec - exiting 19:30:33 (2361): No heartbeat from core client for 30 sec - exiting 19:30:34 (2361): No heartbeat from core client for 30 sec - exiting 19:30:35 (2361): No heartbeat from core client for 30 sec - exiting 19:30:36 (2361): No heartbeat from core client for 30 sec - exiting 19:30:37 (2361): No heartbeat from core client for 30 sec - exiting 19:30:38 (2361): No heartbeat from core client for 30 sec - exiting 19:30:39 (2361): No heartbeat from core client for 30 sec - exiting 19:30:40 (2361): No heartbeat from core client for 30 sec - exiting 19:30:41 (2361): No heartbeat from core client for 30 sec - exiting 19:30:42 (2361): No heartbeat from core client for 30 sec - exiting 19:30:43 (2361): No heartbeat from core client for 30 sec - exiting 19:30:44 (2361): No heartbeat from core client for 30 sec - exiting 19:30:45 (2361): No heartbeat from core client for 30 sec - exiting 19:30:46 (2361): No heartbeat from core client for 30 sec - exiting 19:30:47 (2361): No heartbeat from core client for 30 sec - exiting 19:30:48 (2361): No heartbeat from core client for 30 sec - exiting 19:30:49 (2361): No heartbeat from core client for 30 sec - exiting 19:30:50 (2361): No heartbeat from core client for 30 sec - exiting 19:30:51 (2361): No heartbeat from core client for 30 sec - exiting 19:30:52 (2361): No heartbeat from core client for 30 sec - exiting 19:30:53 (2361): No heartbeat from core client for 30 sec - exiting 19:30:54 (2361): No heartbeat from core client for 30 sec - exiting 19:30:55 (2361): No heartbeat from core client for 30 sec - exiting 19:30:56 (2361): No heartbeat from core client for 30 sec - exiting 19:30:57 (2361): No heartbeat from core client for 30 sec - exiting 19:30:58 (2361): No heartbeat from core client for 30 sec - exiting 19:30:59 (2361): No heartbeat from core client for 30 sec - exiting 19:31:00 (2361): No heartbeat from core client for 30 sec - exiting 19:31:01 (2361): No heartbeat from core client for 30 sec - exiting 19:31:02 (2361): No heartbeat from core client for 30 sec - exiting 19:31:03 (2361): No heartbeat from core client for 30 sec - exiting 19:31:04 (2361): No heartbeat from core client for 30 sec - exiting 19:31:05 (2361): No heartbeat from core client for 30 sec - exiting 19:31:06 (2361): No heartbeat from core client for 30 sec - exiting 19:31:07 (2361): No heartbeat from core client for 30 sec - exiting 19:31:08 (2361): No heartbeat from core client for 30 sec - exiting 19:31:09 (2361): No heartbeat from core client for 30 sec - exiting 19:31:10 (2361): No heartbeat from core client for 30 sec - exiting 19:31:11 (2361): No heartbeat from core client for 30 sec - exiting 19:31:12 (2361): No heartbeat from core client for 30 sec - exiting 19:31:13 (2361): No heartbeat from core client for 30 sec - exiting 19:31:14 (2361): No heartbeat from core client for 30 sec - exiting 19:31:15 (2361): No heartbeat from core client for 30 sec - exiting 19:31:16 (2361): No heartbeat from core client for 30 sec - exiting 19:31:17 (2361): No heartbeat from core client for 30 sec - exiting 19:31:18 (2361): No heartbeat from core client for 30 sec - exiting 19:31:19 (2361): No heartbeat from core client for 30 sec - exiting 19:31:20 (2361): No heartbeat from core client for 30 sec - exiting 19:31:21 (2361): No heartbeat from core client for 30 sec - exiting 19:31:22 (2361): No heartbeat from core client for 30 sec - exiting 19:31:23 (2361): No heartbeat from core client for 30 sec - exiting 19:31:24 (2361): No heartbeat from core client for 30 sec - exiting 19:31:25 (2361): No heartbeat from core client for 30 sec - exiting 19:31:26 (2361): No heartbeat from core client for 30 sec - exiting 19:31:27 (2361): No heartbeat from core client for 30 sec - exiting 19:31:28 (2361): No heartbeat from core client for 30 sec - exiting 19:31:29 (2361): No heartbeat from core client for 30 sec - exiting 19:31:30 (2361): No heartbeat from core client for 30 sec - exiting 19:31:31 (2361): No heartbeat from core client for 30 sec - exiting 19:31:32 (2361): No heartbeat from core client for 30 sec - exiting 19:31:33 (2361): No heartbeat from core client for 30 sec - exiting 19:31:34 (2361): No heartbeat from core client for 30 sec - exiting 19:31:35 (2361): No heartbeat from core client for 30 sec - exiting 19:31:36 (2361): No heartbeat from core client for 30 sec - exiting 19:31:37 (2361): No heartbeat from core client for 30 sec - exiting 19:31:38 (2361): No heartbeat from core client for 30 sec - exiting 19:31:39 (2361): No heartbeat from core client for 30 sec - exiting 19:31:40 (2361): No heartbeat from core client for 30 sec - exiting 19:31:41 (2361): No heartbeat from core client for 30 sec - exiting 19:31:42 (2361): No heartbeat from core client for 30 sec - exiting 19:31:43 (2361): No heartbeat from core client for 30 sec - exiting 19:31:44 (2361): No heartbeat from core client for 30 sec - exiting 19:31:45 (2361): No heartbeat from core client for 30 sec - exiting 19:31:46 (2361): No heartbeat from core client for 30 sec - exiting 19:31:47 (2361): No heartbeat from core client for 30 sec - exiting 19:31:48 (2361): No heartbeat from core client for 30 sec - exiting 19:31:49 (2361): No heartbeat from core client for 30 sec - exiting 19:31:50 (2361): No heartbeat from core client for 30 sec - exiting 19:31:51 (2361): No heartbeat from core client for 30 sec - exiting 19:31:52 (2361): No heartbeat from core client for 30 sec - exiting 19:31:53 (2361): No heartbeat from core client for 30 sec - exiting 19:31:54 (2361): No heartbeat from core client for 30 sec - exiting 19:31:55 (2361): No heartbeat from core client for 30 sec - exiting 19:31:56 (2361): No heartbeat from core client for 30 sec - exiting 19:31:57 (2361): No heartbeat from core client for 30 sec - exiting 19:31:58 (2361): No heartbeat from core client for 30 sec - exiting 19:31:59 (2361): No heartbeat from core client for 30 sec - exiting 19:32:00 (2361): No heartbeat from core client for 30 sec - exiting 19:32:01 (2361): No heartbeat from core client for 30 sec - exiting 19:32:02 (2361): No heartbeat from core client for 30 sec - exiting 19:32:03 (2361): No heartbeat from core client for 30 sec - exiting 19:32:04 (2361): No heartbeat from core client for 30 sec - exiting 19:32:05 (2361): No heartbeat from core client for 30 sec - exiting 19:32:06 (2361): No heartbeat from core client for 30 sec - exiting 19:32:07 (2361): No heartbeat from core client for 30 sec - exiting 19:32:08 (2361): No heartbeat from core client for 30 sec - exiting 19:32:09 (2361): No heartbeat from core client for 30 sec - exiting 19:32:10 (2361): No heartbeat from core client for 30 sec - exiting 19:32:11 (2361): No heartbeat from core client for 30 sec - exiting 19:32:12 (2361): No heartbeat from core client for 30 sec - exiting 19:32:13 (2361): No heartbeat from core client for 30 sec - exiting 19:32:14 (2361): No heartbeat from core client for 30 sec - exiting 19:32:15 (2361): No heartbeat from core client for 30 sec - exiting 19:32:16 (2361): No heartbeat from core client for 30 sec - exiting 19:32:17 (2361): No heartbeat from core client for 30 sec - exiting 19:32:18 (2361): No heartbeat from core client for 30 sec - exiting 19:32:19 (2361): No heartbeat from core client for 30 sec - exiting 19:32:20 (2361): No heartbeat from core client for 30 sec - exiting 19:32:21 (2361): No heartbeat from core client for 30 sec - exiting 19:32:22 (2361): No heartbeat from core client for 30 sec - exiting 19:32:23 (2361): No heartbeat from core client for 30 sec - exiting 19:32:24 (2361): No heartbeat from core client for 30 sec - exiting 19:32:25 (2361): No heartbeat from core client for 30 sec - exiting 19:32:26 (2361): No heartbeat from core client for 30 sec - exiting 19:32:27 (2361): No heartbeat from core client for 30 sec - exiting 19:32:28 (2361): No heartbeat from core client for 30 sec - exiting 19:32:29 (2361): No heartbeat from core client for 30 sec - exiting 19:32:30 (2361): No heartbeat from core client for 30 sec - exiting 19:32:31 (2361): No heartbeat from core client for 30 sec - exiting 19:32:32 (2361): No heartbeat from core client for 30 sec - exiting 19:32:33 (2361): No heartbeat from core client for 30 sec - exiting 19:32:34 (2361): No heartbeat from core client for 30 sec - exiting 19:32:35 (2361): No heartbeat from core client for 30 sec - exiting 19:32:36 (2361): No heartbeat from core client for 30 sec - exiting 19:32:37 (2361): No heartbeat from core client for 30 sec - exiting 19:32:38 (2361): No heartbeat from core client for 30 sec - exiting 19:32:39 (2361): No heartbeat from core client for 30 sec - exiting 19:32:40 (2361): No heartbeat from core client for 30 sec - exiting 19:32:41 (2361): No heartbeat from core client for 30 sec - exiting 19:32:42 (2361): No heartbeat from core client for 30 sec - exiting 19:32:43 (2361): No heartbeat from core client for 30 sec - exiting 19:32:44 (2361): No heartbeat from core client for 30 sec - exiting 19:32:45 (2361): No heartbeat from core client for 30 sec - exiting 19:32:46 (2361): No heartbeat from core client for 30 sec - exiting 19:32:47 (2361): No heartbeat from core client for 30 sec - exiting 19:32:48 (2361): No heartbeat from core client for 30 sec - exiting 19:32:49 (2361): No heartbeat from core client for 30 sec - exiting 19:32:50 (2361): No heartbeat from core client for 30 sec - exiting 19:32:51 (2361): No heartbeat from core client for 30 sec - exiting 19:32:52 (2361): No heartbeat from core client for 30 sec - exiting 19:32:53 (2361): No heartbeat from core client for 30 sec - exiting 19:32:54 (2361): No heartbeat from core client for 30 sec - exiting 19:32:55 (2361): No heartbeat from core client for 30 sec - exiting 19:32:56 (2361): No heartbeat from core client for 30 sec - exiting 19:32:57 (2361): No heartbeat from core client for 30 sec - exiting 19:32:58 (2361): No heartbeat from core client for 30 sec - exiting 19:32:59 (2361): No heartbeat from core client for 30 sec - exiting 19:33:00 (2361): No heartbeat from core client for 30 sec - exiting 19:33:01 (2361): No heartbeat from core client for 30 sec - exiting 19:33:02 (2361): No heartbeat from core client for 30 sec - exiting 19:33:03 (2361): No heartbeat from core client for 30 sec - exiting 19:33:04 (2361): No heartbeat from core client for 30 sec - exiting 19:33:05 (2361): No heartbeat from core client for 30 sec - exiting 19:33:06 (2361): No heartbeat from core client for 30 sec - exiting 19:33:07 (2361): No heartbeat from core client for 30 sec - exiting 19:33:08 (2361): No heartbeat from core client for 30 sec - exiting 19:33:09 (2361): No heartbeat from core client for 30 sec - exiting 19:33:10 (2361): No heartbeat from core client for 30 sec - exiting 19:33:11 (2361): No heartbeat from core client for 30 sec - exiting 19:33:12 (2361): No heartbeat from core client for 30 sec - exiting 19:33:13 (2361): No heartbeat from core client for 30 sec - exiting 19:33:14 (2361): No heartbeat from core client for 30 sec - exiting 19:33:15 (2361): No heartbeat from core client for 30 sec - exiting 19:33:16 (2361): No heartbeat from core client for 30 sec - exiting 19:33:17 (2361): No heartbeat from core client for 30 sec - exiting 19:33:18 (2361): No heartbeat from core client for 30 sec - exiting 19:33:19 (2361): No heartbeat from core client for 30 sec - exiting 19:33:20 (2361): No heartbeat from core client for 30 sec - exiting 19:33:21 (2361): No heartbeat from core client for 30 sec - exiting 19:33:22 (2361): No heartbeat from core client for 30 sec - exiting 19:33:23 (2361): No heartbeat from core client for 30 sec - exiting 19:33:24 (2361): No heartbeat from core client for 30 sec - exiting 19:33:25 (2361): No heartbeat from core client for 30 sec - exiting 19:33:26 (2361): No heartbeat from core client for 30 sec - exiting 19:33:27 (2361): No heartbeat from core client for 30 sec - exiting 19:33:28 (2361): No heartbeat from core client for 30 sec - exiting 19:33:29 (2361): No heartbeat from core client for 30 sec - exiting 19:33:30 (2361): No heartbeat from core client for 30 sec - exiting 19:33:31 (3374): Can't acquire lockfile (-154) - waiting 35s 19:33:31 (2361): No heartbeat from core client for 30 sec - exiting 19:33:32 (2361): No heartbeat from core client for 30 sec - exiting 19:34:06 (3374): Can't acquire lockfile (-154) - exiting 19:34:36 (2361): No heartbeat from core client for 30 sec - exiting 19:34:37 (2361): No heartbeat from core client for 30 sec - exiting 19:34:38 (2361): No heartbeat from core client for 30 sec - exiting 19:34:39 (2361): No heartbeat from core client for 30 sec - exiting 19:34:40 (2361): No heartbeat from core client for 30 sec - exiting 19:34:41 (2361): No heartbeat from core client for 30 sec - exiting 19:34:42 (2361): No heartbeat from core client for 30 sec - exiting 19:34:43 (2361): No heartbeat from core client for 30 sec - exiting 19:34:44 (2361): No heartbeat from core client for 30 sec - exiting 19:34:45 (2361): No heartbeat from core client for 30 sec - exiting 19:34:46 (2361): No heartbeat from core client for 30 sec - exiting 19:34:47 (2361): No heartbeat from core client for 30 sec - exiting 19:34:48 (2361): No heartbeat from core client for 30 sec - exiting 19:34:49 (2361): No heartbeat from core client for 30 sec - exiting 19:34:50 (2361): No heartbeat from core client for 30 sec - exiting 19:34:51 (2361): No heartbeat from core client for 30 sec - exiting 19:34:52 (2361): No heartbeat from core client for 30 sec - exiting 19:34:53 (2361): No heartbeat from core client for 30 sec - exiting 19:34:54 (2361): No heartbeat from core client for 30 sec - exiting 19:34:55 (2361): No heartbeat from core client for 30 sec - exiting 19:34:56 (2361): No heartbeat from core client for 30 sec - exiting 19:34:57 (2361): No heartbeat from core client for 30 sec - exiting 19:34:58 (2361): No heartbeat from core client for 30 sec - exiting 19:34:59 (2361): No heartbeat from core client for 30 sec - exiting 19:35:00 (2361): No heartbeat from core client for 30 sec - exiting 19:35:01 (2361): No heartbeat from core client for 30 sec - exiting 19:35:02 (2361): No heartbeat from core client for 30 sec - exiting 19:35:03 (2361): No heartbeat from core client for 30 sec - exiting 19:35:04 (2361): No heartbeat from core client for 30 sec - exiting 19:35:05 (2361): No heartbeat from core client for 30 sec - exiting 19:35:06 (2361): No heartbeat from core client for 30 sec - exiting 19:35:07 (2361): No heartbeat from core client for 30 sec - exiting 19:35:08 (2361): No heartbeat from core client for 30 sec - exiting 19:35:09 (2361): No heartbeat from core client for 30 sec - exiting 19:35:10 (2361): No heartbeat from core client for 30 sec - exiting 19:35:11 (2361): No heartbeat from core client for 30 sec - exiting 19:35:12 (2361): No heartbeat from core client for 30 sec - exiting 19:35:13 (2361): No heartbeat from core client for 30 sec - exiting 19:35:14 (2361): No heartbeat from core client for 30 sec - exiting 19:35:15 (2361): No heartbeat from core client for 30 sec - exiting 19:35:16 (2361): No heartbeat from core client for 30 sec - exiting 19:35:17 (2361): No heartbeat from core client for 30 sec - exiting 19:35:18 (2361): No heartbeat from core client for 30 sec - exiting 19:35:19 (2361): No heartbeat from core client for 30 sec - exiting 19:35:20 (2361): No heartbeat from core client for 30 sec - exiting 19:35:21 (2361): No heartbeat from core client for 30 sec - exiting 19:35:22 (2361): No heartbeat from core client for 30 sec - exiting 19:35:23 (2361): No heartbeat from core client for 30 sec - exiting 19:35:24 (2361): No heartbeat from core client for 30 sec - exiting 19:35:25 (2361): No heartbeat from core client for 30 sec - exiting 19:35:26 (2361): No heartbeat from core client for 30 sec - exiting 19:35:27 (2361): No heartbeat from core client for 30 sec - exiting 19:35:29 (2361): No heartbeat from core client for 30 sec - exiting 19:35:30 (2361): No heartbeat from core client for 30 sec - exiting 19:35:31 (2361): No heartbeat from core client for 30 sec - exiting 19:35:32 (2361): No heartbeat from core client for 30 sec - exiting 19:35:33 (2361): No heartbeat from core client for 30 sec - exiting 19:35:34 (2361): No heartbeat from core client for 30 sec - exiting 19:35:35 (2361): No heartbeat from core client for 30 sec - exiting 19:35:36 (2361): No heartbeat from core client for 30 sec - exiting 19:35:37 (2361): No heartbeat from core client for 30 sec - exiting 19:35:38 (2361): No heartbeat from core client for 30 sec - exiting 19:35:39 (2361): No heartbeat from core client for 30 sec - exiting 19:35:40 (2361): No heartbeat from core client for 30 sec - exiting 19:35:41 (2361): No heartbeat from core client for 30 sec - exiting 19:35:42 (2361): No heartbeat from core client for 30 sec - exiting 19:35:43 (2361): No heartbeat from core client for 30 sec - exiting 19:35:44 (2361): No heartbeat from core client for 30 sec - exiting 19:35:45 (2361): No heartbeat from core client for 30 sec - exiting 19:35:46 (2361): No heartbeat from core client for 30 sec - exiting 19:35:47 (2361): No heartbeat from core client for 30 sec - exiting 19:35:48 (2361): No heartbeat from core client for 30 sec - exiting 19:35:49 (2361): No heartbeat from core client for 30 sec - exiting 19:35:50 (2361): No heartbeat from core client for 30 sec - exiting 19:35:51 (2361): No heartbeat from core client for 30 sec - exiting 19:35:52 (2361): No heartbeat from core client for 30 sec - exiting 19:35:53 (2361): No heartbeat from core client for 30 sec - exiting 19:35:54 (2361): No heartbeat from core client for 30 sec - exiting 19:35:55 (2361): No heartbeat from core client for 30 sec - exiting 19:35:56 (2361): No heartbeat from core client for 30 sec - exiting 19:35:57 (2361): No heartbeat from core client for 30 sec - exiting 19:35:58 (2361): No heartbeat from core client for 30 sec - exiting 19:35:59 (2361): No heartbeat from core client for 30 sec - exiting 19:36:00 (2361): No heartbeat from core client for 30 sec - exiting 19:36:01 (2361): No heartbeat from core client for 30 sec - exiting 19:36:02 (2361): No heartbeat from core client for 30 sec - exiting 19:36:03 (2361): No heartbeat from core client for 30 sec - exiting 19:36:04 (2361): No heartbeat from core client for 30 sec - exiting 19:36:05 (2361): No heartbeat from core client for 30 sec - exiting 19:36:06 (2361): No heartbeat from core client for 30 sec - exiting 19:36:07 (2361): No heartbeat from core client for 30 sec - exiting 19:36:08 (2361): No heartbeat from core client for 30 sec - exiting 19:36:09 (2361): No heartbeat from core client for 30 sec - exiting 19:36:10 (2361): No heartbeat from core client for 30 sec - exiting 19:36:11 (2361): No heartbeat from core client for 30 sec - exiting 19:36:12 (2361): No heartbeat from core client for 30 sec - exiting 19:36:13 (2361): No heartbeat from core client for 30 sec - exiting 19:36:14 (2361): No heartbeat from core client for 30 sec - exiting 19:36:15 (2361): No heartbeat from core client for 30 sec - exiting 19:36:16 (2361): No heartbeat from core client for 30 sec - exiting 19:36:17 (2361): No heartbeat from core client for 30 sec - exiting 19:36:18 (2361): No heartbeat from core client for 30 sec - exiting 19:36:19 (2361): No heartbeat from core client for 30 sec - exiting 19:36:20 (2361): No heartbeat from core client for 30 sec - exiting 19:36:21 (2361): No heartbeat from core client for 30 sec - exiting 19:36:22 (2361): No heartbeat from core client for 30 sec - exiting 19:36:23 (2361): No heartbeat from core client for 30 sec - exiting 19:36:24 (2361): No heartbeat from core client for 30 sec - exiting 19:36:25 (2361): No heartbeat from core client for 30 sec - exiting 19:36:26 (2361): No heartbeat from core client for 30 sec - exiting 19:36:27 (2361): No heartbeat from core client for 30 sec - exiting 19:36:28 (2361): No heartbeat from core client for 30 sec - exiting 19:36:29 (2361): No heartbeat from core client for 30 sec - exiting 19:36:30 (2361): No heartbeat from core client for 30 sec - exiting 19:36:31 (2361): No heartbeat from core client for 30 sec - exiting 19:36:32 (2361): No heartbeat from core client for 30 sec - exiting 19:36:33 (2361): No heartbeat from core client for 30 sec - exiting 19:36:34 (2361): No heartbeat from core client for 30 sec - exiting 19:36:35 (2361): No heartbeat from core client for 30 sec - exiting 19:36:36 (2361): No heartbeat from core client for 30 sec - exiting 19:36:37 (2361): No heartbeat from core client for 30 sec - exiting 19:36:38 (2361): No heartbeat from core client for 30 sec - exiting 19:36:39 (2361): No heartbeat from core client for 30 sec - exiting 19:36:40 (2361): No heartbeat from core client for 30 sec - exiting 19:36:41 (2361): No heartbeat from core client for 30 sec - exiting 19:36:42 (2361): No heartbeat from core client for 30 sec - exiting 19:36:43 (2361): No heartbeat from core client for 30 sec - exiting 19:36:44 (2361): No heartbeat from core client for 30 sec - exiting 19:36:45 (2361): No heartbeat from core client for 30 sec - exiting 19:36:46 (2361): No heartbeat from core client for 30 sec - exiting 19:36:47 (2361): No heartbeat from core client for 30 sec - exiting 19:36:48 (2361): No heartbeat from core client for 30 sec - exiting 19:36:49 (2361): No heartbeat from core client for 30 sec - exiting 19:36:50 (2361): No heartbeat from core client for 30 sec - exiting 19:36:51 (2361): No heartbeat from core client for 30 sec - exiting 19:36:52 (2361): No heartbeat from core client for 30 sec - exiting 19:36:53 (2361): No heartbeat from core client for 30 sec - exiting 19:36:54 (2361): No heartbeat from core client for 30 sec - exiting 19:36:55 (2361): No heartbeat from core client for 30 sec - exiting 19:36:56 (2361): No heartbeat from core client for 30 sec - exiting 19:36:57 (2361): No heartbeat from core client for 30 sec - exiting 19:36:58 (2361): No heartbeat from core client for 30 sec - exiting 19:36:59 (2361): No heartbeat from core client for 30 sec - exiting 19:37:00 (2361): No heartbeat from core client for 30 sec - exiting 19:37:01 (2361): No heartbeat from core client for 30 sec - exiting 19:37:02 (2361): No heartbeat from core client for 30 sec - exiting 19:37:03 (2361): No heartbeat from core client for 30 sec - exiting 19:37:04 (2361): No heartbeat from core client for 30 sec - exiting 19:37:05 (2361): No heartbeat from core client for 30 sec - exiting 19:37:06 (2361): No heartbeat from core client for 30 sec - exiting 19:37:07 (2361): No heartbeat from core client for 30 sec - exiting 19:37:08 (2361): No heartbeat from core client for 30 sec - exiting 19:37:09 (2361): No heartbeat from core client for 30 sec - exiting 19:37:10 (2361): No heartbeat from core client for 30 sec - exiting 19:37:11 (2361): No heartbeat from core client for 30 sec - exiting 19:37:12 (2361): No heartbeat from core client for 30 sec - exiting 19:37:13 (2361): No heartbeat from core client for 30 sec - exiting 19:37:14 (2361): No heartbeat from core client for 30 sec - exiting 19:37:15 (2361): No heartbeat from core client for 30 sec - exiting 19:37:16 (2361): No heartbeat from core client for 30 sec - exiting 19:37:17 (2361): No heartbeat from core client for 30 sec - exiting 19:37:18 (2361): No heartbeat from core client for 30 sec - exiting 19:37:19 (2361): No heartbeat from core client for 30 sec - exiting 19:37:20 (2361): No heartbeat from core client for 30 sec - exiting 19:37:21 (2361): No heartbeat from core client for 30 sec - exiting 19:37:22 (2361): No heartbeat from core client for 30 sec - exiting 19:37:23 (2361): No heartbeat from core client for 30 sec - exiting 19:37:24 (2361): No heartbeat from core client for 30 sec - exiting 19:37:25 (2361): No heartbeat from core client for 30 sec - exiting 19:37:26 (2361): No heartbeat from core client for 30 sec - exiting 19:37:27 (2361): No heartbeat from core client for 30 sec - exiting 19:37:28 (2361): No heartbeat from core client for 30 sec - exiting 19:37:29 (2361): No heartbeat from core client for 30 sec - exiting 19:37:30 (2361): No heartbeat from core client for 30 sec - exiting 19:37:31 (2361): No heartbeat from core client for 30 sec - exiting 19:37:32 (2361): No heartbeat from core client for 30 sec - exiting 19:37:33 (2361): No heartbeat from core client for 30 sec - exiting 19:37:34 (2361): No heartbeat from core client for 30 sec - exiting 19:37:35 (2361): No heartbeat from core client for 30 sec - exiting 19:37:36 (2361): No heartbeat from core client for 30 sec - exiting 19:37:37 (2361): No heartbeat from core client for 30 sec - exiting 19:37:38 (2361): No heartbeat from core client for 30 sec - exiting 19:37:39 (2361): No heartbeat from core client for 30 sec - exiting 19:37:40 (2361): No heartbeat from core client for 30 sec - exiting 19:37:41 (2361): No heartbeat from core client for 30 sec - exiting 19:37:42 (2361): No heartbeat from core client for 30 sec - exiting 19:37:43 (2361): No heartbeat from core client for 30 sec - exiting 19:37:44 (2361): No heartbeat from core client for 30 sec - exiting 19:37:45 (2361): No heartbeat from core client for 30 sec - exiting 19:37:46 (2361): No heartbeat from core client for 30 sec - exiting 19:37:47 (2361): No heartbeat from core client for 30 sec - exiting 19:37:48 (2361): No heartbeat from core client for 30 sec - exiting 19:37:49 (2361): No heartbeat from core client for 30 sec - exiting 19:37:50 (2361): No heartbeat from core client for 30 sec - exiting 19:37:51 (2361): No heartbeat from core client for 30 sec - exiting 19:37:52 (2361): No heartbeat from core client for 30 sec - exiting 19:37:53 (2361): No heartbeat from core client for 30 sec - exiting 19:37:54 (2361): No heartbeat from core client for 30 sec - exiting 19:37:55 (2361): No heartbeat from core client for 30 sec - exiting 19:37:56 (2361): No heartbeat from core client for 30 sec - exiting 19:37:57 (2361): No heartbeat from core client for 30 sec - exiting 19:37:58 (2361): No heartbeat from core client for 30 sec - exiting 19:37:59 (2361): No heartbeat from core client for 30 sec - exiting 19:38:00 (2361): No heartbeat from core client for 30 sec - exiting 19:38:01 (2361): No heartbeat from core client for 30 sec - exiting 19:38:02 (2361): No heartbeat from core client for 30 sec - exiting 19:38:03 (2361): No heartbeat from core client for 30 sec - exiting 19:38:04 (2361): No heartbeat from core client for 30 sec - exiting 19:38:05 (2361): No heartbeat from core client for 30 sec - exiting 19:38:06 (2361): No heartbeat from core client for 30 sec - exiting 19:38:07 (2361): No heartbeat from core client for 30 sec - exiting 19:38:08 (2361): No heartbeat from core client for 30 sec - exiting 19:38:09 (2361): No heartbeat from core client for 30 sec - exiting 19:38:10 (2361): No heartbeat from core client for 30 sec - exiting 19:38:11 (2361): No heartbeat from core client for 30 sec - exiting 19:38:12 (2361): No heartbeat from core client for 30 sec - exiting 19:38:13 (2361): No heartbeat from core client for 30 sec - exiting 19:38:14 (2361): No heartbeat from core client for 30 sec - exiting 19:38:15 (2361): No heartbeat from core client for 30 sec - exiting 19:38:16 (2361): No heartbeat from core client for 30 sec - exiting 19:38:17 (2361): No heartbeat from core client for 30 sec - exiting 19:38:18 (2361): No heartbeat from core client for 30 sec - exiting 19:38:19 (2361): No heartbeat from core client for 30 sec - exiting 19:38:20 (2361): No heartbeat from core client for 30 sec - exiting 19:38:21 (2361): No heartbeat from core client for 30 sec - exiting 19:38:22 (2361): No heartbeat from core client for 30 sec - exiting 19:38:23 (2361): No heartbeat from core client for 30 sec - exiting 19:38:24 (2361): No heartbeat from core client for 30 sec - exiting 19:38:25 (2361): No heartbeat from core client for 30 sec - exiting 19:38:26 (2361): No heartbeat from core client for 30 sec - exiting 19:38:27 (2361): No heartbeat from core client for 30 sec - exiting 19:38:28 (2361): No heartbeat from core client for 30 sec - exiting 19:38:29 (2361): No heartbeat from core client for 30 sec - exiting 19:38:30 (2361): No heartbeat from core client for 30 sec - exiting 19:38:31 (2361): No heartbeat from core client for 30 sec - exiting 19:38:32 (2361): No heartbeat from core client for 30 sec - exiting 19:38:33 (2361): No heartbeat from core client for 30 sec - exiting 19:38:34 (2361): No heartbeat from core client for 30 sec - exiting 19:38:35 (2361): No heartbeat from core client for 30 sec - exiting 19:38:36 (2361): No heartbeat from core client for 30 sec - exiting 19:38:37 (2361): No heartbeat from core client for 30 sec - exiting 19:38:38 (2361): No heartbeat from core client for 30 sec - exiting 19:38:39 (2361): No heartbeat from core client for 30 sec - exiting 19:38:40 (2361): No heartbeat from core client for 30 sec - exiting 19:38:41 (2361): No heartbeat from core client for 30 sec - exiting 19:38:42 (2361): No heartbeat from core client for 30 sec - exiting 19:38:43 (2361): No heartbeat from core client for 30 sec - exiting 19:38:44 (2361): No heartbeat from core client for 30 sec - exiting 19:38:45 (2361): No heartbeat from core client for 30 sec - exiting 19:38:46 (2361): No heartbeat from core client for 30 sec - exiting 19:38:47 (2361): No heartbeat from core client for 30 sec - exiting 19:38:48 (2361): No heartbeat from core client for 30 sec - exiting 19:38:49 (2361): No heartbeat from core client for 30 sec - exiting 19:38:50 (2361): No heartbeat from core client for 30 sec - exiting 19:38:51 (2361): No heartbeat from core client for 30 sec - exiting 19:38:52 (2361): No heartbeat from core client for 30 sec - exiting 19:38:53 (2361): No heartbeat from core client for 30 sec - exiting 19:38:54 (2361): No heartbeat from core client for 30 sec - exiting 19:38:55 (2361): No heartbeat from core client for 30 sec - exiting 19:38:56 (2361): No heartbeat from core client for 30 sec - exiting 19:38:57 (2361): No heartbeat from core client for 30 sec - exiting 19:38:58 (2361): No heartbeat from core client for 30 sec - exiting 19:38:59 (2361): No heartbeat from core client for 30 sec - exiting 19:39:00 (2361): No heartbeat from core client for 30 sec - exiting 19:39:01 (2361): No heartbeat from core client for 30 sec - exiting 19:39:02 (2361): No heartbeat from core client for 30 sec - exiting 19:39:03 (2361): No heartbeat from core client for 30 sec - exiting 19:39:04 (2361): No heartbeat from core client for 30 sec - exiting 19:39:05 (2361): No heartbeat from core client for 30 sec - exiting 19:39:06 (2361): No heartbeat from core client for 30 sec - exiting 19:39:07 (2361): No heartbeat from core client for 30 sec - exiting 19:39:08 (2361): No heartbeat from core client for 30 sec - exiting 19:39:09 (2361): No heartbeat from core client for 30 sec - exiting 19:39:10 (2361): No heartbeat from core client for 30 sec - exiting 19:39:11 (2361): No heartbeat from core client for 30 sec - exiting 19:39:12 (2361): No heartbeat from core client for 30 sec - exiting 19:39:13 (2361): No heartbeat from core client for 30 sec - exiting 19:39:14 (2361): No heartbeat from core client for 30 sec - exiting 19:39:15 (2361): No heartbeat from core client for 30 sec - exiting 19:39:16 (2361): No heartbeat from core client for 30 sec - exiting 19:39:17 (2361): No heartbeat from core client for 30 sec - exiting 19:39:18 (2361): No heartbeat from core client for 30 sec - exiting 19:39:19 (2361): No heartbeat from core client for 30 sec - exiting 19:39:20 (2361): No heartbeat from core client for 30 sec - exiting 19:39:21 (2361): No heartbeat from core client for 30 sec - exiting 19:39:22 (2361): No heartbeat from core client for 30 sec - exiting 19:39:23 (2361): No heartbeat from core client for 30 sec - exiting 19:39:24 (2361): No heartbeat from core client for 30 sec - exiting 19:39:25 (2361): No heartbeat from core client for 30 sec - exiting 19:39:26 (2361): No heartbeat from core client for 30 sec - exiting 19:39:27 (2361): No heartbeat from core client for 30 sec - exiting 19:39:28 (2361): No heartbeat from core client for 30 sec - exiting 19:39:29 (2361): No heartbeat from core client for 30 sec - exiting 19:39:30 (2361): No heartbeat from core client for 30 sec - exiting 19:39:31 (2361): No heartbeat from core client for 30 sec - exiting 19:39:32 (2361): No heartbeat from core client for 30 sec - exiting 19:39:33 (2361): No heartbeat from core client for 30 sec - exiting 19:39:34 (2361): No heartbeat from core client for 30 sec - exiting 19:39:35 (2361): No heartbeat from core client for 30 sec - exiting 19:39:36 (2361): No heartbeat from core client for 30 sec - exiting 19:39:37 (2361): No heartbeat from core client for 30 sec - exiting 19:39:38 (2361): No heartbeat from core client for 30 sec - exiting 19:39:39 (2361): No heartbeat from core client for 30 sec - exiting 19:39:40 (2361): No heartbeat from core client for 30 sec - exiting 19:39:41 (2361): No heartbeat from core client for 30 sec - exiting 19:39:42 (2361): No heartbeat from core client for 30 sec - exiting 19:39:43 (2361): No heartbeat from core client for 30 sec - exiting 19:39:44 (2361): No heartbeat from core client for 30 sec - exiting 19:39:45 (2361): No heartbeat from core client for 30 sec - exiting 19:39:46 (2361): No heartbeat from core client for 30 sec - exiting 19:39:47 (2361): No heartbeat from core client for 30 sec - exiting 19:39:48 (2361): No heartbeat from core client for 30 sec - exiting 19:39:49 (2361): No heartbeat from core client for 30 sec - exiting 19:39:50 (2361): No heartbeat from core client for 30 sec - exiting 19:39:51 (2361): No heartbeat from core client for 30 sec - exiting 19:39:52 (2361): No heartbeat from core client for 30 sec - exiting 19:39:53 (2361): No heartbeat from core client for 30 sec - exiting 19:39:54 (2361): No heartbeat from core client for 30 sec - exiting 19:39:55 (2361): No heartbeat from core client for 30 sec - exiting 19:39:56 (2361): No heartbeat from core client for 30 sec - exiting 19:39:57 (2361): No heartbeat from core client for 30 sec - exiting 19:39:58 (2361): No heartbeat from core client for 30 sec - exiting 19:39:59 (2361): No heartbeat from core client for 30 sec - exiting 19:40:00 (2361): No heartbeat from core client for 30 sec - exiting 19:40:01 (2361): No heartbeat from core client for 30 sec - exiting 19:40:02 (2361): No heartbeat from core client for 30 sec - exiting 19:40:03 (2361): No heartbeat from core client for 30 sec - exiting 19:40:04 (2361): No heartbeat from core client for 30 sec - exiting 19:40:05 (2361): No heartbeat from core client for 30 sec - exiting 19:40:06 (2361): No heartbeat from core client for 30 sec - exiting 19:40:07 (2361): No heartbeat from core client for 30 sec - exiting 19:40:08 (2361): No heartbeat from core client for 30 sec - exiting 19:40:09 (2361): No heartbeat from core client for 30 sec - exiting 19:40:10 (2361): No heartbeat from core client for 30 sec - exiting 19:40:11 (2361): No heartbeat from core client for 30 sec - exiting 19:40:12 (2361): No heartbeat from core client for 30 sec - exiting 19:40:13 (2361): No heartbeat from core client for 30 sec - exiting 19:40:14 (2361): No heartbeat from core client for 30 sec - exiting 19:40:15 (2361): No heartbeat from core client for 30 sec - exiting 19:40:16 (2361): No heartbeat from core client for 30 sec - exiting 19:40:17 (2361): No heartbeat from core client for 30 sec - exiting 19:40:18 (2361): No heartbeat from core client for 30 sec - exiting 19:40:19 (2361): No heartbeat from core client for 30 sec - exiting 19:40:20 (2361): No heartbeat from core client for 30 sec - exiting 19:40:21 (2361): No heartbeat from core client for 30 sec - exiting 19:40:22 (2361): No heartbeat from core client for 30 sec - exiting 19:40:23 (2361): No heartbeat from core client for 30 sec - exiting 19:40:24 (2361): No heartbeat from core client for 30 sec - exiting 19:40:25 (2361): No heartbeat from core client for 30 sec - exiting 19:40:26 (2361): No heartbeat from core client for 30 sec - exiting 19:40:27 (2361): No heartbeat from core client for 30 sec - exiting 19:40:28 (2361): No heartbeat from core client for 30 sec - exiting 19:40:29 (2361): No heartbeat from core client for 30 sec - exiting 19:40:30 (2361): No heartbeat from core client for 30 sec - exiting 19:40:31 (2361): No heartbeat from core client for 30 sec - exiting 19:40:32 (2361): No heartbeat from core client for 30 sec - exiting 19:40:33 (2361): No heartbeat from core client for 30 sec - exiting 19:40:34 (2361): No heartbeat from core client for 30 sec - exiting 19:40:35 (2361): No heartbeat from core client for 30 sec - exiting 19:40:36 (2361): No heartbeat from core client for 30 sec - exiting 19:40:37 (2361): No heartbeat from core client for 30 sec - exiting 19:40:38 (2361): No heartbeat from core client for 30 sec - exiting 19:40:39 (2361): No heartbeat from core client for 30 sec - exiting 19:40:40 (2361): No heartbeat from core client for 30 sec - exiting 19:40:41 (2361): No heartbeat from core client for 30 sec - exiting 19:40:42 (2361): No heartbeat from core client for 30 sec - exiting 19:40:43 (2361): No heartbeat from core client for 30 sec - exiting 19:40:44 (2361): No heartbeat from core client for 30 sec - exiting 19:40:45 (2361): No heartbeat from core client for 30 sec - exiting 19:40:46 (2361): No heartbeat from core client for 30 sec - exiting 19:40:47 (2361): No heartbeat from core client for 30 sec - exiting 19:40:48 (2361): No heartbeat from core client for 30 sec - exiting 19:40:49 (2361): No heartbeat from core client for 30 sec - exiting 19:40:50 (2361): No heartbeat from core client for 30 sec - exiting 19:40:51 (2361): No heartbeat from core client for 30 sec - exiting 19:40:52 (2361): No heartbeat from core client for 30 sec - exiting 19:40:53 (2361): No heartbeat from core client for 30 sec - exiting 19:40:54 (2361): No heartbeat from core client for 30 sec - exiting 19:40:55 (2361): No heartbeat from core client for 30 sec - exiting 19:40:56 (2361): No heartbeat from core client for 30 sec - exiting 19:40:57 (2361): No heartbeat from core client for 30 sec - exiting 19:40:58 (2361): No heartbeat from core client for 30 sec - exiting 19:40:59 (2361): No heartbeat from core client for 30 sec - exiting 19:41:00 (2361): No heartbeat from core client for 30 sec - exiting 19:41:01 (2361): No heartbeat from core client for 30 sec - exiting 19:41:02 (2361): No heartbeat from core client for 30 sec - exiting 19:41:03 (2361): No heartbeat from core client for 30 sec - exiting 19:41:04 (2361): No heartbeat from core client for 30 sec - exiting 19:41:05 (2361): No heartbeat from core client for 30 sec - exiting 19:41:06 (2361): No heartbeat from core client for 30 sec - exiting 19:41:07 (2361): No heartbeat from core client for 30 sec - exiting 19:41:08 (2361): No heartbeat from core client for 30 sec - exiting 19:41:09 (2361): No heartbeat from core client for 30 sec - exiting 19:41:10 (2361): No heartbeat from core client for 30 sec - exiting 19:41:11 (2361): No heartbeat from core client for 30 sec - exiting 19:41:12 (2361): No heartbeat from core client for 30 sec - exiting 19:41:13 (2361): No heartbeat from core client for 30 sec - exiting 19:41:14 (2361): No heartbeat from core client for 30 sec - exiting 19:41:15 (2361): No heartbeat from core client for 30 sec - exiting 19:41:16 (2361): No heartbeat from core client for 30 sec - exiting 19:41:17 (2361): No heartbeat from core client for 30 sec - exiting 19:41:18 (2361): No heartbeat from core client for 30 sec - exiting 19:41:19 (2361): No heartbeat from core client for 30 sec - exiting 19:41:20 (2361): No heartbeat from core client for 30 sec - exiting 19:41:21 (2361): No heartbeat from core client for 30 sec - exiting 19:41:22 (2361): No heartbeat from core client for 30 sec - exiting 19:41:23 (2361): No heartbeat from core client for 30 sec - exiting 19:41:23 (3576): Can't acquire lockfile (-154) - waiting 35s 19:41:24 (2361): No heartbeat from core client for 30 sec - exiting 19:41:25 (2361): No heartbeat from core client for 30 sec - exiting 19:41:58 (3576): Can't acquire lockfile (-154) - exiting 19:42:14 (2361): No heartbeat from core client for 30 sec - exiting 19:42:15 (2361): No heartbeat from core client for 30 sec - exiting 19:42:16 (2361): No heartbeat from core client for 30 sec - exiting 19:42:17 (2361): No heartbeat from core client for 30 sec - exiting 19:42:18 (2361): No heartbeat from core client for 30 sec - exiting 19:42:19 (2361): No heartbeat from core client for 30 sec - exiting 19:42:20 (2361): No heartbeat from core client for 30 sec - exiting 19:42:21 (2361): No heartbeat from core client for 30 sec - exiting 19:42:22 (2361): No heartbeat from core client for 30 sec - exiting 19:42:23 (2361): No heartbeat from core client for 30 sec - exiting 19:42:24 (2361): No heartbeat from core client for 30 sec - exiting 19:42:25 (2361): No heartbeat from core client for 30 sec - exiting 19:42:26 (2361): No heartbeat from core client for 30 sec - exiting 19:42:27 (2361): No heartbeat from core client for 30 sec - exiting 19:42:28 (2361): No heartbeat from core client for 30 sec - exiting 19:42:29 (2361): No heartbeat from core client for 30 sec - exiting 19:42:30 (2361): No heartbeat from core client for 30 sec - exiting 19:42:31 (2361): No heartbeat from core client for 30 sec - exiting 19:42:32 (2361): No heartbeat from core client for 30 sec - exiting 19:42:33 (2361): No heartbeat from core client for 30 sec - exiting 19:42:34 (2361): No heartbeat from core client for 30 sec - exiting 19:42:35 (2361): No heartbeat from core client for 30 sec - exiting 19:42:36 (2361): No heartbeat from core client for 30 sec - exiting 19:42:37 (2361): No heartbeat from core client for 30 sec - exiting 19:42:38 (2361): No heartbeat from core client for 30 sec - exiting 19:42:39 (2361): No heartbeat from core client for 30 sec - exiting 19:42:40 (2361): No heartbeat from core client for 30 sec - exiting 19:42:41 (2361): No heartbeat from core client for 30 sec - exiting 19:42:42 (2361): No heartbeat from core client for 30 sec - exiting 19:42:43 (2361): No heartbeat from core client for 30 sec - exiting 19:42:44 (2361): No heartbeat from core client for 30 sec - exiting 19:42:45 (2361): No heartbeat from core client for 30 sec - exiting 19:42:46 (2361): No heartbeat from core client for 30 sec - exiting 19:42:47 (2361): No heartbeat from core client for 30 sec - exiting 19:42:48 (2361): No heartbeat from core client for 30 sec - exiting 19:42:49 (2361): No heartbeat from core client for 30 sec - exiting 19:42:50 (2361): No heartbeat from core client for 30 sec - exiting 19:42:51 (2361): No heartbeat from core client for 30 sec - exiting 19:42:52 (2361): No heartbeat from core client for 30 sec - exiting 19:42:53 (2361): No heartbeat from core client for 30 sec - exiting 19:42:54 (2361): No heartbeat from core client for 30 sec - exiting 19:42:55 (2361): No heartbeat from core client for 30 sec - exiting 19:42:56 (2361): No heartbeat from core client for 30 sec - exiting 19:42:57 (2361): No heartbeat from core client for 30 sec - exiting 19:42:58 (2361): No heartbeat from core client for 30 sec - exiting 19:42:59 (2361): No heartbeat from core client for 30 sec - exiting 19:43:00 (2361): No heartbeat from core client for 30 sec - exiting 19:43:01 (2361): No heartbeat from core client for 30 sec - exiting 19:43:02 (2361): No heartbeat from core client for 30 sec - exiting 19:43:03 (2361): No heartbeat from core client for 30 sec - exiting 19:43:04 (2361): No heartbeat from core client for 30 sec - exiting 19:43:05 (2361): No heartbeat from core client for 30 sec - exiting 19:43:06 (2361): No heartbeat from core client for 30 sec - exiting 19:43:07 (2361): No heartbeat from core client for 30 sec - exiting 19:43:08 (2361): No heartbeat from core client for 30 sec - exiting 19:43:09 (2361): No heartbeat from core client for 30 sec - exiting 19:43:10 (2361): No heartbeat from core client for 30 sec - exiting 19:43:11 (2361): No heartbeat from core client for 30 sec - exiting 19:43:12 (2361): No heartbeat from core client for 30 sec - exiting 19:43:13 (2361): No heartbeat from core client for 30 sec - exiting 19:43:14 (2361): No heartbeat from core client for 30 sec - exiting 19:43:15 (2361): No heartbeat from core client for 30 sec - exiting 19:43:16 (2361): No heartbeat from core client for 30 sec - exiting 19:43:17 (2361): No heartbeat from core client for 30 sec - exiting 19:43:18 (2361): No heartbeat from core client for 30 sec - exiting 19:43:19 (2361): No heartbeat from core client for 30 sec - exiting 19:43:20 (2361): No heartbeat from core client for 30 sec - exiting 19:43:21 (2361): No heartbeat from core client for 30 sec - exiting 19:43:22 (2361): No heartbeat from core client for 30 sec - exiting 19:43:23 (2361): No heartbeat from core client for 30 sec - exiting 19:43:24 (2361): No heartbeat from core client for 30 sec - exiting 19:43:25 (2361): No heartbeat from core client for 30 sec - exiting 19:43:26 (2361): No heartbeat from core client for 30 sec - exiting 19:43:27 (2361): No heartbeat from core client for 30 sec - exiting 19:43:28 (2361): No heartbeat from core client for 30 sec - exiting 19:43:29 (2361): No heartbeat from core client for 30 sec - exiting 19:43:30 (2361): No heartbeat from core client for 30 sec - exiting 19:43:31 (2361): No heartbeat from core client for 30 sec - exiting 19:43:32 (2361): No heartbeat from core client for 30 sec - exiting 19:43:33 (2361): No heartbeat from core client for 30 sec - exiting 19:43:34 (2361): No heartbeat from core client for 30 sec - exiting 19:43:35 (2361): No heartbeat from core client for 30 sec - exiting 19:43:36 (2361): No heartbeat from core client for 30 sec - exiting 19:43:37 (2361): No heartbeat from core client for 30 sec - exiting 19:43:38 (2361): No heartbeat from core client for 30 sec - exiting 19:43:39 (2361): No heartbeat from core client for 30 sec - exiting 19:43:40 (2361): No heartbeat from core client for 30 sec - exiting 19:43:41 (2361): No heartbeat from core client for 30 sec - exiting 19:43:42 (2361): No heartbeat from core client for 30 sec - exiting 19:43:43 (3669): Can't acquire lockfile (-154) - waiting 35s 19:43:43 (2361): No heartbeat from core client for 30 sec - exiting 19:43:44 (2361): No heartbeat from core client for 30 sec - exiting 19:44:18 (3669): Can't acquire lockfile (-154) - exiting 19:44:40 (2361): No heartbeat from core client for 30 sec - exiting 19:44:41 (2361): No heartbeat from core client for 30 sec - exiting 19:44:42 (2361): No heartbeat from core client for 30 sec - exiting 19:44:43 (2361): No heartbeat from core client for 30 sec - exiting 19:44:44 (2361): No heartbeat from core client for 30 sec - exiting 19:44:45 (2361): No heartbeat from core client for 30 sec - exiting 19:44:46 (2361): No heartbeat from core client for 30 sec - exiting 19:44:47 (2361): No heartbeat from core client for 30 sec - exiting 19:44:48 (2361): No heartbeat from core client for 30 sec - exiting 19:44:49 (2361): No heartbeat from core client for 30 sec - exiting 19:44:50 (2361): No heartbeat from core client for 30 sec - exiting 19:44:51 (2361): No heartbeat from core client for 30 sec - exiting 19:44:52 (2361): No heartbeat from core client for 30 sec - exiting 19:44:53 (2361): No heartbeat from core client for 30 sec - exiting 19:44:54 (2361): No heartbeat from core client for 30 sec - exiting 19:44:55 (2361): No heartbeat from core client for 30 sec - exiting 19:44:56 (2361): No heartbeat from core client for 30 sec - exiting 19:44:57 (2361): No heartbeat from core client for 30 sec - exiting 19:44:58 (2361): No heartbeat from core client for 30 sec - exiting 19:44:59 (2361): No heartbeat from core client for 30 sec - exiting 19:45:00 (2361): No heartbeat from core client for 30 sec - exiting 19:45:01 (2361): No heartbeat from core client for 30 sec - exiting 19:45:02 (2361): No heartbeat from core client for 30 sec - exiting 19:45:03 (2361): No heartbeat from core client for 30 sec - exiting 19:45:04 (2361): No heartbeat from core client for 30 sec - exiting 19:45:05 (2361): No heartbeat from core client for 30 sec - exiting 19:45:06 (2361): No heartbeat from core client for 30 sec - exiting 19:45:07 (2361): No heartbeat from core client for 30 sec - exiting 19:45:08 (2361): No heartbeat from core client for 30 sec - exiting 19:45:09 (2361): No heartbeat from core client for 30 sec - exiting 19:45:10 (2361): No heartbeat from core client for 30 sec - exiting 19:45:11 (2361): No heartbeat from core client for 30 sec - exiting 19:45:12 (2361): No heartbeat from core client for 30 sec - exiting 19:45:13 (2361): No heartbeat from core client for 30 sec - exiting 19:45:14 (2361): No heartbeat from core client for 30 sec - exiting 19:45:15 (2361): No heartbeat from core client for 30 sec - exiting 19:45:16 (2361): No heartbeat from core client for 30 sec - exiting 19:45:17 (2361): No heartbeat from core client for 30 sec - exiting 19:45:18 (2361): No heartbeat from core client for 30 sec - exiting 19:45:19 (2361): No heartbeat from core client for 30 sec - exiting 19:45:20 (2361): No heartbeat from core client for 30 sec - exiting 19:45:21 (2361): No heartbeat from core client for 30 sec - exiting 19:45:22 (2361): No heartbeat from core client for 30 sec - exiting 19:45:23 (2361): No heartbeat from core client for 30 sec - exiting 19:45:24 (2361): No heartbeat from core client for 30 sec - exiting 19:45:25 (2361): No heartbeat from core client for 30 sec - exiting 19:45:26 (2361): No heartbeat from core client for 30 sec - exiting 19:45:27 (2361): No heartbeat from core client for 30 sec - exiting 19:45:28 (2361): No heartbeat from core client for 30 sec - exiting 19:45:29 (2361): No heartbeat from core client for 30 sec - exiting 19:45:30 (2361): No heartbeat from core client for 30 sec - exiting 19:45:31 (2361): No heartbeat from core client for 30 sec - exiting 19:45:32 (2361): No heartbeat from core client for 30 sec - exiting 19:45:33 (2361): No heartbeat from core client for 30 sec - exiting 19:45:34 (2361): No heartbeat from core client for 30 sec - exiting 19:45:35 (2361): No heartbeat from core client for 30 sec - exiting 19:45:36 (2361): No heartbeat from core client for 30 sec - exiting 19:45:37 (2361): No heartbeat from core client for 30 sec - exiting 19:45:38 (2361): No heartbeat from core client for 30 sec - exiting 19:45:39 (2361): No heartbeat from core client for 30 sec - exiting 19:45:40 (2361): No heartbeat from core client for 30 sec - exiting 19:45:41 (2361): No heartbeat from core client for 30 sec - exiting 19:45:42 (2361): No heartbeat from core client for 30 sec - exiting 19:45:43 (2361): No heartbeat from core client for 30 sec - exiting 19:45:44 (2361): No heartbeat from core client for 30 sec - exiting 19:45:45 (2361): No heartbeat from core client for 30 sec - exiting 19:45:46 (2361): No heartbeat from core client for 30 sec - exiting 19:45:47 (2361): No heartbeat from core client for 30 sec - exiting 19:45:48 (2361): No heartbeat from core client for 30 sec - exiting 19:45:49 (2361): No heartbeat from core client for 30 sec - exiting 19:45:50 (2361): No heartbeat from core client for 30 sec - exiting 19:45:51 (2361): No heartbeat from core client for 30 sec - exiting 19:45:52 (2361): No heartbeat from core client for 30 sec - exiting 19:45:53 (2361): No heartbeat from core client for 30 sec - exiting 19:45:54 (2361): No heartbeat from core client for 30 sec - exiting 19:45:55 (2361): No heartbeat from core client for 30 sec - exiting 19:45:56 (2361): No heartbeat from core client for 30 sec - exiting 19:45:57 (2361): No heartbeat from core client for 30 sec - exiting 19:45:58 (2361): No heartbeat from core client for 30 sec - exiting 19:45:59 (2361): No heartbeat from core client for 30 sec - exiting 19:46:00 (2361): No heartbeat from core client for 30 sec - exiting 19:46:01 (2361): No heartbeat from core client for 30 sec - exiting 19:46:02 (2361): No heartbeat from core client for 30 sec - exiting 19:46:03 (2361): No heartbeat from core client for 30 sec - exiting 19:46:04 (2361): No heartbeat from core client for 30 sec - exiting 19:46:05 (2361): No heartbeat from core client for 30 sec - exiting 19:46:06 (2361): No heartbeat from core client for 30 sec - exiting 19:46:07 (2361): No heartbeat from core client for 30 sec - exiting 19:46:08 (2361): No heartbeat from core client for 30 sec - exiting 19:46:09 (2361): No heartbeat from core client for 30 sec - exiting 19:46:10 (2361): No heartbeat from core client for 30 sec - exiting 19:46:11 (2361): No heartbeat from core client for 30 sec - exiting 19:46:12 (2361): No heartbeat from core client for 30 sec - exiting 19:46:13 (2361): No heartbeat from core client for 30 sec - exiting 19:46:14 (2361): No heartbeat from core client for 30 sec - exiting 19:46:15 (2361): No heartbeat from core client for 30 sec - exiting 19:46:16 (2361): No heartbeat from core client for 30 sec - exiting 19:46:17 (2361): No heartbeat from core client for 30 sec - exiting 19:46:18 (2361): No heartbeat from core client for 30 sec - exiting 19:46:19 (2361): No heartbeat from core client for 30 sec - exiting 19:46:20 (2361): No heartbeat from core client for 30 sec - exiting 19:46:21 (2361): No heartbeat from core client for 30 sec - exiting Signal 15 received, exiting... Called boinc_finish 19:46:22 (2361): No heartbeat from core client for 30 sec - exiting 19:46:23 (2361): No heartbeat from core client for 30 sec - exiting hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09ae4850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x097f4850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08f2b850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09388850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09738850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a04850 *** hadcm3n_6.07_i686-pc-linux-gnu: malloc.c:2451: sYSMALLOc: Assertion `(old_top == (((mbinptr) (((char *) &((av)->bins[((1) - 1) * 2])) - __builtin_offsetof (struct malloc_chunk, fd)))) && old_size == 0) || ((unsigned long) (old_size) >= (unsigned long)((((__builtin_offsetof (struct malloc_chunk, fd_nextsize))+((2 * (sizeof(size_t))) - 1)) & ~((2 * (sizeof(size_t))) - 1))) && ((old_top)->size & 0x1) && ((unsigned long)old_end & pagemask) == 0)' failed. SIGABRT: abort called Signal 15 received, exiting... Called boinc_finish execv: No such file or directory </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
02 Jun 2013 09:13:53 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 1,036,800 | 2,262,805 | 2.1825 |
01 Jun 2013 17:44:28 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 1,010,880 | 2,207,435 | 2.1837 |
31 May 2013 23:10:37 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 984,960 | 2,152,350 | 2.1852 |
27 May 2013 03:11:58 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 959,040 | 2,096,379 | 2.1859 |
25 May 2013 19:40:20 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 933,120 | 2,039,720 | 2.1859 |
24 May 2013 20:47:03 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 907,200 | 1,983,554 | 2.1865 |
22 May 2013 18:39:23 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 881,280 | 1,926,895 | 2.1865 |
20 May 2013 18:44:57 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 855,360 | 1,870,770 | 2.1871 |
16 May 2013 20:29:13 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 829,440 | 1,813,827 | 2.1868 |
15 May 2013 00:07:28 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 803,520 | 1,756,385 | 2.1859 |
12 May 2013 13:17:32 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 777,600 | 1,700,262 | 2.1866 |
11 May 2013 13:04:44 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 751,680 | 1,643,751 | 2.1868 |
05 May 2013 20:33:55 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 725,760 | 1,586,741 | 2.1863 |
05 May 2013 01:02:49 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 699,840 | 1,530,350 | 2.1867 |
04 May 2013 02:59:39 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 673,920 | 1,473,788 | 2.1869 |
02 May 2013 14:10:15 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 648,000 | 1,416,989 | 2.1867 |
01 May 2013 11:59:49 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 622,080 | 1,360,737 | 2.1874 |
30 Apr 2013 18:47:35 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 596,160 | 1,303,751 | 2.1869 |
28 Apr 2013 08:56:08 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 570,240 | 1,246,548 | 2.1860 |
25 Apr 2013 21:49:01 | 1026511 | 15651914 | hadcm3n_488z_1980_40_008324969_0 | 544,320 | 1,189,860 | 2.1860 |
©2024 climateprediction.net