climateprediction.net home page
Task 12738031

Task 12738031

Name hadcm3n_o2dv_1900_40_007198422_0
Workunit 7396702
Created 28 Mar 2011, 14:03:24 UTC
Sent 1 Apr 2011, 2:10:46 UTC
Report deadline 1 Jul 2011, 9:37:57 UTC
Received 14 Sep 2011, 1:54:35 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1005642
Run time 10 days 10 hours 0 min 25 sec
CPU time 6 days 9 hours 6 min 1 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 1.98 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.6.37</core_client_version>
<![CDATA[
<message>
too many exit(0)s
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
00:02:45 (15473): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09961778 ***
Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=22976, selfPID=22976, iMonCtr=1
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09e07dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08759dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090aadd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08bfcdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08839dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09074dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08207dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c7fdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x095fadd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c2add0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0937add0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09b26dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08cccdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x083dcdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x099bcdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09bdcdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x099acdd0 ***
23:45:04 (7577): No heartbeat from core client for 30 sec - exiting
23:45:05 (7577): No heartbeat from core client for 30 sec - exiting
23:45:06 (7577): No heartbeat from core client for 30 sec - exiting
23:45:07 (7577): No heartbeat from core client for 30 sec - exiting
23:45:08 (7577): No heartbeat from core client for 30 sec - exiting
23:45:09 (7577): No heartbeat from core client for 30 sec - exiting
23:45:10 (7577): No heartbeat from core client for 30 sec - exiting
23:45:11 (7577): No heartbeat from core client for 30 sec - exiting
23:45:12 (7577): No heartbeat from core client for 30 sec - exiting
23:45:13 (7577): No heartbeat from core client for 30 sec - exiting
23:45:14 (7577): No heartbeat from core client for 30 sec - exiting
23:45:47 (7577): No heartbeat from core client for 30 sec - exiting
23:45:48 (7577): No heartbeat from core client for 30 sec - exiting
23:45:49 (7577): No heartbeat from core client for 30 sec - exiting
23:45:50 (7577): No heartbeat from core client for 30 sec - exiting
23:45:51 (7577): No heartbeat from core client for 30 sec - exiting
23:45:52 (7577): No heartbeat from core client for 30 sec - exiting
23:45:53 (7577): No heartbeat from core client for 30 sec - exiting
23:45:54 (7577): No heartbeat from core client for 30 sec - exiting
23:45:55 (7577): No heartbeat from core client for 30 sec - exiting
23:45:56 (7577): No heartbeat from core client for 30 sec - exiting
23:45:57 (7577): No heartbeat from core client for 30 sec - exiting
23:45:58 (7577): No heartbeat from core client for 30 sec - exiting
23:46:29 (7577): No heartbeat from core client for 30 sec - exiting
23:46:30 (7577): No heartbeat from core client for 30 sec - exiting
23:46:31 (7577): No heartbeat from core client for 30 sec - exiting
23:46:32 (7577): No heartbeat from core client for 30 sec - exiting
23:46:33 (7577): No heartbeat from core client for 30 sec - exiting
23:46:34 (7577): No heartbeat from core client for 30 sec - exiting
23:46:35 (7577): No heartbeat from core client for 30 sec - exiting
23:46:36 (7577): No heartbeat from core client for 30 sec - exiting
23:46:37 (7577): No heartbeat from core client for 30 sec - exiting
23:46:38 (7577): No heartbeat from core client for 30 sec - exiting
23:46:39 (7577): No heartbeat from core client for 30 sec - exiting
23:47:11 (7577): No heartbeat from core client for 30 sec - exiting
23:47:12 (7577): No heartbeat from core client for 30 sec - exiting
23:47:13 (7577): No heartbeat from core client for 30 sec - exiting
23:47:14 (7577): No heartbeat from core client for 30 sec - exiting
23:47:15 (7577): No heartbeat from core client for 30 sec - exiting
23:47:16 (7577): No heartbeat from core client for 30 sec - exiting
23:47:17 (7577): No heartbeat from core client for 30 sec - exiting
23:47:18 (7577): No heartbeat from core client for 30 sec - exiting
23:47:19 (7577): No heartbeat from core client for 30 sec - exiting
23:47:20 (7577): No heartbeat from core client for 30 sec - exiting
23:47:21 (7577): No heartbeat from core client for 30 sec - exiting
23:48:12 (7577): No heartbeat from core client for 30 sec - exiting
23:48:13 (7577): No heartbeat from core client for 30 sec - exiting
23:48:14 (7577): No heartbeat from core client for 30 sec - exiting
23:48:15 (7577): No heartbeat from core client for 30 sec - exiting
23:48:16 (7577): No heartbeat from core client for 30 sec - exiting
23:48:17 (7577): No heartbeat from core client for 30 sec - exiting
23:48:18 (7577): No heartbeat from core client for 30 sec - exiting
23:48:19 (7577): No heartbeat from core client for 30 sec - exiting
23:48:20 (7577): No heartbeat from core client for 30 sec - exiting
23:48:21 (7577): No heartbeat from core client for 30 sec - exiting
23:48:22 (7577): No heartbeat from core client for 30 sec - exiting
23:48:54 (7577): No heartbeat from core client for 30 sec - exiting
23:48:55 (7577): No heartbeat from core client for 30 sec - exiting
23:48:56 (7577): No heartbeat from core client for 30 sec - exiting
23:48:57 (7577): No heartbeat from core client for 30 sec - exiting
23:48:58 (7577): No heartbeat from core client for 30 sec - exiting
23:48:59 (7577): No heartbeat from core client for 30 sec - exiting
23:49:00 (7577): No heartbeat from core client for 30 sec - exiting
23:49:01 (7577): No heartbeat from core client for 30 sec - exiting
23:49:02 (7577): No heartbeat from core client for 30 sec - exiting
23:49:03 (7577): No heartbeat from core client for 30 sec - exiting
23:49:04 (7577): No heartbeat from core client for 30 sec - exiting
23:49:55 (7577): No heartbeat from core client for 30 sec - exiting
23:49:56 (7577): No heartbeat from core client for 30 sec - exiting
23:49:57 (7577): No heartbeat from core client for 30 sec - exiting
23:49:58 (7577): No heartbeat from core client for 30 sec - exiting
23:49:59 (7577): No heartbeat from core client for 30 sec - exiting
23:50:00 (7577): No heartbeat from core client for 30 sec - exiting
23:50:01 (7577): No heartbeat from core client for 30 sec - exiting
23:50:02 (7577): No heartbeat from core client for 30 sec - exiting
23:50:03 (7577): No heartbeat from core client for 30 sec - exiting
23:50:04 (7577): No heartbeat from core client for 30 sec - exiting
23:50:05 (7577): No heartbeat from core client for 30 sec - exiting
23:50:37 (7577): No heartbeat from core client for 30 sec - exiting
23:50:38 (7577): No heartbeat from core client for 30 sec - exiting
23:50:39 (7577): No heartbeat from core client for 30 sec - exiting
23:50:40 (7577): No heartbeat from core client for 30 sec - exiting
23:50:41 (7577): No heartbeat from core client for 30 sec - exiting
23:50:42 (7577): No heartbeat from core client for 30 sec - exiting
23:50:43 (7577): No heartbeat from core client for 30 sec - exiting
23:50:44 (7577): No heartbeat from core client for 30 sec - exiting
23:50:45 (7577): No heartbeat from core client for 30 sec - exiting
23:50:46 (7577): No heartbeat from core client for 30 sec - exiting
23:50:47 (7577): No heartbeat from core client for 30 sec - exiting
23:51:38 (7577): No heartbeat from core client for 30 sec - exiting
23:51:39 (7577): No heartbeat from core client for 30 sec - exiting
23:51:40 (7577): No heartbeat from core client for 30 sec - exiting
23:51:41 (7577): No heartbeat from core client for 30 sec - exiting
23:51:42 (7577): No heartbeat from core client for 30 sec - exiting
23:51:43 (7577): No heartbeat from core client for 30 sec - exiting
23:51:44 (7577): No heartbeat from core client for 30 sec - exiting
23:51:45 (7577): No heartbeat from core client for 30 sec - exiting
23:51:46 (7577): No heartbeat from core client for 30 sec - exiting
23:51:47 (7577): No heartbeat from core client for 30 sec - exiting
23:51:48 (7577): No heartbeat from core client for 30 sec - exiting
23:52:20 (7577): No heartbeat from core client for 30 sec - exiting
23:52:21 (7577): No heartbeat from core client for 30 sec - exiting
23:52:22 (7577): No heartbeat from core client for 30 sec - exiting
23:52:23 (7577): No heartbeat from core client for 30 sec - exiting
23:52:24 (7577): No heartbeat from core client for 30 sec - exiting
23:52:25 (7577): No heartbeat from core client for 30 sec - exiting
23:52:26 (7577): No heartbeat from core client for 30 sec - exiting
23:52:27 (7577): No heartbeat from core client for 30 sec - exiting
23:52:28 (7577): No heartbeat from core client for 30 sec - exiting
23:52:29 (7577): No heartbeat from core client for 30 sec - exiting
23:52:30 (7577): No heartbeat from core client for 30 sec - exiting
23:53:21 (7577): No heartbeat from core client for 30 sec - exiting
23:53:22 (7577): No heartbeat from core client for 30 sec - exiting
23:53:23 (7577): No heartbeat from core client for 30 sec - exiting
23:53:24 (7577): No heartbeat from core client for 30 sec - exiting
23:53:25 (7577): No heartbeat from core client for 30 sec - exiting
23:53:26 (7577): No heartbeat from core client for 30 sec - exiting
23:53:27 (7577): No heartbeat from core client for 30 sec - exiting
23:53:28 (7577): No heartbeat from core client for 30 sec - exiting
23:53:29 (7577): No heartbeat from core client for 30 sec - exiting
23:53:30 (7577): No heartbeat from core client for 30 sec - exiting
23:53:31 (7577): No heartbeat from core client for 30 sec - exiting
23:54:03 (7577): No heartbeat from core client for 30 sec - exiting
23:54:04 (7577): No heartbeat from core client for 30 sec - exiting
23:54:05 (7577): No heartbeat from core client for 30 sec - exiting
23:54:06 (7577): No heartbeat from core client for 30 sec - exiting
23:54:07 (7577): No heartbeat from core client for 30 sec - exiting
23:54:08 (7577): No heartbeat from core client for 30 sec - exiting
23:54:09 (7577): No heartbeat from core client for 30 sec - exiting
23:54:10 (7577): No heartbeat from core client for 30 sec - exiting
23:54:11 (7577): No heartbeat from core client for 30 sec - exiting
23:54:12 (7577): No heartbeat from core client for 30 sec - exiting
23:54:13 (7577): No heartbeat from core client for 30 sec - exiting
23:55:04 (7577): No heartbeat from core client for 30 sec - exiting
23:55:05 (7577): No heartbeat from core client for 30 sec - exiting
23:55:06 (7577): No heartbeat from core client for 30 sec - exiting
23:55:07 (7577): No heartbeat from core client for 30 sec - exiting
23:55:08 (7577): No heartbeat from core client for 30 sec - exiting
23:55:09 (7577): No heartbeat from core client for 30 sec - exiting
23:55:10 (7577): No heartbeat from core client for 30 sec - exiting
23:55:11 (7577): No heartbeat from core client for 30 sec - exiting
23:55:12 (7577): No heartbeat from core client for 30 sec - exiting
23:55:13 (7577): No heartbeat from core client for 30 sec - exiting
23:55:14 (7577): No heartbeat from core client for 30 sec - exiting
23:55:46 (7577): No heartbeat from core client for 30 sec - exiting
23:55:47 (7577): No heartbeat from core client for 30 sec - exiting
23:55:48 (7577): No heartbeat from core client for 30 sec - exiting
23:55:49 (7577): No heartbeat from core client for 30 sec - exiting
23:55:50 (7577): No heartbeat from core client for 30 sec - exiting
23:55:51 (7577): No heartbeat from core client for 30 sec - exiting
23:55:52 (7577): No heartbeat from core client for 30 sec - exiting
23:55:53 (7577): No heartbeat from core client for 30 sec - exiting
23:55:54 (7577): No heartbeat from core client for 30 sec - exiting
23:55:55 (7577): No heartbeat from core client for 30 sec - exiting
23:55:56 (7577): No heartbeat from core client for 30 sec - exiting
23:56:47 (7577): No heartbeat from core client for 30 sec - exiting
23:56:48 (7577): No heartbeat from core client for 30 sec - exiting
23:56:49 (7577): No heartbeat from core client for 30 sec - exiting
23:56:50 (7577): No heartbeat from core client for 30 sec - exiting
23:56:51 (7577): No heartbeat from core client for 30 sec - exiting
23:56:52 (7577): No heartbeat from core client for 30 sec - exiting
23:56:53 (7577): No heartbeat from core client for 30 sec - exiting
23:56:54 (7577): No heartbeat from core client for 30 sec - exiting
23:56:55 (7577): No heartbeat from core client for 30 sec - exiting
23:56:56 (7577): No heartbeat from core client for 30 sec - exiting
23:56:57 (7577): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09738dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x088d7dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c4edd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09f46dd0 ***
00:25:40 (5453): No heartbeat from core client for 30 sec - exiting
00:25:41 (5453): No heartbeat from core client for 30 sec - exiting
00:25:42 (5453): No heartbeat from core client for 30 sec - exiting
00:25:43 (5453): No heartbeat from core client for 30 sec - exiting
00:25:44 (5453): No heartbeat from core client for 30 sec - exiting
00:25:45 (5453): No heartbeat from core client for 30 sec - exiting
00:25:46 (5453): No heartbeat from core client for 30 sec - exiting
00:25:47 (5453): No heartbeat from core client for 30 sec - exiting
00:25:48 (5453): No heartbeat from core client for 30 sec - exiting
00:25:49 (5453): No heartbeat from core client for 30 sec - exiting
00:25:50 (5453): No heartbeat from core client for 30 sec - exiting
00:26:22 (5453): No heartbeat from core client for 30 sec - exiting
00:26:23 (5453): No heartbeat from core client for 30 sec - exiting
00:26:24 (5453): No heartbeat from core client for 30 sec - exiting
00:26:25 (5453): No heartbeat from core client for 30 sec - exiting
00:26:26 (5453): No heartbeat from core client for 30 sec - exiting
00:26:27 (5453): No heartbeat from core client for 30 sec - exiting
00:26:28 (5453): No heartbeat from core client for 30 sec - exiting
00:26:29 (5453): No heartbeat from core client for 30 sec - exiting
00:26:30 (5453): No heartbeat from core client for 30 sec - exiting
00:26:31 (5453): No heartbeat from core client for 30 sec - exiting
00:26:32 (5453): No heartbeat from core client for 30 sec - exiting
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08f06dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09ea9dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08fd4dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09637dd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08c7fdd0 ***
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a8edd0 ***
19:50:08 (5491): Can't acquire lockfile (-154) - waiting 35s
19:50:43 (5491): Can't acquire lockfile (-154) - exiting
19:50:43 (5700): Can't acquire lockfile (-154) - waiting 35s
19:51:18 (5700): Can't acquire lockfile (-154) - exiting
19:51:18 (5701): Can't acquire lockfile (-154) - waiting 35s
19:51:53 (5701): Can't acquire lockfile (-154) - exiting
19:51:53 (5702): Can't acquire lockfile (-154) - waiting 35s
19:52:28 (5702): Can't acquire lockfile (-154) - exiting
19:52:28 (5759): Can't acquire lockfile (-154) - waiting 35s
19:53:03 (5759): Can't acquire lockfile (-154) - exiting
19:53:04 (5918): Can't acquire lockfile (-154) - waiting 35s
19:53:39 (5918): Can't acquire lockfile (-154) - exiting
19:53:39 (5919): Can't acquire lockfile (-154) - waiting 35s
19:54:14 (5919): Can't acquire lockfile (-154) - exiting
19:54:14 (5922): Can't acquire lockfile (-154) - waiting 35s
19:54:49 (5922): Can't acquire lockfile (-154) - exiting
19:54:50 (5927): Can't acquire lockfile (-154) - waiting 35s
19:55:25 (5927): Can't acquire lockfile (-154) - exiting
19:55:25 (5935): Can't acquire lockfile (-154) - waiting 35s
19:56:00 (5935): Can't acquire lockfile (-154) - exiting
19:56:00 (5947): Can't acquire lockfile (-154) - waiting 35s
19:56:35 (5947): Can't acquire lockfile (-154) - exiting
19:56:35 (5950): Can't acquire lockfile (-154) - waiting 35s
19:57:10 (5950): Can't acquire lockfile (-154) - exiting
19:57:11 (6089): Can't acquire lockfile (-154) - waiting 35s
19:57:46 (6089): Can't acquire lockfile (-154) - exiting
19:57:46 (6140): Can't acquire lockfile (-154) - waiting 35s
19:58:21 (6140): Can't acquire lockfile (-154) - exiting
19:58:21 (6220): Can't acquire lockfile (-154) - waiting 35s
19:58:56 (6220): Can't acquire lockfile (-154) - exiting
19:58:57 (6291): Can't acquire lockfile (-154) - waiting 35s
19:59:32 (6291): Can't acquire lockfile (-154) - exiting
19:59:32 (6345): Can't acquire lockfile (-154) - waiting 35s
20:00:07 (6345): Can't acquire lockfile (-154) - exiting
20:00:08 (6351): Can't acquire lockfile (-154) - waiting 35s
20:00:43 (6351): Can't acquire lockfile (-154) - exiting
20:00:43 (6389): Can't acquire lockfile (-154) - waiting 35s
20:01:18 (6389): Can't acquire lockfile (-154) - exiting
20:01:18 (6413): Can't acquire lockfile (-154) - waiting 35s
20:01:53 (6413): Can't acquire lockfile (-154) - exiting
20:01:54 (6414): Can't acquire lockfile (-154) - waiting 35s
20:02:29 (6414): Can't acquire lockfile (-154) - exiting
20:02:29 (6415): Can't acquire lockfile (-154) - waiting 35s
20:03:04 (6415): Can't acquire lockfile (-154) - exiting
20:03:04 (6417): Can't acquire lockfile (-154) - waiting 35s
20:03:39 (6417): Can't acquire lockfile (-154) - exiting
20:03:40 (6419): Can't acquire lockfile (-154) - waiting 35s
20:04:15 (6419): Can't acquire lockfile (-154) - exiting
20:04:15 (6420): Can't acquire lockfile (-154) - waiting 35s
20:04:50 (6420): Can't acquire lockfile (-154) - exiting
20:04:50 (6421): Can't acquire lockfile (-154) - waiting 35s
20:05:25 (6421): Can't acquire lockfile (-154) - exiting
20:05:25 (6422): Can't acquire lockfile (-154) - waiting 35s
20:06:00 (6422): Can't acquire lockfile (-154) - exiting
20:06:01 (6423): Can't acquire lockfile (-154) - waiting 35s
20:06:36 (6423): Can't acquire lockfile (-154) - exiting
20:06:36 (6425): Can't acquire lockfile (-154) - waiting 35s
20:07:11 (6425): Can't acquire lockfile (-154) - exiting
20:07:11 (6426): Can't acquire lockfile (-154) - waiting 35s
20:07:46 (6426): Can't acquire lockfile (-154) - exiting
20:07:47 (6427): Can't acquire lockfile (-154) - waiting 35s
20:08:22 (6427): Can't acquire lockfile (-154) - exiting
20:08:22 (6489): Can't acquire lockfile (-154) - waiting 35s
20:08:57 (6489): Can't acquire lockfile (-154) - exiting
20:08:57 (6569): Can't acquire lockfile (-154) - waiting 35s
20:09:32 (6569): Can't acquire lockfile (-154) - exiting
20:09:33 (6573): Can't acquire lockfile (-154) - waiting 35s
20:10:08 (6573): Can't acquire lockfile (-154) - exiting
20:10:08 (6577): Can't acquire lockfile (-154) - waiting 35s
20:10:43 (6577): Can't acquire lockfile (-154) - exiting
20:10:44 (6611): Can't acquire lockfile (-154) - waiting 35s
20:11:19 (6611): Can't acquire lockfile (-154) - exiting
20:11:19 (6623): Can't acquire lockfile (-154) - waiting 35s
20:11:54 (6623): Can't acquire lockfile (-154) - exiting
20:11:54 (6638): Can't acquire lockfile (-154) - waiting 35s
20:12:29 (6638): Can't acquire lockfile (-154) - exiting
20:12:30 (6640): Can't acquire lockfile (-154) - waiting 35s
20:13:05 (6640): Can't acquire lockfile (-154) - exiting
20:13:05 (6642): Can't acquire lockfile (-154) - waiting 35s
20:13:40 (6642): Can't acquire lockfile (-154) - exiting
20:13:40 (6646): Can't acquire lockfile (-154) - waiting 35s
20:14:15 (6646): Can't acquire lockfile (-154) - exiting
20:14:16 (6648): Can't acquire lockfile (-154) - waiting 35s
20:14:51 (6648): Can't acquire lockfile (-154) - exiting
20:14:51 (6649): Can't acquire lockfile (-154) - waiting 35s
20:15:26 (6649): Can't acquire lockfile (-154) - exiting
20:15:26 (6665): Can't acquire lockfile (-154) - waiting 35s
20:16:01 (6665): Can't acquire lockfile (-154) - exiting
20:16:01 (6687): Can't acquire lockfile (-154) - waiting 35s
20:16:36 (6687): Can't acquire lockfile (-154) - exiting
20:16:37 (6688): Can't acquire lockfile (-154) - waiting 35s
20:17:12 (6688): Can't acquire lockfile (-154) - exiting
20:17:12 (6711): Can't acquire lockfile (-154) - waiting 35s
20:17:47 (6711): Can't acquire lockfile (-154) - exiting
20:17:47 (6726): Can't acquire lockfile (-154) - waiting 35s
20:18:22 (6726): Can't acquire lockfile (-154) - exiting
20:18:23 (6727): Can't acquire lockfile (-154) - waiting 35s
20:18:58 (6727): Can't acquire lockfile (-154) - exiting
20:18:58 (6728): Can't acquire lockfile (-154) - waiting 35s
20:19:33 (6728): Can't acquire lockfile (-154) - exiting
20:19:33 (6733): Can't acquire lockfile (-154) - waiting 35s
20:20:08 (6733): Can't acquire lockfile (-154) - exiting
20:20:09 (6735): Can't acquire lockfile (-154) - waiting 35s
20:20:44 (6735): Can't acquire lockfile (-154) - exiting
20:20:44 (6737): Can't acquire lockfile (-154) - waiting 35s
20:21:19 (6737): Can't acquire lockfile (-154) - exiting
20:21:19 (6740): Can't acquire lockfile (-154) - waiting 35s
20:21:54 (6740): Can't acquire lockfile (-154) - exiting
20:21:54 (6746): Can't acquire lockfile (-154) - waiting 35s
20:22:29 (6746): Can't acquire lockfile (-154) - exiting
20:22:30 (6753): Can't acquire lockfile (-154) - waiting 35s
20:23:05 (6753): Can't acquire lockfile (-154) - exiting
20:23:05 (6755): Can't acquire lockfile (-154) - waiting 35s
20:23:40 (6755): Can't acquire lockfile (-154) - exiting
20:23:40 (6756): Can't acquire lockfile (-154) - waiting 35s
20:24:15 (6756): Can't acquire lockfile (-154) - exiting
20:24:16 (6761): Can't acquire lockfile (-154) - waiting 35s
20:24:51 (6761): Can't acquire lockfile (-154) - exiting
20:24:51 (6762): Can't acquire lockfile (-154) - waiting 35s
20:25:26 (6762): Can't acquire lockfile (-154) - exiting
20:25:26 (6763): Can't acquire lockfile (-154) - waiting 35s
20:26:01 (6763): Can't acquire lockfile (-154) - exiting
20:26:02 (6768): Can't acquire lockfile (-154) - waiting 35s
20:26:37 (6768): Can't acquire lockfile (-154) - exiting
20:26:37 (6774): Can't acquire lockfile (-154) - waiting 35s
20:27:12 (6774): Can't acquire lockfile (-154) - exiting
20:27:12 (6778): Can't acquire lockfile (-154) - waiting 35s
20:27:47 (6778): Can't acquire lockfile (-154) - exiting
20:27:47 (6779): Can't acquire lockfile (-154) - waiting 35s
20:28:22 (6779): Can't acquire lockfile (-154) - exiting
20:28:23 (6781): Can't acquire lockfile (-154) - waiting 35s
20:28:58 (6781): Can't acquire lockfile (-154) - exiting
20:28:58 (6782): Can't acquire lockfile (-154) - waiting 35s
20:29:33 (6782): Can't acquire lockfile (-154) - exiting
20:29:33 (6783): Can't acquire lockfile (-154) - waiting 35s
20:30:08 (6783): Can't acquire lockfile (-154) - exiting
20:30:09 (6784): Can't acquire lockfile (-154) - waiting 35s
20:30:44 (6784): Can't acquire lockfile (-154) - exiting
20:30:44 (6785): Can't acquire lockfile (-154) - waiting 35s
20:31:19 (6785): Can't acquire lockfile (-154) - exiting
20:31:19 (6786): Can't acquire lockfile (-154) - waiting 35s
20:31:54 (6786): Can't acquire lockfile (-154) - exiting
20:31:54 (6787): Can't acquire lockfile (-154) - waiting 35s
20:32:29 (6787): Can't acquire lockfile (-154) - exiting
20:32:30 (6788): Can't acquire lockfile (-154) - waiting 35s
20:33:05 (6788): Can't acquire lockfile (-154) - exiting
20:33:05 (6792): Can't acquire lockfile (-154) - waiting 35s
20:33:40 (6792): Can't acquire lockfile (-154) - exiting
20:33:40 (6793): Can't acquire lockfile (-154) - waiting 35s
20:34:15 (6793): Can't acquire lockfile (-154) - exiting
20:34:16 (6794): Can't acquire lockfile (-154) - waiting 35s
20:34:51 (6794): Can't acquire lockfile (-154) - exiting
20:34:51 (6795): Can't acquire lockfile (-154) - waiting 35s
20:35:26 (6795): Can't acquire lockfile (-154) - exiting
20:35:26 (7180): Can't acquire lockfile (-154) - waiting 35s
20:36:02 (7180): Can't acquire lockfile (-154) - exiting
20:36:02 (7181): Can't acquire lockfile (-154) - waiting 35s
20:36:37 (7181): Can't acquire lockfile (-154) - exiting
20:36:37 (7182): Can't acquire lockfile (-154) - waiting 35s
20:37:12 (7182): Can't acquire lockfile (-154) - exiting
20:37:13 (7184): Can't acquire lockfile (-154) - waiting 35s
20:37:48 (7184): Can't acquire lockfile (-154) - exiting
20:37:48 (7185): Can't acquire lockfile (-154) - waiting 35s
20:38:23 (7185): Can't acquire lockfile (-154) - exiting
20:38:23 (7187): Can't acquire lockfile (-154) - waiting 35s
20:38:58 (7187): Can't acquire lockfile (-154) - exiting
20:38:59 (7188): Can't acquire lockfile (-154) - waiting 35s
20:39:34 (7188): Can't acquire lockfile (-154) - exiting
20:39:34 (7194): Can't acquire lockfile (-154) - waiting 35s
20:40:09 (7194): Can't acquire lockfile (-154) - exiting
20:40:09 (7195): Can't acquire lockfile (-154) - waiting 35s
20:40:44 (7195): Can't acquire lockfile (-154) - exiting
20:40:45 (7200): Can't acquire lockfile (-154) - waiting 35s
20:41:20 (7200): Can't acquire lockfile (-154) - exiting
20:41:20 (7205): Can't acquire lockfile (-154) - waiting 35s
20:41:55 (7205): Can't acquire lockfile (-154) - exiting
20:41:55 (7215): Can't acquire lockfile (-154) - waiting 35s
20:42:30 (7215): Can't acquire lockfile (-154) - exiting
20:42:31 (7216): Can't acquire lockfile (-154) - waiting 35s
20:43:06 (7216): Can't acquire lockfile (-154) - exiting
20:43:06 (7218): Can't acquire lockfile (-154) - waiting 35s
20:43:41 (7218): Can't acquire lockfile (-154) - exiting
20:43:41 (7219): Can't acquire lockfile (-154) - waiting 35s
20:44:16 (7219): Can't acquire lockfile (-154) - exiting
20:44:16 (7220): Can't acquire lockfile (-154) - waiting 35s
20:44:51 (7220): Can't acquire lockfile (-154) - exiting
20:44:52 (7221): Can't acquire lockfile (-154) - waiting 35s
20:45:27 (7221): Can't acquire lockfile (-154) - exiting
20:45:27 (7222): Can't acquire lockfile (-154) - waiting 35s
20:46:02 (7222): Can't acquire lockfile (-154) - exiting
20:46:02 (7223): Can't acquire lockfile (-154) - waiting 35s
20:46:37 (7223): Can't acquire lockfile (-154) - exiting
20:46:38 (7233): Can't acquire lockfile (-154) - waiting 35s
20:47:13 (7233): Can't acquire lockfile (-154) - exiting
20:47:13 (7234): Can't acquire lockfile (-154) - waiting 35s
20:47:48 (7234): Can't acquire lockfile (-154) - exiting
20:47:48 (7236): Can't acquire lockfile (-154) - waiting 35s
20:48:23 (7236): Can't acquire lockfile (-154) - exiting
20:48:24 (7237): Can't acquire lockfile (-154) - waiting 35s
20:48:59 (7237): Can't acquire lockfile (-154) - exiting
20:48:59 (7238): Can't acquire lockfile (-154) - waiting 35s
20:49:34 (7238): Can't acquire lockfile (-154) - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Jun 2011 00:18:56 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 259,200 533,706 2.0591
20 Jun 2011 01:42:47 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 233,280 480,443 2.0595
07 Jun 2011 03:50:45 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 207,360 424,980 2.0495
30 May 2011 20:09:05 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 181,440 369,738 2.0378
23 May 2011 02:04:37 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 155,520 315,896 2.0312
13 May 2011 02:39:03 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 129,600 262,168 2.0229
10 May 2011 19:29:47 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 103,680 205,075 1.9780
26 Apr 2011 01:59:01 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 77,760 152,601 1.9625
22 Apr 2011 01:18:26 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 51,840 100,995 1.9482
05 Apr 2011 12:01:36 1005642 12738031 hadcm3n_o2dv_1900_40_007198422_0 25,920 50,101 1.9329


©2024 climateprediction.net