Name | hadcm3n_p78g_1940_40_007450724_0 |
Workunit | 7648227 |
Created | 10 Sep 2011, 7:42:50 UTC |
Sent | 10 Sep 2011, 7:51:24 UTC |
Report deadline | 10 Dec 2011, 15:18:35 UTC |
Received | 25 Oct 2011, 20:44:07 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 970607 |
Run time | 21 days 22 hours 38 min 3 sec |
CPU time | 11 days 23 hours 10 min 59 sec |
Validate state | Invalid |
Credit | 2,177.28 |
Device peak FLOPS | 2.39 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4964, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3384, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3548, iMonCtr=1 Model crash detected, will try to restart... 07:06:11 (3200): No heartbeat from core client for 30 sec - exiting 07:06:12 (3200): No heartbeat from core client for 30 sec - exiting 07:06:13 (3200): No heartbeat from core client for 30 sec - exiting 07:06:15 (3200): No heartbeat from core client for 30 sec - exiting 07:06:16 (3200): No heartbeat from core client for 30 sec - exiting 07:06:17 (3200): No heartbeat from core client for 30 sec - exiting 07:06:18 (3200): No heartbeat from core client for 30 sec - exiting 07:06:19 (3200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:23:58 (1496): No heartbeat from core client for 30 sec - exiting 07:24:00 (1496): No heartbeat from core client for 30 sec - exiting 07:24:01 (1496): No heartbeat from core client for 30 sec - exiting 07:24:02 (1496): No heartbeat from core client for 30 sec - exiting 07:24:03 (1496): No heartbeat from core client for 30 sec - exiting 07:24:04 (1496): No heartbeat from core client for 30 sec - exiting 07:24:05 (1496): No heartbeat from core client for 30 sec - exiting 07:24:06 (1496): No heartbeat from core client for 30 sec - exiting 07:24:07 (1496): No heartbeat from core client for 30 sec - exiting 07:24:08 (1496): No heartbeat from core client for 30 sec - exiting 07:24:09 (1496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:55 (3312): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:07:14 (4092): No heartbeat from core client for 30 sec - exiting 07:07:15 (4092): No heartbeat from core client for 30 sec - exiting 07:07:16 (4092): No heartbeat from core client for 30 sec - exiting 07:07:17 (4092): No heartbeat from core client for 30 sec - exiting 07:07:19 (4092): No heartbeat from core client for 30 sec - exiting 07:07:20 (4092): No heartbeat from core client for 30 sec - exiting 07:07:21 (4092): No heartbeat from core client for 30 sec - exiting 07:07:22 (4092): No heartbeat from core client for 30 sec - exiting 07:07:23 (4092): No heartbeat from core client for 30 sec - exiting 07:07:24 (4092): No heartbeat from core client for 30 sec - exiting 07:07:25 (4092): No heartbeat from core client for 30 sec - exiting 07:07:26 (4092): No heartbeat from core client for 30 sec - exiting 07:07:27 (4092): No heartbeat from core client for 30 sec - exiting 07:07:28 (4092): No heartbeat from core client for 30 sec - exiting 07:07:29 (4092): No heartbeat from core client for 30 sec - exiting 07:07:30 (4092): No heartbeat from core client for 30 sec - exiting 07:07:31 (4092): No heartbeat from core client for 30 sec - exiting 07:07:32 (4092): No heartbeat from core client for 30 sec - exiting 07:07:33 (4092): No heartbeat from core client for 30 sec - exiting 07:07:34 (4092): No heartbeat from core client for 30 sec - exiting 07:07:35 (4092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:20:08 (5108): No heartbeat from core client for 30 sec - exiting 07:20:10 (5108): No heartbeat from core client for 30 sec - exiting 07:20:11 (5108): No heartbeat from core client for 30 sec - exiting 07:20:12 (5108): No heartbeat from core client for 30 sec - exiting 07:20:13 (5108): No heartbeat from core client for 30 sec - exiting 07:20:14 (5108): No heartbeat from core client for 30 sec - exiting 07:20:15 (5108): No heartbeat from core client for 30 sec - exiting 07:20:16 (5108): No heartbeat from core client for 30 sec - exiting 07:20:17 (5108): No heartbeat from core client for 30 sec - exiting 07:20:18 (5108): No heartbeat from core client for 30 sec - exiting 07:20:20 (5108): No heartbeat from core client for 30 sec - exiting 07:20:21 (5108): No heartbeat from core client for 30 sec - exiting 07:20:22 (5108): No heartbeat from core client for 30 sec - exiting 07:20:23 (5108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:22:44 (760): No heartbeat from core client for 30 sec - exiting 07:22:45 (760): No heartbeat from core client for 30 sec - exiting 07:22:46 (760): No heartbeat from core client for 30 sec - exiting 07:22:47 (760): No heartbeat from core client for 30 sec - exiting 07:22:48 (760): No heartbeat from core client for 30 sec - exiting 07:22:49 (760): No heartbeat from core client for 30 sec - exiting 07:22:50 (760): No heartbeat from core client for 30 sec - exiting 07:22:51 (760): No heartbeat from core client for 30 sec - exiting 07:22:52 (760): No heartbeat from core client for 30 sec - exiting 07:22:53 (760): No heartbeat from core client for 30 sec - exiting 07:22:54 (760): No heartbeat from core client for 30 sec - exiting 07:22:56 (760): No heartbeat from core client for 30 sec - exiting 07:22:57 (760): No heartbeat from core client for 30 sec - exiting 07:22:58 (760): No heartbeat from core client for 30 sec - exiting 07:22:59 (760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Called boinc_finish 07:17:04 (5036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:07 (2512): No heartbeat from core client for 30 sec - exiting 07:06:08 (2512): No heartbeat from core client for 30 sec - exiting 07:06:09 (2512): No heartbeat from core client for 30 sec - exiting 07:06:10 (2512): No heartbeat from core client for 30 sec - exiting 07:06:12 (2512): No heartbeat from core client for 30 sec - exiting 07:06:13 (2512): No heartbeat from core client for 30 sec - exiting 07:06:14 (2512): No heartbeat from core client for 30 sec - exiting 07:06:15 (2512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:16:28 (5292): Can't acquire lockfile (32) - waiting 35s CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2972, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
26 Sep 2011 05:32:45 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 181,440 | 471,059 | 2.5962 |
24 Sep 2011 04:44:16 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 155,520 | 402,590 | 2.5887 |
21 Sep 2011 22:10:58 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 129,600 | 333,679 | 2.5747 |
19 Sep 2011 13:11:07 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 103,680 | 266,738 | 2.5727 |
17 Sep 2011 08:25:05 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 77,760 | 200,232 | 2.5750 |
15 Sep 2011 08:09:30 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 51,840 | 133,787 | 2.5808 |
13 Sep 2011 04:19:26 | 970607 | 13367620 | hadcm3n_p78g_1940_40_007450724_0 | 25,920 | 66,881 | 2.5803 |
©2024 cpdn.org