climateprediction.net home page
Task 15492798

Task 15492798

Name hadcm3n_38s9_1940_40_008263955_0
Workunit 8419079
Created 21 Dec 2012, 7:09:06 UTC
Sent 23 Dec 2012, 6:32:42 UTC
Report deadline 24 Mar 2013, 13:59:53 UTC
Received 14 Jan 2013, 4:24:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1217831
Run time 18 days 14 hours 57 min 46 sec
CPU time 12 days 0 hours 51 min 2 sec
Validate state Invalid
Credit 9,642.24
Device peak FLOPS 3.30 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>7.0.28</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7280, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
11:35:08 (6768): No heartbeat from core client for 30 sec - exiting
11:35:09 (6768): No heartbeat from core client for 30 sec - exiting
11:35:10 (6768): No heartbeat from core client for 30 sec - exiting
11:35:11 (6768): No heartbeat from core client for 30 sec - exiting
11:35:12 (6768): No heartbeat from core client for 30 sec - exiting
11:35:13 (6768): No heartbeat from core client for 30 sec - exiting
11:35:14 (6768): No heartbeat from core client for 30 sec - exiting
11:35:15 (6768): No heartbeat from core client for 30 sec - exiting
11:35:16 (6768): No heartbeat from core client for 30 sec - exiting
11:35:17 (6768): No heartbeat from core client for 30 sec - exiting
11:35:18 (6768): No heartbeat from core client for 30 sec - exiting
11:35:19 (6768): No heartbeat from core client for 30 sec - exiting
11:35:20 (6768): No heartbeat from core client for 30 sec - exiting
11:35:21 (6768): No heartbeat from core client for 30 sec - exiting
11:35:22 (6768): No heartbeat from core client for 30 sec - exiting
11:35:23 (6768): No heartbeat from core client for 30 sec - exiting
11:35:24 (6768): No heartbeat from core client for 30 sec - exiting
11:35:25 (6768): No heartbeat from core client for 30 sec - exiting
11:35:26 (6768): No heartbeat from core client for 30 sec - exiting
11:35:27 (6768): No heartbeat from core client for 30 sec - exiting
11:35:28 (6768): No heartbeat from core client for 30 sec - exiting
11:35:29 (6768): No heartbeat from core client for 30 sec - exiting
11:35:30 (6768): No heartbeat from core client for 30 sec - exiting
11:35:31 (6768): No heartbeat from core client for 30 sec - exiting
11:35:32 (6768): No heartbeat from core client for 30 sec - exiting
11:35:33 (6768): No heartbeat from core client for 30 sec - exiting
11:35:34 (6768): No heartbeat from core client for 30 sec - exiting
11:35:35 (6768): No heartbeat from core client for 30 sec - exiting
11:35:36 (6768): No heartbeat from core client for 30 sec - exiting
11:35:37 (6768): No heartbeat from core client for 30 sec - exiting
11:35:38 (6768): No heartbeat from core client for 30 sec - exiting
11:35:39 (6768): No heartbeat from core client for 30 sec - exiting
11:35:40 (6768): No heartbeat from core client for 30 sec - exiting
11:35:41 (6768): No heartbeat from core client for 30 sec - exiting
11:35:42 (6768): No heartbeat from core client for 30 sec - exiting
11:35:43 (6768): No heartbeat from core client for 30 sec - exiting
11:35:44 (6768): No heartbeat from core client for 30 sec - exiting
11:35:45 (6768): No heartbeat from core client for 30 sec - exiting
11:35:46 (6768): No heartbeat from core client for 30 sec - exiting
11:35:47 (6768): No heartbeat from core client for 30 sec - exiting
11:35:48 (6768): No heartbeat from core client for 30 sec - exiting
11:35:50 (6768): No heartbeat from core client for 30 sec - exiting
11:35:51 (6768): No heartbeat from core client for 30 sec - exiting
11:35:52 (6768): No heartbeat from core client for 30 sec - exiting
11:35:53 (6768): No heartbeat from core client for 30 sec - exiting
11:35:54 (6768): No heartbeat from core client for 30 sec - exiting
11:35:55 (6768): No heartbeat from core client for 30 sec - exiting
11:35:56 (6768): No heartbeat from core client for 30 sec - exiting
11:35:57 (6768): No heartbeat from core client for 30 sec - exiting
11:35:58 (6768): No heartbeat from core client for 30 sec - exiting
11:35:59 (6768): No heartbeat from core client for 30 sec - exiting
11:36:00 (6768): No heartbeat from core client for 30 sec - exiting
11:36:01 (6768): No heartbeat from core client for 30 sec - exiting
11:36:02 (6768): No heartbeat from core client for 30 sec - exiting
11:36:03 (6768): No heartbeat from core client for 30 sec - exiting
11:36:04 (6768): No heartbeat from core client for 30 sec - exiting
11:36:05 (6768): No heartbeat from core client for 30 sec - exiting
11:36:06 (6768): No heartbeat from core client for 30 sec - exiting
11:36:07 (6768): No heartbeat from core client for 30 sec - exiting
11:36:08 (6768): No heartbeat from core client for 30 sec - exiting
11:36:09 (6768): No heartbeat from core client for 30 sec - exiting
11:36:10 (6768): No heartbeat from core client for 30 sec - exiting
11:36:11 (6768): No heartbeat from core client for 30 sec - exiting
11:36:12 (6768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9620, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
23:33:59 (7660): No heartbeat from core client for 30 sec - exiting
23:34:00 (7660): No heartbeat from core client for 30 sec - exiting
23:34:01 (7660): No heartbeat from core client for 30 sec - exiting
23:34:02 (7660): No heartbeat from core client for 30 sec - exiting
23:34:03 (7660): No heartbeat from core client for 30 sec - exiting
23:34:04 (7660): No heartbeat from core client for 30 sec - exiting
23:34:05 (7660): No heartbeat from core client for 30 sec - exiting
23:34:06 (7660): No heartbeat from core client for 30 sec - exiting
23:34:07 (7660): No heartbeat from core client for 30 sec - exiting
23:34:08 (7660): No heartbeat from core client for 30 sec - exiting
23:34:09 (7660): No heartbeat from core client for 30 sec - exiting
23:34:10 (7660): No heartbeat from core client for 30 sec - exiting
23:34:11 (7660): No heartbeat from core client for 30 sec - exiting
23:34:12 (7660): No heartbeat from core client for 30 sec - exiting
23:34:13 (7660): No heartbeat from core client for 30 sec - exiting
23:34:14 (7660): No heartbeat from core client for 30 sec - exiting
23:34:15 (7660): No heartbeat from core client for 30 sec - exiting
23:34:16 (7660): No heartbeat from core client for 30 sec - exiting
23:34:17 (7660): No heartbeat from core client for 30 sec - exiting
23:34:18 (7660): No heartbeat from core client for 30 sec - exiting
23:34:19 (7660): No heartbeat from core client for 30 sec - exiting
23:34:20 (7660): No heartbeat from core client for 30 sec - exiting
23:34:21 (7660): No heartbeat from core client for 30 sec - exiting
23:34:22 (7660): No heartbeat from core client for 30 sec - exiting
23:34:23 (7660): No heartbeat from core client for 30 sec - exiting
23:34:24 (7660): No heartbeat from core client for 30 sec - exiting
23:34:25 (7660): No heartbeat from core client for 30 sec - exiting
23:34:26 (7660): No heartbeat from core client for 30 sec - exiting
23:34:27 (7660): No heartbeat from core client for 30 sec - exiting
23:34:28 (7660): No heartbeat from core client for 30 sec - exiting
23:34:29 (7660): No heartbeat from core client for 30 sec - exiting
23:34:30 (7660): No heartbeat from core client for 30 sec - exiting
23:34:31 (7660): No heartbeat from core client for 30 sec - exiting
23:34:32 (7660): No heartbeat from core client for 30 sec - exiting
23:34:33 (7660): No heartbeat from core client for 30 sec - exiting
23:34:34 (7660): No heartbeat from core client for 30 sec - exiting
23:34:35 (7660): No heartbeat from core client for 30 sec - exiting
23:34:36 (7660): No heartbeat from core client for 30 sec - exiting
23:34:37 (7660): No heartbeat from core client for 30 sec - exiting
23:34:38 (7660): No heartbeat from core client for 30 sec - exiting
23:34:39 (7660): No heartbeat from core client for 30 sec - exiting
23:34:40 (7660): No heartbeat from core client for 30 sec - exiting
23:34:41 (7660): No heartbeat from core client for 30 sec - exiting
23:34:42 (7660): No heartbeat from core client for 30 sec - exiting
23:34:43 (7660): No heartbeat from core client for 30 sec - exiting
23:34:44 (7660): No heartbeat from core client for 30 sec - exiting
23:34:45 (7660): No heartbeat from core client for 30 sec - exiting
23:34:46 (7660): No heartbeat from core client for 30 sec - exiting
23:34:47 (7660): No heartbeat from core client for 30 sec - exiting
23:34:48 (7660): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:21:08 (7300): No heartbeat from core client for 30 sec - exiting
20:21:09 (7300): No heartbeat from core client for 30 sec - exiting
20:21:10 (7300): No heartbeat from core client for 30 sec - exiting
20:21:11 (7300): No heartbeat from core client for 30 sec - exiting
20:21:12 (7300): No heartbeat from core client for 30 sec - exiting
20:21:13 (7300): No heartbeat from core client for 30 sec - exiting
20:21:14 (7300): No heartbeat from core client for 30 sec - exiting
20:21:15 (7300): No heartbeat from core client for 30 sec - exiting
20:21:16 (7300): No heartbeat from core client for 30 sec - exiting
20:21:17 (7300): No heartbeat from core client for 30 sec - exiting
20:21:18 (7300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:21:19 (7300): No heartbeat from core client for 30 sec - exiting
20:21:20 (7300): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:22:30 (102996): No heartbeat from core client for 30 sec - exiting
01:22:32 (102996): No heartbeat from core client for 30 sec - exiting
01:22:33 (102996): No heartbeat from core client for 30 sec - exiting
01:22:34 (102996): No heartbeat from core client for 30 sec - exiting
01:22:35 (102996): No heartbeat from core client for 30 sec - exiting
01:22:36 (102996): No heartbeat from core client for 30 sec - exiting
01:22:37 (102996): No heartbeat from core client for 30 sec - exiting
01:22:38 (102996): No heartbeat from core client for 30 sec - exiting
01:22:39 (102996): No heartbeat from core client for 30 sec - exiting
01:22:40 (102996): No heartbeat from core client for 30 sec - exiting
01:22:41 (102996): No heartbeat from core client for 30 sec - exiting
01:22:42 (102996): No heartbeat from core client for 30 sec - exiting
01:22:43 (102996): No heartbeat from core client for 30 sec - exiting
01:22:44 (102996): No heartbeat from core client for 30 sec - exiting
01:22:45 (102996): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:14:52 (60020): No heartbeat from core client for 30 sec - exiting
20:14:53 (60020): No heartbeat from core client for 30 sec - exiting
20:14:54 (60020): No heartbeat from core client for 30 sec - exiting
20:14:55 (60020): No heartbeat from core client for 30 sec - exiting
20:14:56 (60020): No heartbeat from core client for 30 sec - exiting
20:14:57 (60020): No heartbeat from core client for 30 sec - exiting
20:14:58 (60020): No heartbeat from core client for 30 sec - exiting
20:14:59 (60020): No heartbeat from core client for 30 sec - exiting
20:15:00 (60020): No heartbeat from core client for 30 sec - exiting
20:15:01 (60020): No heartbeat from core client for 30 sec - exiting
20:15:02 (60020): No heartbeat from core client for 30 sec - exiting
20:15:03 (60020): No heartbeat from core client for 30 sec - exiting
20:15:04 (60020): No heartbeat from core client for 30 sec - exiting
20:15:05 (60020): No heartbeat from core client for 30 sec - exiting
20:15:06 (60020): No heartbeat from core client for 30 sec - exiting
20:15:07 (60020): No heartbeat from core client for 30 sec - exiting
20:15:08 (60020): No heartbeat from core client for 30 sec - exiting
20:15:09 (60020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:00:58 (10008): No heartbeat from core client for 30 sec - exiting
22:00:59 (10008): No heartbeat from core client for 30 sec - exiting
22:01:00 (10008): No heartbeat from core client for 30 sec - exiting
22:01:01 (10008): No heartbeat from core client for 30 sec - exiting
22:01:02 (10008): No heartbeat from core client for 30 sec - exiting
22:01:03 (10008): No heartbeat from core client for 30 sec - exiting
22:01:04 (10008): No heartbeat from core client for 30 sec - exiting
22:01:05 (10008): No heartbeat from core client for 30 sec - exiting
22:01:06 (10008): No heartbeat from core client for 30 sec - exiting
22:01:07 (10008): No heartbeat from core client for 30 sec - exiting
22:01:08 (10008): No heartbeat from core client for 30 sec - exiting
22:01:09 (10008): No heartbeat from core client for 30 sec - exiting
22:01:10 (10008): No heartbeat from core client for 30 sec - exiting
22:01:11 (10008): No heartbeat from core client for 30 sec - exiting
22:01:12 (10008): No heartbeat from core client for 30 sec - exiting
22:01:13 (10008): No heartbeat from core client for 30 sec - exiting
22:01:14 (10008): No heartbeat from core client for 30 sec - exiting
22:01:15 (10008): No heartbeat from core client for 30 sec - exiting
22:01:16 (10008): No heartbeat from core client for 30 sec - exiting
22:01:17 (10008): No heartbeat from core client for 30 sec - exiting
22:01:18 (10008): No heartbeat from core client for 30 sec - exiting
22:01:19 (10008): No heartbeat from core client for 30 sec - exiting
22:01:20 (10008): No heartbeat from core client for 30 sec - exiting
22:01:21 (10008): No heartbeat from core client for 30 sec - exiting
22:01:22 (10008): No heartbeat from core client for 30 sec - exiting
22:01:23 (10008): No heartbeat from core client for 30 sec - exiting
22:01:24 (10008): No heartbeat from core client for 30 sec - exiting
22:01:25 (10008): No heartbeat from core client for 30 sec - exiting
22:01:26 (10008): No heartbeat from core client for 30 sec - exiting
22:01:27 (10008): No heartbeat from core client for 30 sec - exiting
22:01:28 (10008): No heartbeat from core client for 30 sec - exiting
22:01:29 (10008): No heartbeat from core client for 30 sec - exiting
22:01:30 (10008): No heartbeat from core client for 30 sec - exiting
22:01:31 (10008): No heartbeat from core client for 30 sec - exiting
22:01:32 (10008): No heartbeat from core client for 30 sec - exiting
22:01:33 (10008): No heartbeat from core client for 30 sec - exiting
22:01:34 (10008): No heartbeat from core client for 30 sec - exiting
22:01:35 (10008): No heartbeat from core client for 30 sec - exiting
22:01:36 (10008): No heartbeat from core client for 30 sec - exiting
22:01:37 (10008): No heartbeat from core client for 30 sec - exiting
22:01:38 (10008): No heartbeat from core client for 30 sec - exiting
22:01:39 (10008): No heartbeat from core client for 30 sec - exiting
22:01:40 (10008): No heartbeat from core client for 30 sec - exiting
22:01:41 (10008): No heartbeat from core client for 30 sec - exiting
22:01:42 (10008): No heartbeat from core client for 30 sec - exiting
22:01:43 (10008): No heartbeat from core client for 30 sec - exiting
22:01:44 (10008): No heartbeat from core client for 30 sec - exiting
22:01:45 (10008): No heartbeat from core client for 30 sec - exiting
22:01:46 (10008): No heartbeat from core client for 30 sec - exiting
22:01:47 (10008): No heartbeat from core client for 30 sec - exiting
22:01:48 (10008): No heartbeat from core client for 30 sec - exiting
22:01:49 (10008): No heartbeat from core client for 30 sec - exiting
22:01:50 (10008): No heartbeat from core client for 30 sec - exiting
22:01:51 (10008): No heartbeat from core client for 30 sec - exiting
22:01:52 (10008): No heartbeat from core client for 30 sec - exiting
22:01:53 (10008): No heartbeat from core client for 30 sec - exiting
22:01:54 (10008): No heartbeat from core client for 30 sec - exiting
22:01:55 (10008): No heartbeat from core client for 30 sec - exiting
22:01:56 (10008): No heartbeat from core client for 30 sec - exiting
22:01:57 (10008): No heartbeat from core client for 30 sec - exiting
22:01:58 (10008): No heartbeat from core client for 30 sec - exiting
22:01:59 (10008): No heartbeat from core client for 30 sec - exiting
22:02:00 (10008): No heartbeat from core client for 30 sec - exiting
22:02:01 (10008): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Jan 2013 01:26:58 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 803,520 1,039,871 1.2941
13 Jan 2013 12:14:57 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 777,600 1,007,059 1.2951
12 Jan 2013 22:57:34 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 751,680 973,663 1.2953
12 Jan 2013 09:29:22 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 725,760 939,756 1.2949
11 Jan 2013 20:10:18 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 699,840 905,680 1.2941
11 Jan 2013 05:33:45 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 673,920 871,401 1.2930
09 Jan 2013 22:51:49 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 648,000 837,950 1.2931
09 Jan 2013 09:10:17 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 622,080 805,399 1.2947
08 Jan 2013 17:56:41 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 596,160 772,596 1.2960
08 Jan 2013 02:40:44 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 570,240 739,845 1.2974
07 Jan 2013 12:45:23 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 544,320 707,275 1.2994
06 Jan 2013 22:33:34 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 518,400 673,824 1.2998
06 Jan 2013 02:29:46 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 492,480 640,309 1.3002
04 Jan 2013 09:30:29 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 466,560 606,991 1.3010
03 Jan 2013 05:20:12 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 440,640 574,350 1.3034
02 Jan 2013 09:30:16 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 414,720 540,961 1.3044
01 Jan 2013 15:45:59 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 388,800 507,152 1.3044
31 Dec 2012 21:02:54 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 362,880 473,559 1.3050
31 Dec 2012 01:57:01 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 336,960 438,544 1.3015
30 Dec 2012 07:54:14 1217831 15492798 hadcm3n_38s9_1940_40_008263955_0 311,040 404,553 1.3006


©2024 climateprediction.net