climateprediction.net home page
Task 15656646

Task 15656646

Name hadcm3n_z8qa_1920_40_008325908_0
Workunit 8477043
Created 11 Mar 2013, 4:13:16 UTC
Sent 11 Mar 2013, 4:13:26 UTC
Report deadline 10 Jun 2013, 11:40:37 UTC
Received 23 Mar 2013, 1:35:33 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1272705
Run time 10 days 15 hours 11 min 30 sec
CPU time 5 days 17 hours 29 min 3 sec
Validate state Invalid
Credit 11,508.48
Device peak FLOPS 1.72 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr 
<core_client_version>7.0.53</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Signal 15 received, exiting...
Called boinc_finish

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Signal 15 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED.                                                                                                                                                                                                                     tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Signal 15 received, exiting...
Called boinc_finish
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
11:18:25 (3519): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:18:26 (3519): No heartbeat from core client for 30 sec - exiting
11:18:27 (3519): No heartbeat from core client for 30 sec - exiting
11:18:28 (3519): No heartbeat from core client for 30 sec - exiting
11:18:29 (3519): No heartbeat from core client for 30 sec - exiting
11:18:30 (3519): No heartbeat from core client for 30 sec - exiting
11:18:31 (3519): No heartbeat from core client for 30 sec - exiting
11:18:32 (3519): No heartbeat from core client for 30 sec - exiting
11:18:33 (3519): No heartbeat from core client for 30 sec - exiting
11:18:34 (3519): No heartbeat from core client for 30 sec - exiting
11:18:35 (3519): No heartbeat from core client for 30 sec - exiting
11:18:36 (3519): No heartbeat from core client for 30 sec - exiting
11:18:37 (3519): No heartbeat from core client for 30 sec - exiting
11:18:38 (3519): No heartbeat from core client for 30 sec - exiting
11:18:39 (3519): No heartbeat from core client for 30 sec - exiting
11:18:40 (3519): No heartbeat from core client for 30 sec - exiting
11:18:41 (3519): No heartbeat from core client for 30 sec - exiting
11:18:42 (3519): No heartbeat from core client for 30 sec - exiting
11:18:43 (3519): No heartbeat from core client for 30 sec - exiting
11:18:44 (3519): No heartbeat from core client for 30 sec - exiting
11:18:45 (3519): No heartbeat from core client for 30 sec - exiting
11:18:46 (3519): No heartbeat from core client for 30 sec - exiting
11:21:01 (5458): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:21:02 (5458): No heartbeat from core client for 30 sec - exiting
11:21:03 (5458): No heartbeat from core client for 30 sec - exiting
11:21:04 (5458): No heartbeat from core client for 30 sec - exiting
11:21:05 (5458): No heartbeat from core client for 30 sec - exiting
11:21:06 (5458): No heartbeat from core client for 30 sec - exiting
11:21:07 (5458): No heartbeat from core client for 30 sec - exiting
11:21:08 (5458): No heartbeat from core client for 30 sec - exiting
11:21:09 (5458): No heartbeat from core client for 30 sec - exiting
11:21:10 (5458): No heartbeat from core client for 30 sec - exiting
11:21:11 (5458): No heartbeat from core client for 30 sec - exiting
11:21:12 (5458): No heartbeat from core client for 30 sec - exiting
11:21:13 (5458): No heartbeat from core client for 30 sec - exiting
11:21:14 (5458): No heartbeat from core client for 30 sec - exiting
11:21:15 (5458): No heartbeat from core client for 30 sec - exiting
11:21:16 (5458): No heartbeat from core client for 30 sec - exiting
11:21:17 (5458): No heartbeat from core client for 30 sec - exiting
11:21:18 (5458): No heartbeat from core client for 30 sec - exiting
11:21:19 (5458): No heartbeat from core client for 30 sec - exiting
11:21:20 (5458): No heartbeat from core client for 30 sec - exiting
11:21:21 (5458): No heartbeat from core client for 30 sec - exiting
11:21:22 (5458): No heartbeat from core client for 30 sec - exiting
11:21:23 (5458): No heartbeat from core client for 30 sec - exiting
11:21:24 (5458): No heartbeat from core client for 30 sec - exiting
11:21:25 (5458): No heartbeat from core client for 30 sec - exiting
11:21:26 (5458): No heartbeat from core client for 30 sec - exiting
11:21:27 (5458): No heartbeat from core client for 30 sec - exiting
11:21:28 (5458): No heartbeat from core client for 30 sec - exiting
11:21:29 (5458): No heartbeat from core client for 30 sec - exiting
11:21:30 (5458): No heartbeat from core client for 30 sec - exiting
11:21:31 (5458): No heartbeat from core client for 30 sec - exiting
11:21:32 (5458): No heartbeat from core client for 30 sec - exiting
11:21:33 (5458): No heartbeat from core client for 30 sec - exiting
11:21:34 (5458): No heartbeat from core client for 30 sec - exiting
11:21:35 (5458): No heartbeat from core client for 30 sec - exiting
11:21:36 (5458): No heartbeat from core client for 30 sec - exiting
Signal 15 received, exiting...
Called boinc_finish

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
23 Mar 2013 00:19:08 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 959,040 498,606 0.5199
22 Mar 2013 11:49:57 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 933,120 474,798 0.5088
22 Mar 2013 04:52:47 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 907,200 450,040 0.4961
21 Mar 2013 19:57:54 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 881,280 425,973 0.4834
21 Mar 2013 12:50:15 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 855,360 402,050 0.4700
21 Mar 2013 06:13:34 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 829,440 378,334 0.4561
20 Mar 2013 23:36:37 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 803,520 354,774 0.4415
20 Mar 2013 16:05:44 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 777,600 330,451 0.4250
20 Mar 2013 09:27:12 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 751,680 306,563 0.4078
20 Mar 2013 02:45:39 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 725,760 282,743 0.3896
19 Mar 2013 19:40:26 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 699,840 259,077 0.3702
19 Mar 2013 12:30:22 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 673,920 235,485 0.3494
19 Mar 2013 05:53:22 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 648,000 211,817 0.3269
18 Mar 2013 23:11:39 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 622,080 313,436 0.5039
18 Mar 2013 16:30:41 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 596,160 289,286 0.4852
18 Mar 2013 09:48:59 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 570,240 265,464 0.4655
18 Mar 2013 03:12:13 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 544,320 241,622 0.4439
17 Mar 2013 20:39:01 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 518,400 218,160 0.4208
17 Mar 2013 14:05:20 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 492,480 344,298 0.6991
17 Mar 2013 07:33:41 1272705 15656646 hadcm3n_z8qa_1920_40_008325908_0 466,560 320,813 0.6876


©2024 climateprediction.net