climateprediction.net home page
Task 16077852

Task 16077852

Name hadcm3n_49h2_2020_40_008410343_2
Workunit 8561199
Created 5 Nov 2013, 3:38:51 UTC
Sent 5 Nov 2013, 3:39:21 UTC
Report deadline 4 Feb 2014, 11:06:32 UTC
Received 27 Nov 2013, 2:36:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1090283
Run time 10 days 17 hours 37 min 51 sec
CPU time 8 days 23 hours 31 min
Validate state Invalid
Credit 7,464.96
Device peak FLOPS 3.17 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>7.2.28</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
06:40:38 (47857): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:49:38 (48617): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:49:40 (48617): No heartbeat from core client for 30 sec - exiting
08:49:41 (48617): No heartbeat from core client for 30 sec - exiting
08:49:42 (48617): No heartbeat from core client for 30 sec - exiting
08:49:43 (48617): No heartbeat from core client for 30 sec - exiting
08:49:44 (48617): No heartbeat from core client for 30 sec - exiting
08:49:45 (48617): No heartbeat from core client for 30 sec - exiting
08:49:46 (48617): No heartbeat from core client for 30 sec - exiting
08:53:26 (49742): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:27 (49742): No heartbeat from core client for 30 sec - exiting
08:53:28 (49742): No heartbeat from core client for 30 sec - exiting
08:53:29 (49742): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
12:13:40 (26461): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Signal 1 received, exiting...
Called boinc_finish
10:46:40 (47500): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:47:17 (49333): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:47:19 (49333): No heartbeat from core client for 30 sec - exiting
13:47:20 (49333): No heartbeat from core client for 30 sec - exiting
13:47:21 (49333): No heartbeat from core client for 30 sec - exiting
13:47:22 (49333): No heartbeat from core client for 30 sec - exiting
13:47:23 (49333): No heartbeat from core client for 30 sec - exiting
13:47:24 (49333): No heartbeat from core client for 30 sec - exiting
13:47:25 (49333): No heartbeat from core client for 30 sec - exiting
13:47:26 (49333): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
20:31:39 (3941): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:31:40 (3941): No heartbeat from core client for 30 sec - exiting
20:31:41 (3941): No heartbeat from core client for 30 sec - exiting
20:31:42 (3941): No heartbeat from core client for 30 sec - exiting
20:37:16 (4284): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:38:12 (4331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:39:07 (4342): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Nov 2013 19:57:20 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 622,080 850,466 1.3671
23 Nov 2013 23:19:24 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 596,160 816,314 1.3693
22 Nov 2013 21:29:07 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 570,240 781,633 1.3707
22 Nov 2013 03:14:06 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 544,320 748,555 1.3752
19 Nov 2013 20:38:16 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 518,400 712,322 1.3741
18 Nov 2013 23:37:09 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 492,480 673,770 1.3681
18 Nov 2013 08:04:36 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 466,560 633,642 1.3581
16 Nov 2013 11:26:02 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 440,640 594,657 1.3495
16 Nov 2013 00:38:26 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 414,720 559,403 1.3489
14 Nov 2013 18:52:38 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 388,800 525,628 1.3519
14 Nov 2013 08:23:15 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 362,880 491,606 1.3547
13 Nov 2013 05:05:32 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 336,960 458,372 1.3603
10 Nov 2013 23:09:19 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 311,040 423,532 1.3617
10 Nov 2013 10:28:20 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 285,120 388,546 1.3627
10 Nov 2013 01:01:00 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 259,200 355,945 1.3732
09 Nov 2013 15:42:59 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 233,280 323,760 1.3879
09 Nov 2013 06:10:40 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 207,360 290,767 1.4022
08 Nov 2013 09:52:34 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 181,440 255,325 1.4072
07 Nov 2013 21:39:02 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 155,520 222,087 1.4280
07 Nov 2013 10:56:03 1090283 16077852 hadcm3n_49h2_2020_40_008410343_2 129,600 185,096 1.4282


©2024 climateprediction.net