climateprediction.net home page
Task 15865138

Task 15865138

Name hadcm3n_o2nu_2020_40_008396312_0
Workunit 8547171
Created 26 Jun 2013, 1:54:38 UTC
Sent 29 Jun 2013, 22:23:40 UTC
Report deadline 29 Sep 2013, 5:50:51 UTC
Received 29 Jul 2013, 13:03:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1261981
Run time 23 days 23 hours 30 min 42 sec
CPU time 12 days 17 hours 13 min 48 sec
Validate state Invalid
Credit 11,197.44
Device peak FLOPS 1.70 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
14:28:50 (407): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:29:36 (4070): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:57:49 (4091): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:59:05 (4220): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:00:47 (4247): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:33:46 (4268): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:34:30 (4409): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:29:33 (4436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:48:24 (4510): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:49:12 (4617): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:38:03 (4638): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:12:20 (4717): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:13:06 (4840): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
11:59:36 (4861): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:00:23 (5794): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:02:04 (5815): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
13:36:37 (5836): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:37:44 (5959): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:43:13 (5980): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:43:58 (6221): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:45:40 (6241): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:35:45 (6261): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
02:02:05 (8258): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:03:19 (8655): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:05:02 (8675): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:49:36 (8695): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:44:46 (9143): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:45:38 (9229): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:34:57 (9248): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:35:41 (9314): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:37:23 (9344): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:39:39 (9363): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:51:19 (9382): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:53:23 (12901): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:55:37 (12920): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:58:38 (12939): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:59:22 (13247): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:28:35 (13266): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:15:17 (13517): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:55:08 (13744): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:32:29 (13810): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
23:52:24 (14531): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:53:08 (24826): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:54:50 (24845): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
29 Jul 2013 13:08:19 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 933,120 1,263,848 1.3544
29 Jul 2013 13:08:19 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 907,200 1,208,247 1.3318
26 Jul 2013 05:56:25 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 881,280 1,152,681 1.3080
25 Jul 2013 14:22:37 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 855,360 1,287,624 1.5054
24 Jul 2013 22:50:10 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 829,440 1,232,086 1.4854
24 Jul 2013 07:19:11 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 803,520 1,176,587 1.4643
23 Jul 2013 22:12:49 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 777,600 1,120,997 1.4416
23 Jul 2013 21:57:09 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 751,680 1,449,377 1.9282
23 Jul 2013 21:38:05 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 725,760 1,393,865 1.9206
23 Jul 2013 21:18:38 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 699,840 1,338,321 1.9123
23 Jul 2013 20:46:33 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 673,920 1,282,747 1.9034
23 Jul 2013 20:23:37 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 648,000 1,227,174 1.8938
23 Jul 2013 19:58:43 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 622,080 1,171,675 1.8835
23 Jul 2013 19:17:32 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 596,160 1,116,160 1.8722
23 Jul 2013 15:38:43 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 570,240 1,060,666 1.8600
23 Jul 2013 14:36:55 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 544,320 1,005,077 1.8465
23 Jul 2013 14:36:56 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 518,400 949,584 1.8318
23 Jul 2013 14:36:56 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 492,480 894,048 1.8154
23 Jul 2013 14:36:56 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 466,560 838,546 1.7973
23 Jul 2013 14:36:56 1261981 15865138 hadcm3n_o2nu_2020_40_008396312_0 440,640 783,043 1.7771


©2024 climateprediction.net