climateprediction.net home page
Task 16677485

Task 16677485

Name hadcm3n_8awu_1980_40_008723561_1
Workunit 8869539
Created 20 Jun 2014, 3:17:16 UTC
Sent 20 Jun 2014, 3:17:25 UTC
Report deadline 19 Sep 2014, 10:44:36 UTC
Received 3 Aug 2014, 14:18:43 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1323214
Run time 39 days 16 hours 6 min 9 sec
CPU time 36 days 8 hours 22 min 28 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 0.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.17</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
21:10:22 (2895): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:41:58 (16921): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:15:09 (3506): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:23:00 (4547): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:24:13 (5170): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:32:58 (5176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:08:34 (5359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:34:59 (5412): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:32:12 (13828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:10:20 (15676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
00:10:21 (15676): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:05:23 (10868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
16:59:46 (12677): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:27:38 (18990): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
19:03:13 (19515): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Signal 15 received, exiting...
Called boinc_finish
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_8awu_1980_40_008723561/dataout/ocean_restart.day after 11 attempts

Model crashed: READ_FLH: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
07 Aug 2014 02:57:20 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 518,400 3,140,633 6.0583
31 Jul 2014 02:58:04 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 492,480 2,979,247 6.0495
29 Jul 2014 23:10:50 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 466,560 2,838,232 6.0833
27 Jul 2014 18:47:29 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 440,640 2,710,724 6.1518
25 Jul 2014 17:39:49 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 414,720 2,548,996 6.1463
23 Jul 2014 19:02:58 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 388,800 2,389,082 6.1448
22 Jul 2014 13:08:06 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 362,880 2,229,603 6.1442
19 Jul 2014 10:16:40 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 336,960 2,073,578 6.1538
17 Jul 2014 03:34:23 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 311,040 1,912,895 6.1500
14 Jul 2014 16:22:04 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 285,120 1,751,264 6.1422
12 Jul 2014 07:48:14 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 259,200 1,593,153 6.1464
10 Jul 2014 03:57:58 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 233,280 1,434,483 6.1492
08 Jul 2014 03:00:15 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 207,360 1,274,200 6.1449
06 Jul 2014 02:00:50 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 181,440 1,115,009 6.1453
03 Jul 2014 22:53:43 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 155,520 952,163 6.1224
01 Jul 2014 21:38:47 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 129,600 795,486 6.1380
28 Jun 2014 19:18:26 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 103,680 637,374 6.1475
26 Jun 2014 13:20:58 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 77,760 476,211 6.1241
24 Jun 2014 06:06:58 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 51,840 316,278 6.1010
23 Jun 2014 12:46:25 1323214 16677485 hadcm3n_8awu_1980_40_008723561_1 25,920 157,637 6.0817


©2024 climateprediction.net