climateprediction.net home page
Task 13029457

Task 13029457

Name hadcm3n_t7c2_1940_40_007317076_2
Workunit 7514506
Created 29 Jun 2011, 13:39:14 UTC
Sent 29 Jun 2011, 13:51:26 UTC
Report deadline 28 Sep 2011, 21:18:37 UTC
Received 15 Jul 2011, 15:13:42 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 942621
Run time 3 days 19 hours 30 min 14 sec
CPU time 2 days 10 hours 44 min
Validate state Invalid
Credit 1,555.20
Device peak FLOPS 3.44 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.6.36</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:19:29 (13857): No heartbeat from core client for 30 sec - exiting
21:19:30 (13857): No heartbeat from core client for 30 sec - exiting
21:19:31 (13857): No heartbeat from core client for 30 sec - exiting
21:19:32 (13857): No heartbeat from core client for 30 sec - exiting
21:19:33 (13857): No heartbeat from core client for 30 sec - exiting
21:19:34 (13857): No heartbeat from core client for 30 sec - exiting
21:19:35 (13857): No heartbeat from core client for 30 sec - exiting
21:19:36 (13857): No heartbeat from core client for 30 sec - exiting
21:19:37 (13857): No heartbeat from core client for 30 sec - exiting
21:19:38 (13857): No heartbeat from core client for 30 sec - exiting
21:19:39 (13857): No heartbeat from core client for 30 sec - exiting
21:19:40 (13857): No heartbeat from core client for 30 sec - exiting
21:19:41 (13857): No heartbeat from core client for 30 sec - exiting
21:19:42 (13857): No heartbeat from core client for 30 sec - exiting
21:19:43 (13857): No heartbeat from core client for 30 sec - exiting
21:19:44 (13857): No heartbeat from core client for 30 sec - exiting
21:19:45 (13857): No heartbeat from core client for 30 sec - exiting
21:19:46 (13857): No heartbeat from core client for 30 sec - exiting
21:19:47 (13857): No heartbeat from core client for 30 sec - exiting
21:19:48 (13857): No heartbeat from core client for 30 sec - exiting
21:19:49 (13857): No heartbeat from core client for 30 sec - exiting
21:19:50 (13857): No heartbeat from core client for 30 sec - exiting
21:19:51 (13857): No heartbeat from core client for 30 sec - exiting
21:19:52 (13857): No heartbeat from core client for 30 sec - exiting
21:19:53 (13857): No heartbeat from core client for 30 sec - exiting
21:19:54 (13857): No heartbeat from core client for 30 sec - exiting
21:19:55 (13857): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:28:56 (23589): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:28:58 (23589): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:11:34 (40291): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:42:43 (47068): No heartbeat from core client for 30 sec - exiting
10:42:45 (47068): No heartbeat from core client for 30 sec - exiting
10:42:46 (47068): No heartbeat from core client for 30 sec - exiting
10:42:47 (47068): No heartbeat from core client for 30 sec - exiting
10:42:48 (47068): No heartbeat from core client for 30 sec - exiting
10:42:49 (47068): No heartbeat from core client for 30 sec - exiting
10:42:50 (47068): No heartbeat from core client for 30 sec - exiting
10:42:51 (47068): No heartbeat from core client for 30 sec - exiting
10:42:52 (47068): No heartbeat from core client for 30 sec - exiting
10:42:53 (47068): No heartbeat from core client for 30 sec - exiting
10:42:55 (47068): No heartbeat from core client for 30 sec - exiting
10:42:56 (47068): No heartbeat from core client for 30 sec - exiting
10:42:57 (47068): No heartbeat from core client for 30 sec - exiting
10:42:58 (47068): No heartbeat from core client for 30 sec - exiting
10:42:59 (47068): No heartbeat from core client for 30 sec - exiting
10:43:00 (47068): No heartbeat from core client for 30 sec - exiting
10:43:01 (47068): No heartbeat from core client for 30 sec - exiting
10:43:02 (47068): No heartbeat from core client for 30 sec - exiting
10:43:03 (47068): No heartbeat from core client for 30 sec - exiting
10:43:04 (47068): No heartbeat from core client for 30 sec - exiting
10:43:05 (47068): No heartbeat from core client for 30 sec - exiting
10:43:06 (47068): No heartbeat from core client for 30 sec - exiting
10:43:07 (47068): No heartbeat from core client for 30 sec - exiting
10:43:08 (47068): No heartbeat from core client for 30 sec - exiting
10:43:09 (47068): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
12:45:36 (49262): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
16:57:49 (50934): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:57:50 (50934): No heartbeat from core client for 30 sec - exiting
20:23:41 (54473): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t7c2_1940_40_007317076/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E1953  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000D9389  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0015826A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00163AB7  Unknown               UnController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58816, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E1BF7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000FEDA0  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0020B19B  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00160E7A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00164453  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038CE7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038A1ED  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000048E1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000027FB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00002729  Unknown               Unknown  Unknown
Unknown            00000003  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58816, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit -1, file stdout
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E1BF7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000FEDA0  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0020B19B  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00160E7A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00164453  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038CE7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038A1ED  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000048E1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000027FB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00002729  Unknown               Unknown  Unknown
Unknown            00000003  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=58816, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_t7c2_1940_40_007317076/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E1953  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000D9389  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0015826A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00163AB7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038CE7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038A1ED  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000048E1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000027FB Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
25 Jul 2011 13:28:55 942621 13029457 hadcm3n_t7c2_1940_40_007317076_2 129,600 201,528 1.5550
10 Jul 2011 03:19:45 942621 13029457 hadcm3n_t7c2_1940_40_007317076_2 103,680 163,352 1.5755
08 Jul 2011 23:51:03 942621 13029457 hadcm3n_t7c2_1940_40_007317076_2 77,760 120,481 1.5494
05 Jul 2011 16:12:23 942621 13029457 hadcm3n_t7c2_1940_40_007317076_2 51,840 80,177 1.5466
30 Jun 2011 20:33:03 942621 13029457 hadcm3n_t7c2_1940_40_007317076_2 25,920 40,104 1.5472


©2024 climateprediction.net