climateprediction.net home page
Task 12751081

Task 12751081

Name hadcm3n_o7ej_1900_40_007204926_0
Workunit 7403206
Created 28 Mar 2011, 14:20:10 UTC
Sent 28 Mar 2011, 16:46:15 UTC
Report deadline 28 Jun 2011, 0:13:26 UTC
Received 21 Apr 2011, 3:18:19 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1000973
Run time 15 days 19 hours 7 min
CPU time 14 days 3 hours 4 min 43 sec
Validate state Invalid
Credit 9,331.20
Device peak FLOPS 2.69 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.6.36</core_client_version>
<![CDATA[
<message>
 - exit code 193 (0xc1)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
22:26:10 (7052): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:55:34 (768): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:55:35 (768): No heartbeat from core client for 30 sec - exiting
19:19:05 (5484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:19:06 (5484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
22:20:51 (7168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:20:52 (7168): No heartbeat from core client for 30 sec - exiting
22:20:53 (7168): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
09:52:33 (5984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:45:11 (6140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:45:12 (6140): No heartbeat from core client for 30 sec - exiting
10:45:13 (6140): No heartbeat from core client for 30 sec - exiting
10:45:14 (6140): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:05:01 (6732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
22:11:32 (8088): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
14:44:39 (8076): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:44:40 (8076): No heartbeat from core client for 30 sec - exiting
14:44:41 (8076): No heartbeat from core client for 30 sec - exiting
14:44:42 (8076): No heartbeat from core client for 30 sec - exiting
14:44:43 (8076): No heartbeat from core client for 30 sec - exiting
14:44:44 (8076): No heartbeat from core client for 30 sec - exiting
14:44:45 (8076): No heartbeat from core client for 30 sec - exiting
14:44:46 (8076): No heartbeat from core client for 30 sec - exiting
14:44:47 (8076): No heartbeat from core client for 30 sec - exiting
14:44:48 (8076): No heartbeat from core client for 30 sec - exiting
14:44:49 (8076): No heartbeat from core client for 30 sec - exiting
15:20:51 (8340): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:28:13 (6816): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:28:14 (6816): No heartbeat from core client for 30 sec - exiting
15:28:16 (6816): No heartbeat from core client for 30 sec - exiting
15:28:17 (6816): No heartbeat from core client for 30 sec - exiting
15:28:18 (6816): No heartbeat from core client for 30 sec - exiting
15:28:19 (6816): No heartbeat from core client for 30 sec - exiting
15:28:20 (6816): No heartbeat from core client for 30 sec - exiting
15:28:21 (6816): No heartbeat from core client for 30 sec - exiting
15:28:22 (6816): No heartbeat from core client for 30 sec - exiting
15:28:23 (6816): No heartbeat from core client for 30 sec - exiting
15:28:24 (6816): No heartbeat from core client for 30 sec - exiting
15:42:35 (6664): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:42:36 (6664): No heartbeat from core client for 30 sec - exiting
15:42:37 (6664): No heartbeat from core client for 30 sec - exiting
15:42:38 (6664): No heartbeat from core client for 30 sec - exiting
15:42:39 (6664): No heartbeat from core client for 30 sec - exiting
15:42:40 (6664): No heartbeat from core client for 30 sec - exiting
15:46:37 (1516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:46:38 (1516): No heartbeat from core client for 30 sec - exiting
15:46:39 (1516): No heartbeat from core client for 30 sec - exiting
15:46:40 (1516): No heartbeat from core client for 30 sec - exiting
15:46:41 (1516): No heartbeat from core client for 30 sec - exiting
15:46:42 (1516): No heartbeat from core client for 30 sec - exiting
15:46:43 (1516): No heartbeat from core client for 30 sec - exiting
15:46:44 (1516): No heartbeat from core client for 30 sec - exiting
15:46:45 (1516): No heartbeat from core client for 30 sec - exiting
15:46:46 (1516): No heartbeat from core client for 30 sec - exiting
15:46:47 (1516): No heartbeat from core client for 30 sec - exiting
15:49:11 (8908): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:50:12 (8908): No heartbeat from core client for 30 sec - exiting
15:58:42 (8848): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:58:43 (8848): No heartbeat from core client for 30 sec - exiting
15:58:44 (8848): No heartbeat from core client for 30 sec - exiting
15:58:45 (8848): No heartbeat from core client for 30 sec - exiting
15:58:46 (8848): No heartbeat from core client for 30 sec - exiting
15:58:47 (8848): No heartbeat from core client for 30 sec - exiting
15:58:48 (8848): No heartbeat from core client for 30 sec - exiting
15:58:49 (8848): No heartbeat from core client for 30 sec - exiting
15:58:50 (8848): No heartbeat from core client for 30 sec - exiting
15:58:51 (8848): No heartbeat from core client for 30 sec - exiting
15:58:52 (8848): No heartbeat from core client for 30 sec - exiting
16:09:39 (8824): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:09:40 (8824): No heartbeat from core client for 30 sec - exiting
16:09:41 (8824): No heartbeat from core client for 30 sec - exiting
16:28:23 (9224): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:28:25 (9224): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:05:08 (8484): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:56:55 (4516): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:58:02 (7288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:58:03 (7288): No heartbeat from core client for 30 sec - exiting
05:58:04 (7288): No heartbeat from core client for 30 sec - exiting
05:58:05 (7288): No heartbeat from core client for 30 sec - exiting
05:58:06 (7288): No heartbeat from core client for 30 sec - exiting
05:58:07 (7288): No heartbeat from core client for 30 sec - exiting
05:58:08 (7288): No heartbeat from core client for 30 sec - exiting
05:58:09 (7288): No heartbeat from core client for 30 sec - exiting
05:58:10 (7288): No heartbeat from core client for 30 sec - exiting
05:58:11 (7288): No heartbeat from core client for 30 sec - exiting
05:58:12 (7288): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
19:13:44 (3640): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:13:45 (3640): No heartbeat from core client for 30 sec - exiting
19:13:47 (3640): No heartbeat from core client for 30 sec - exiting
19:13:48 (3640): No heartbeat from core client for 30 sec - exiting
19:13:49 (3640): No heartbeat from core client for 30 sec - exiting
19:13:50 (3640): No heartbeat from core client for 30 sec - exiting
19:13:51 (3640): No heartbeat from core client for 30 sec - exiting
19:13:52 (3640): No heartbeat from core client for 30 sec - exiting
19:13:53 (3640): No heartbeat from core client for 30 sec - exiting
19:13:54 (3640): No heartbeat from core client for 30 sec - exiting
19:13:55 (3640): No heartbeat from core client for 30 sec - exiting
19:54:41 (1892): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:54:42 (1892): No heartbeat from core client for 30 sec - exiting
19:54:43 (1892): No heartbeat from core client for 30 sec - exiting
19:54:44 (1892): No heartbeat from core client for 30 sec - exiting
19:54:45 (1892): No heartbeat from core client for 30 sec - exiting
19:54:46 (1892): No heartbeat from core client for 30 sec - exiting
19:54:47 (1892): No heartbeat from core client for 30 sec - exiting
19:54:48 (1892): No heartbeat from core client for 30 sec - exiting
19:54:49 (1892): No heartbeat from core client for 30 sec - exiting
19:54:50 (1892): No heartbeat from core client for 30 sec - exiting
19:54:51 (1892): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:14:23 (9992): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
02:25:54 (3228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:07:57 (2448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:07:58 (2448): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
23:48:58 (3844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:48:59 (3844): No heartbeat from core client for 30 sec - exiting
23:49:00 (3844): No heartbeat from core client for 30 sec - exiting
23:49:01 (3844): No heartbeat from core client for 30 sec - exiting
23:49:02 (3844): No heartbeat from core client for 30 sec - exiting
23:49:03 (3844): No heartbeat from core client for 30 sec - exiting
23:49:04 (3844): No heartbeat from core client for 30 sec - exiting
23:49:05 (3844): No heartbeat from core client for 30 sec - exiting
23:49:06 (3844): No heartbeat from core client for 30 sec - exiting
23:49:07 (3844): No heartbeat from core client for 30 sec - exiting
23:49:08 (3844): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
22:58:33 (4740): No heartbeat from core client for 30 sec - exiting
22:58:34 (4740): No heartbeat from core client for 30 sec - exiting
22:58:35 (4740): No heartbeat from core client for 30 sec - exiting
22:58:36 (4740): No heartbeat from core client for 30 sec - exiting
22:58:37 (4740): No heartbeat from core client for 30 sec - exiting
22:58:38 (4740): No heartbeat from core client for 30 sec - exiting
22:58:39 (4740): No heartbeat from core client for 30 sec - exiting
22:58:40 (4740): No heartbeat from core client for 30 sec - exiting
22:58:41 (4740): No heartbeat from core client for 30 sec - exiting
22:58:42 (4740): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
05:19:17 (8236): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
14:46:11 (5352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:46:12 (5352): No heartbeat from core client for 30 sec - exiting
14:46:13 (5352): No heartbeat from core client for 30 sec - exiting
14:46:14 (5352): No heartbeat from core client for 30 sec - exiting
14:46:15 (5352): No heartbeat from core client for 30 sec - exiting
14:46:16 (5352): No heartbeat from core client for 30 sec - exiting
14:46:17 (5352): No heartbeat from core client for 30 sec - exiting
14:46:18 (5352): No heartbeat from core client for 30 sec - exiting
14:46:19 (5352): No heartbeat from core client for 30 sec - exiting
14:46:20 (5352): No heartbeat from core client for 30 sec - exiting
14:46:21 (5352): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
05:56:51 (5476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:56:53 (5476): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
22:16:25 (3032): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:16:26 (3032): No heartbeat from core client for 30 sec - exiting
22:25:23 (6116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:25:24 (6116): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
10:18:37 (6148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:18:38 (6148): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
forrtl: There is not enough space on the disk.
00:20:43 (3656): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
05:07:14 (4636): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
BUFFOUT: C I/O Error - Return code = 32

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
Signal 11 received, exiting...
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Apr 2011 03:22:19 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 777,600 1,220,678 1.5698
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 751,680 1,188,794 1.5815
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 725,760 1,155,772 1.5925
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 699,840 1,131,615 1.6170
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 673,920 1,090,016 1.6174
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 648,000 1,048,355 1.6178
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 622,080 1,006,407 1.6178
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 596,160 964,974 1.6186
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 570,240 924,610 1.6214
20 Apr 2011 18:23:43 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 544,320 883,097 1.6224
13 Apr 2011 01:17:19 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 518,400 841,636 1.6235
12 Apr 2011 09:06:51 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 492,480 800,493 1.6254
12 Apr 2011 09:06:03 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 466,560 759,229 1.6273
12 Apr 2011 09:05:29 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 440,640 718,470 1.6305
12 Apr 2011 09:04:59 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 414,720 676,559 1.6314
12 Apr 2011 09:04:35 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 388,800 634,157 1.6311
12 Apr 2011 09:04:14 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 362,880 592,947 1.6340
12 Apr 2011 09:03:49 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 336,960 551,656 1.6372
12 Apr 2011 09:03:18 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 311,040 510,296 1.6406
12 Apr 2011 09:02:09 1000973 12751081 hadcm3n_o7ej_1900_40_007204926_0 285,120 469,159 1.6455


©2024 climateprediction.net