Task 14652329

Name	hadcm3n_yfv7_1980_40_007958705_0
Workunit	8113817
Created	9 May 2012, 21:56:19 UTC
Sent	10 May 2012, 2:44:18 UTC
Report deadline	9 Aug 2012, 10:11:29 UTC
Received	30 May 2012, 1:32:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1260259
Run time	18 days 13 hours 43 min 33 sec
CPU time	15 days 12 hours 56 min 20 sec
Validate state	Invalid
Credit	8,087.04
Device peak FLOPS	2.35 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 SETPOS: Seek Failed: No space left on device SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 Model crashed: SETPOS: Unit 22 to Word Address 169984 Failed with Error Code -1 Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/d4sti/BOINC/projects/climateprediction.net/hadcm3n_yfv7_1980_40_007958705/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0824EBA6 Unknown Unknown Unknown hadcm3n_um_6.07_i 082712DC Unknown Unknown Unknown hadcm3n_um_6.07_i 08177076 Unknown Unknown Unknown hadcm3n_um_6.07_i 081795D4 Unknown Unknown Unknown hadcm3n_um_6.07_i 081908AF Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75A93B7 Unknown Unknown Unknown hadcm3n_um_6.Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2337, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/d4sti/BOINC/projects/climateprediction.net/hadcm3n_yfv7_1980_40_007958705/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08450E2C Unknown Unknown Unknown hadcm3n_um_6.07_i 0824EBA6 Unknown Unknown Unknown hadcm3n_um_6.07_i 082712DC Unknown Unknown Unknown hadcm3n_um_6.07_i 08177076 Unknown Unknown Unknown hadcm3n_um_6.07_i 081795D4 Unknown Unknown Unknown hadcm3n_um_6.07_i 081908AF Unknown Unknown Unknown hadcm3n_um_6.07_i 08391957 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F8B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 F75C63B7 Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2337, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
29 May 2012 17:29:13	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	673,920	1,398,665	2.0754
29 May 2012 00:29:01	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	648,000	1,357,597	2.0951
28 May 2012 03:50:52	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	622,080	1,295,060	2.0818
27 May 2012 10:05:36	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	596,160	1,232,525	2.0674
26 May 2012 14:39:09	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	570,240	1,170,001	2.0518
25 May 2012 18:58:55	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	544,320	1,107,447	2.0346
24 May 2012 21:01:19	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	518,400	1,045,335	2.0165
24 May 2012 06:31:32	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	492,480	991,741	2.0138
23 May 2012 14:49:32	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	466,560	938,747	2.0121
23 May 2012 00:00:39	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	440,640	979,454	2.2228
22 May 2012 06:15:37	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	414,720	919,954	2.2183
21 May 2012 12:45:50	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	388,800	871,440	2.2414
20 May 2012 18:30:54	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	362,880	809,051	2.2295
20 May 2012 01:01:12	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	336,960	746,663	2.2159
19 May 2012 06:47:20	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	311,040	684,234	2.1998
18 May 2012 09:22:20	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	285,120	621,861	2.1811
17 May 2012 13:26:03	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	259,200	562,459	2.1700
16 May 2012 20:37:23	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	233,280	513,879	2.2028
16 May 2012 06:34:43	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	207,360	493,171	2.3783
15 May 2012 11:41:29	1165363	14652329	hadcm3n_yfv7_1980_40_007958705_0	181,440	433,814	2.3910