Task 13262437

Name	hadcm3n_t66e_1940_40_007411139_0
Workunit	7608769
Created	16 Aug 2011, 16:49:34 UTC
Sent	16 Aug 2011, 16:52:28 UTC
Report deadline	16 Nov 2011, 0:19:39 UTC
Received	6 Sep 2011, 3:47:44 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1153920
Run time	12 days 7 hours 18 min 15 sec
CPU time	9 days 17 hours 50 min 25 sec
Validate state	Invalid
Credit	6,531.84
Device peak FLOPS	2.20 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> MainError: 06:36:15 PM No files match the supplied pattern. MainError: 06:36:15 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 08:16:15 PM No files match the supplied pattern. MainError: 08:16:15 PM No files match the supplied pattern. MainError: 09:56:54 PM No files match the supplied pattern. MainError: 09:56:54 PM No files match the supplied pattern. MainError: 11:46:48 AM No files match the supplied pattern. MainError: 11:46:48 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 01:35:25 AM No files match the supplied pattern. MainError: 01:35:25 AM No files match the supplied pattern. MainError: 03:13:40 PM No files match the supplied pattern. MainError: 03:13:40 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... MainError: 04:54:07 PM No files match the supplied pattern. MainError: 04:54:07 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 06:38:13 PM No files match the supplied pattern. MainError: 06:38:13 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 12:48:13 AM No files match the supplied pattern. MainError: 12:48:13 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 05:00:30 PM No files match the supplied pattern. MainError: 05:00:30 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 10:36:43 AM No files match the supplied pattern. MainError: 10:36:43 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 05:32:52 AM No files match the supplied pattern. MainError: 05:32:52 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 10:00:23 PM No files match the supplied pattern. MainError: 10:00:23 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 02:43:59 AM No files match the supplied pattern. MainError: 02:43:59 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 06:24:04 PM No files match the supplied pattern. MainError: 06:24:04 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 12:12:07 AM No files match the supplied pattern. MainError: 12:12:07 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 04:33:15 AM No files match the supplied pattern. MainError: 04:33:15 AM No files match the supplied pattern. MainError: 05:55:27 PM No files match the supplied pattern. MainError: 05:55:27 PM No files match the supplied pattern. MainError: 07:06:14 AM No files match the supplied pattern. MainError: 07:06:14 AM No files match the supplied pattern. MainError: 08:10:01 PM No files match the supplied pattern. MainError: 08:10:01 PM No files match the supplied pattern. MainError: 09:09:20 PM No files match the supplied pattern. MainError: 09:09:20 PM No files match the supplied pattern. BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITDUMP: BAD BUFFOUT OF DATA tmp/pipe_dummy 2048 forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/boincuser/Download/BOINC/projects/climateprediction.net/hadcm3n_t66e_1940_40_007411139/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836D10D Unknown Unknown Unknown hadcm3n_um_6.07_i 082EB086 Unknown Unknown Unknown hadcm3n_um_6.07_i 0838F66D Unknown Unknown Unknown hadcm3n_um_6.07_i 0839BDF8 Unknown Unknown Unknown libc.so.6 00576E9C Unknown Unknown Unknown hadcm3n_um_6.07_i 0804CB11 Unknown Unknown Unknown Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=21277, iMonCtr=1 Model crash detected, will try to restart... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /home/boincuser/Download/BOINC/projects/climateprediction.net/hadcm3n_t66e_1940_40_007411139/dataout/stdout_um.txt Image PC Routine Line Source hadcm3n_um_6.07_i 0848EB7D Unknown Unknown Unknown hadcm3n_um_6.07_i 0848D975 Unknown Unknown Unknown hadcm3n_um_6.07_i 0845F3CF Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F90D Unknown Unknown Unknown hadcm3n_um_6.07_i 0841F257 Unknown Unknown Unknown hadcm3n_um_6.07_i 08451069 Unknown Unknown Unknown hadcm3n_um_6.07_i 0844E937 Unknown Unknown Unknown hadcm3n_um_6.07_i 0836Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Sep 2011 21:11:23	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	544,320	1,036,913	1.9050
04 Sep 2011 20:12:54	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	518,400	989,627	1.9090
04 Sep 2011 07:28:08	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	492,480	942,593	1.9140
03 Sep 2011 17:59:34	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	466,560	895,169	1.9187
03 Sep 2011 05:21:52	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	440,640	847,067	1.9224
02 Sep 2011 00:51:15	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	414,720	797,664	1.9234
31 Aug 2011 18:27:44	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	388,800	747,184	1.9218
30 Aug 2011 02:46:34	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	362,880	697,575	1.9223
28 Aug 2011 23:01:52	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	336,960	647,720	1.9222
28 Aug 2011 05:38:18	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	311,040	596,836	1.9188
27 Aug 2011 10:41:23	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	285,120	546,865	1.9180
26 Aug 2011 17:01:59	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	259,200	496,871	1.9169
25 Aug 2011 00:49:44	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	233,280	446,898	1.9157
23 Aug 2011 18:42:29	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	207,360	396,674	1.9130
22 Aug 2011 17:18:17	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	181,440	346,823	1.9115
21 Aug 2011 15:16:44	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	155,520	297,313	1.9117
21 Aug 2011 01:39:36	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	129,600	248,306	1.9159
20 Aug 2011 11:48:17	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	103,680	198,746	1.9169
19 Aug 2011 21:58:19	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	77,760	149,063	1.9170
18 Aug 2011 20:18:28	1153920	13262437	hadcm3n_t66e_1940_40_007411139_0	51,840	99,369	1.9168