Task 12733990

Name	hadcm3n_o0tv_1900_40_007196406_1
Workunit	7394686
Created	28 Mar 2011, 13:58:14 UTC
Sent	2 Apr 2011, 15:41:05 UTC
Report deadline	2 Jul 2011, 23:08:16 UTC
Received	18 Jun 2011, 8:15:51 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1002155
Run time	25 days 22 hours 6 min 3 sec
CPU time	24 days 13 hours 30 min 30 sec
Validate state	Invalid
Credit	7,776.00
Device peak FLOPS	1.09 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 1 Model crashed: WRITHEAD: I/O error tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:56:34 (1439): No heartbeat from core client for 30 sec - exiting 10:56:43 (1439): No heartbeat from core client for 30 sec - exiting 10:56:44 (1439): No heartbeat from core client for 30 sec - exiting 10:56:45 (1439): No heartbeat from core client for 30 sec - exiting 10:56:46 (1439): No heartbeat from core client for 30 sec - exiting 10:56:47 (1439): No heartbeat from core client for 30 sec - exiting 10:56:48 (1439): No heartbeat from core client for 30 sec - exiting 10:56:49 (1439): No heartbeat from core client for 30 sec - exiting 10:56:50 (1439): No heartbeat from core client for 30 sec - exiting 10:56:51 (1439): No heartbeat from core client for 30 sec - exiting 10:56:54 (1439): No heartbeat from core client for 30 sec - exiting 10:56:55 (1439): No heartbeat from core client for 30 sec - exiting 10:56:56 (1439): No heartbeat from core client for 30 sec - exiting 10:56:57 (1439): No heartbeat from core client for 30 sec - exiting 10:56:58 (1439): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish 16:09:06 (1265): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (7 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xe44400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804cedf] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050a03] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0x1c6bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Jun 2011 17:35:46	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	648,000	2,108,975	3.2546
15 Jun 2011 07:29:11	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	622,080	2,024,260	3.2540
14 Jun 2011 04:20:07	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	596,160	1,939,717	3.2537
11 Jun 2011 17:58:29	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	570,240	1,854,836	3.2527
10 Jun 2011 07:43:24	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	544,320	1,770,247	3.2522
08 Jun 2011 16:11:27	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	518,400	1,685,712	3.2518
30 May 2011 04:42:32	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	492,480	1,600,788	3.2505
28 May 2011 09:29:50	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	466,560	1,515,427	3.2481
27 May 2011 04:53:11	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	440,640	1,430,518	3.2465
25 May 2011 12:00:17	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	414,720	1,345,773	3.2450
24 May 2011 05:32:24	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	388,800	1,261,196	3.2438
22 May 2011 14:17:18	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	362,880	1,177,442	3.2447
20 May 2011 21:47:18	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	336,960	1,093,110	3.2440
19 May 2011 13:07:14	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	311,040	1,008,741	3.2431
15 May 2011 09:32:49	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	285,120	924,568	3.2427
07 May 2011 13:30:52	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	259,200	840,435	3.2424
03 May 2011 20:42:00	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	233,280	755,663	3.2393
30 Apr 2011 08:54:26	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	207,360	671,737	3.2395
24 Apr 2011 11:55:15	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	181,440	588,011	3.2408
12 Apr 2011 12:36:22	1002155	12733990	hadcm3n_o0tv_1900_40_007196406_1	155,520	504,085	3.2413