Task 13136516

Name	hadcm3n_yja7_1900_40_007357849_2
Workunit	7555279
Created	10 Jul 2011, 7:26:28 UTC
Sent	10 Jul 2011, 7:42:36 UTC
Report deadline	9 Oct 2011, 15:09:47 UTC
Received	14 Sep 2011, 19:11:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1032862
Run time	17 days 22 hours 7 min 51 sec
CPU time	12 days 13 hours 23 min 52 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.94 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 23:33:30 (3710): No heartbeat from core client for 30 sec - exiting 23:33:33 (3710): No heartbeat from core client for 30 sec - exiting 23:33:34 (3710): No heartbeat from core client for 30 sec - exiting 23:33:35 (3710): No heartbeat from core client for 30 sec - exiting 23:33:37 (3710): No heartbeat from core client for 30 sec - exiting 23:33:38 (3710): No heartbeat from core client for 30 sec - exiting 23:33:39 (3710): No heartbeat from core client for 30 sec - exiting 23:33:40 (3710): No heartbeat from core client for 30 sec - exiting 23:33:41 (3710): No heartbeat from core client for 30 sec - exiting 23:33:42 (3710): No heartbeat from core client for 30 sec - exiting 23:33:43 (3710): No heartbeat from core client for 30 sec - exiting 23:33:44 (3710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/yja7ko.pja4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ko.pja4c10 Error: Input file: dataout/yja7ko.pia4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ko.pia4c10 Error: Input file: dataout/yja7ko.pfa4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ko.pfa4c10 Error: Input file: dataout/yja7ka.pha4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ka.pha4c10 Error: Input file: dataout/yja7ka.pga4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ka.pga4c10 Error: Input file: dataout/yja7ka.pea4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ka.pea4c10 Error: Input file: dataout/yja7ka.pda4c10 is not a valid UM file. Error converting file to netcdf: dataout/yja7ka.pda4c10 Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Signal 1 received, exiting... Called boinc_finish Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (14 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806c0d5] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x806e5f2] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8072509] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8077f47] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x80781a3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e1b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xfe)[0xf7419c2e] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
14 Sep 2011 19:12:33	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	518,400	1,085,027	2.0930
11 Sep 2011 13:27:42	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	492,480	1,031,834	2.0952
07 Sep 2011 17:00:09	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	466,560	977,926	2.0960
03 Sep 2011 23:10:21	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	440,640	924,252	2.0975
29 Aug 2011 18:00:05	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	414,720	870,198	2.0983
27 Aug 2011 10:16:04	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	388,800	816,866	2.1010
23 Aug 2011 15:46:28	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	362,880	763,458	2.1039
19 Aug 2011 18:02:18	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	336,960	709,579	2.1058
18 Aug 2011 12:53:11	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	311,040	654,203	2.1033
16 Aug 2011 18:23:20	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	285,120	599,038	2.1010
15 Aug 2011 12:30:08	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	259,200	543,900	2.0984
12 Aug 2011 18:50:48	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	233,280	488,189	2.0927
11 Aug 2011 14:29:45	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	207,360	433,121	2.0887
08 Aug 2011 11:29:12	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	181,440	378,028	2.0835
02 Aug 2011 19:32:45	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	155,520	323,010	2.0770
30 Jul 2011 12:27:48	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	129,600	268,316	2.0703
26 Jul 2011 17:27:49	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	103,680	213,528	2.0595
25 Jul 2011 19:09:29	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	77,760	158,553	2.0390
25 Jul 2011 18:01:35	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	51,840	105,514	2.0354
25 Jul 2011 15:37:31	1032862	13136516	hadcm3n_yja7_1900_40_007357849_2	25,920	53,232	2.0537