Task 15445773

Name	hadcm3n_zd4x_1880_40_008247923_1
Workunit	8403047
Created	21 Nov 2012, 10:43:26 UTC
Sent	21 Nov 2012, 10:43:30 UTC
Report deadline	20 Feb 2013, 18:10:41 UTC
Received	6 Dec 2012, 6:45:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1291504
Run time	11 days 8 hours 33 min 46 sec
CPU time	9 days 18 hours 12 min 21 sec
Validate state	Invalid
Credit	4,354.56
Device peak FLOPS	2.63 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish 01:04:46 (8701): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:35:24 (3769): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 1 received, exiting... CPDN Monitor - Quit request from BOINC... Signal 1 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish 01:02:16 (372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:02:24 (372): No heartbeat from core client for 30 sec - exiting 01:05:51 (10621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:57 (10621): No heartbeat from core client for 30 sec - exiting 01:05:58 (10621): No heartbeat from core client for 30 sec - exiting 01:05:59 (10621): No heartbeat from core client for 30 sec - exiting 01:06:00 (10621): No heartbeat from core client for 30 sec - exiting 01:11:44 (10673): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:45:31 (10727): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf7771400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf7771430] /lib/libc.so.6(gsignal+0x4f)[0xf75ab31f] /lib/libc.so.6(abort+0x143)[0xf75acc03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75963d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77a4400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77a4430] /lib/libc.so.6(gsignal+0x4f)[0xf75de31f] /lib/libc.so.6(abort+0x143)[0xf75dfc03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75c93d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf778d400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf778d430] /lib/libc.so.6(gsignal+0x4f)[0xf75c731f] /lib/libc.so.6(abort+0x143)[0xf75c8c03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75b23d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76ed400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf76ed430] /lib/libc.so.6(gsignal+0x4f)[0xf752731f] /lib/libc.so.6(abort+0x143)[0xf7528c03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75123d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf77c9400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf77c9430] /lib/libc.so.6(gsignal+0x4f)[0xf760331f] /lib/libc.so.6(abort+0x143)[0xf7604c03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf75ee3d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... SIGABRT: abort called Stack trace (9 frames): /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840da8f] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf770a400] linux-gate.so.1(__kernel_vsyscall+0x10)[0xf770a430] /lib/libc.so.6(gsignal+0x4f)[0xf754431f] /lib/libc.so.6(abort+0x143)[0xf7545c03] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x83400c3] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x838f395] /home/va3rcc/Downloads/BOINC/projects/climateprediction.net/hadcm3n_um_6.07_i686-pc-linux-gnu[0x839bdf8] /lib/libc.so.6(__libc_start_main+0xf5)[0xf752f3d5] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6371, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
06 Dec 2012 04:27:35	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	362,880	838,463	2.3106
05 Dec 2012 09:09:30	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	336,960	777,190	2.3065
04 Dec 2012 12:22:59	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	311,040	716,142	2.3024
03 Dec 2012 16:46:17	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	285,120	655,558	2.2992
02 Dec 2012 21:57:02	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	259,200	594,757	2.2946
02 Dec 2012 05:18:00	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	233,280	535,379	2.2950
01 Dec 2012 12:57:13	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	207,360	480,434	2.3169
30 Nov 2012 18:06:04	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	181,440	422,691	2.3296
29 Nov 2012 22:44:30	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	155,520	362,131	2.3285
29 Nov 2012 04:31:39	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	129,600	301,516	2.3265
28 Nov 2012 08:26:45	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	103,680	240,752	2.3221
27 Nov 2012 14:19:46	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	77,760	180,181	2.3171
26 Nov 2012 17:48:06	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	51,840	119,488	2.3049
25 Nov 2012 18:38:20	1217251	15445773	hadcm3n_zd4x_1880_40_008247923_1	25,920	60,011	2.3152