Task 17340967

Name	hadcm3s_3xy0_1983_2_009115752_1
Workunit	9246088
Created	3 Nov 2014, 6:02:26 UTC
Sent	3 Nov 2014, 6:06:25 UTC
Report deadline	2 Feb 2015, 13:33:36 UTC
Received	5 Nov 2014, 22:07:31 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1256734
Run time	1 days 9 hours 22 min 54 sec
CPU time	2 min 53 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	3.88 GFLOPS
Application version	UK Met Office HadCM3 short v7.24 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> MonID=12136, UMPID=12138, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=14146, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=15953, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=18321, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=18903, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=23742, RM3PID=0 SIGSEGV: segmentation violation Stack trace (13 frames): /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x840dcff] linux-gate.so.1(__kernel_sigreturn+0x0)[0xf76e8d70] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x8155032] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x8159aa1] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x815185f] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x815a6ea] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x8153231] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x807f083] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x83812b4] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x839c0ee] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x8392177] /var/lib/boinc/projects/climateprediction.net/hadcm3s_um_7.24_i686-pc-linux-gnu[0x839e676] /usr/lib32/libc.so.6(__libc_start_main+0xde)[0xf7493e5e] Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=12136, iMonCtr=1 Model crash detected, will try to restart... MonID=12136, UMPID=24034, RM3PID=0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=31965, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=31967, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=31969, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=31971, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 MonID=12136, UMPID=31977, RM3PID=0 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( 16:07:18 (12136): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Nov 2014 00:18:41	1256734	17340967	hadcm3s_3xy0_1983_2_009115752_1	25,920	14,974	0.5777