Task 18415910

Name	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0
Workunit	9885526
Created	7 May 2015, 15:39:15 UTC
Sent	27 May 2015, 20:59:47 UTC
Report deadline	9 May 2016, 2:19:47 UTC
Received	19 Sep 2015, 6:12:54 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1364627
Run time	13 days 19 hours 51 min 35 sec
CPU time	10 days 20 hours 38 min 35 sec
Validate state	Invalid
Credit	8,771.29
Device peak FLOPS	2.75 GFLOPS
Application version	UK Met Office HadAM3P and HadRM3P model with MOSES II and TRIFFID Europe v7.01 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 07:58:33 (7716): called boinc_finish Signal 15 received, exiting... 07:58:33 (7715): called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... 09:18:23 (5784): called boinc_finish Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (15 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf774e400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf74a3904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf7507920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf7507ad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf750625c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf774e400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf748be46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (13 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7707400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf745c904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf74c0920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf74c0ad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf74bf25c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf7707400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884] /lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x5c39)[0xf76cbc39] /lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf7504c6e] Exiting... 09:04:21 (5233): No heartbeat from client for 30 sec - exiting 09:04:21 (5233): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (Stack trace (137 frames): frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7706400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7443e46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... [0xf7706400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf745b904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf74bf920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf74bfad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf74be25c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf7706400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884] /lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x5c39)[0xf76cac39] /lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf7503c6e] Exiting... 00:27:18 (6565): No heartbeat from client for 30 sec - exiting 00:27:18 (6565): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (13 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7731400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf7486904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf74ea920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf74eaad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf74e925c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf7731400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c5884] /lib/i386-linux-gnu/i686/cmov/libpthread.so.0(+0x5c39)[0xf76f5c39] /lib/i386-linux-gnu/i686/cmov/libc.so.6(clone+0x5e)[0xf752ec6e] Exiting... 11:06:48 (6487): No heartbeat from client for 30 sec - exiting 11:06:48 (6487): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:17:46 (22067): No heartbeat from client for 30 sec - exiting 01:17:46 (22067): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:17:06 (6078): No heartbeat from client for 30 sec - exiting 12:17:06 (6078): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (15 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7791400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf74e6904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf754a920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf754aad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf754925c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf7791400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74cee46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... 11:04:09 (6830): called boinc_finish Signal 15 received, exiting... SIGSEGV: segmentation violation SIGSEGV: segmentation violation Stack trace (Stack trace (137 frames): frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf775a400] [0xf775a400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf74af904] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f7d] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf7513920] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf7513ad1] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf751225c] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7497e46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] Exiting... [0xf775a400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 01:31:31 (5932): called boinc_finish Signal 15 received, exiting... 01:31:31 (5933): called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5932, selfPID=5932, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (16 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf7717400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf746c904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf74d0920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf74d0ad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf74cf25c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf7717400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80507b3] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f63] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf7454e46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:38:20 (6726): No heartbeat from client for 30 sec - exiting 03:38:23 (6726): timer handler: client dead, exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11193, selfPID=11193, iMonCtr=1 Signal 15 received, exiting... Signal 15 received, exiting... 16:35:01 (11194): called boinc_finish 16:35:01 (11193): called boinc_finish Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=11193, selfPID=11194, iMonCtr=1 Signal 15 received, exiting... Signal 15 received, exiting... SIGSEGV: segmentation violation Stack trace (15 frames): ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80c8ccf] [0xf77a3400] /lib/i386-linux-gnu/i686/cmov/libc.so.6(getenv+0x64)[0xf74f8904] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92920)[0xf755c920] /lib/i386-linux-gnu/i686/cmov/libc.so.6(+0x92ad1)[0xf755cad1] /lib/i386-linux-gnu/i686/cmov/libc.so.6(localtime_r+0x2c)[0xf755b25c] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c4306] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80c47b6] [0xf77a3400] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x80da8e0] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8050f74] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051aa7] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu[0x8051d79] /lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xf74e0e46] ../../projects/climateprediction.net/hadam3prm3pm2t_eu_7.01_i686-pc-linux-gnu(__gxx_personality_v0+0x1bd)[0x804d331] Exiting... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=7450, selfPID=7450, iMonCtr=1 04:37:08 (16651): No heartbeat from client for 30 sec - exiting 04:37:08 (16651): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=16665, selfPID=16665, iMonCtr=2 04:39:00 (26666): No heartbeat from client for 30 sec - exiting 04:39:00 (26666): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:41:04 (26721): No heartbeat from client for 30 sec - exiting 04:41:04 (26721): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:57:01 (26814): No heartbeat from client for 30 sec - exiting 04:57:01 (26814): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:26 (27444): No heartbeat from client for 30 sec - exiting 11:12:26 (27444): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:15:04 (5733): No heartbeat from client for 30 sec - exiting 11:15:04 (5733): timer handler: client dead, exiting CPDN Monitor - No 'heartbeat' from BOINC... Leaving CPDN_Main::Monitor... 08:07:56 (6238): called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
18 Sep 2015 03:16:46	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	127,115	1,088,914	8.5664
17 Sep 2015 00:03:53	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	115,595	991,233	8.5751
04 Sep 2015 14:07:01	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	103,979	888,781	8.5477
03 Sep 2015 08:28:20	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	92,459	804,731	8.7037
02 Sep 2015 05:12:41	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	80,939	711,426	8.7897
01 Sep 2015 03:17:56	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	69,419	618,457	8.9090
30 Aug 2015 15:09:57	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	57,899	521,135	9.0008
12 Aug 2015 20:17:35	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	46,379	371,700	8.0144
22 Jul 2015 06:51:50	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	34,859	296,429	8.5037
14 Jun 2015 02:41:41	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	23,339	186,631	7.9965
11 Jun 2015 20:52:29	1364627	18415910	hadam3prm3pm2t_eu_oqhp_2002_1_009829600_0	11,819	93,908	7.9455