Task 14776363

Name	hadam3p_eu_cvae_1999_1_007960104_1
Workunit	8115218
Created	6 Jun 2012, 6:41:42 UTC
Sent	6 Jun 2012, 6:45:42 UTC
Report deadline	19 May 2013, 12:05:42 UTC
Received	7 Jun 2012, 10:06:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1171756
Run time	13 hours 50 min 4 sec
CPU time	12 hours 39 min 48 sec
Validate state	Invalid
Credit	200.76
Device peak FLOPS	2.66 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Europe v6.09 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <stderr_txt> 00:41:53 (1797912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:05:13 (1839200): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:18:52 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:53 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:54 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:55 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:56 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:57 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:58 (1662488): No heartbeat from core client for 30 sec - exiting 01:18:59 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:00 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:01 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:02 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:03 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:04 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:05 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:06 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:07 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:08 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:09 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:10 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:11 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:12 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:13 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:14 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:15 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:16 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:17 (1662488): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=1563964, iMonCtr=1 01:19:18 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:19 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:20 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:21 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:22 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:23 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:24 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:25 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:26 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:27 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:28 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:29 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:30 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:31 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:32 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:33 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:34 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:35 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:36 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:37 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:38 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:39 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:40 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:41 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:42 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:43 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:44 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:45 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:46 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:47 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:48 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:49 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:50 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:51 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:52 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:53 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:54 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:55 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:56 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:57 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:58 (1662488): No heartbeat from core client for 30 sec - exiting 01:19:59 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:00 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:01 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:02 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:03 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:04 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:05 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:06 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:07 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:08 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:09 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:10 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:11 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:12 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:13 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:14 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:15 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:16 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:17 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:18 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:19 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:20 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:21 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:22 (1662488): No heartbeat from core client for 30 sec - exiting 01:20:23 (1662488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:17 (1827000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:56:18 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:19 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:20 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:21 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:22 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:23 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:24 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:25 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:26 (1827000): No heartbeat from core client for 30 sec - exiting 01:56:27 (1827000): No heartbeat from core client for 30 sec - exiting 02:07:56 (1839392): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:21:20 (613064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:39:01 (1796464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:51:57 (1839116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1838828, selfPID=1838828, iMonCtr=2 03:01:53 (1643916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:14 (1839908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1839944, selfPID=1839944, iMonCtr=2 03:40:32 (1839612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:13 (1662184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:14 (1662184): No heartbeat from core client for 30 sec - exiting 03:50:15 (1662184): No heartbeat from core client for 30 sec - exiting 04:19:59 (1838788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:35:35 (1662144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:41 (1838920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:48:56 (1563908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:49:47 (1839820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:23:54 (1795304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:00:24 (1839808): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1839160, selfPID=1839160, iMonCtr=2 10:04:37 (1838536): No heartbeat from core client for 30 sec - exiting 10:04:38 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:29 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:30 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:31 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:32 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:33 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:34 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:35 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:36 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:37 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:38 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:39 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:40 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:41 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:42 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:43 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:44 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:45 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:46 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:47 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:48 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:49 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:50 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:51 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:52 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:53 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:54 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:55 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:56 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:57 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:58 (1838536): No heartbeat from core client for 30 sec - exiting 10:05:59 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:00 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:01 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:02 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:03 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:04 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:05 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:06 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:07 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:08 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:09 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:10 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:11 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:12 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:13 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:14 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:15 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:16 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:17 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:18 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:19 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:20 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:21 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:22 (1838536): No heartbeat from core client for 30 sec - exiting 10:06:23 (1838536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:05:35 (1839644): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... SETPOS: Seek Failed: Invalid argument SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 61 to Word Address -198 Failed with Error Code -1 Leaving CPDN_Main::Monitor... Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_2.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_3.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_4.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_5.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_eu_cvae_1999_1_007960104_1_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Jun 2012 02:47:44	1171756	14776363	hadam3p_eu_cvae_1999_1_007960104_1	11,638	27,256	2.3420
07 Jun 2012 02:47:44	1171756	14776363	hadam3p_eu_cvae_1999_1_007960104_1	11,616	26,799	2.3071