Task 15741090

Name	hadam3p_pnw_qap8_2039_1_008357269_0
Workunit	8508128
Created	19 Apr 2013, 17:03:34 UTC
Sent	19 Apr 2013, 17:10:01 UTC
Report deadline	1 Apr 2014, 22:30:01 UTC
Received	3 May 2013, 9:49:21 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1180505
Run time	2 days 21 hours 37 min 55 sec
CPU time	1 days 22 hours 29 min 18 sec
Validate state	Invalid
Credit	1,253.67
Device peak FLOPS	2.92 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 i686-apple-darwin
Stderr	<core_client_version>7.0.65</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:32:47 (7108): No heartbeat from core client for 30 sec - exiting 21:32:49 (7108): No heartbeat from core client for 30 sec - exiting 21:32:50 (7108): No heartbeat from core client for 30 sec - exiting 21:32:51 (7108): No heartbeat from core client for 30 sec - exiting 21:32:52 (7108): No heartbeat from core client for 30 sec - exiting 21:32:53 (7108): No heartbeat from core client for 30 sec - exiting 21:32:54 (7108): No heartbeat from core client for 30 sec - exiting 21:32:55 (7108): No heartbeat from core client for 30 sec - exiting 21:32:56 (7108): No heartbeat from core client for 30 sec - exiting 21:32:57 (7108): No heartbeat from core client for 30 sec - exiting 21:32:58 (7108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:41:04 (7130): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 22:39:44 (7319): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:59 (321): No heartbeat from core client for 30 sec - exiting 08:18:00 (321): No heartbeat from core client for 30 sec - exiting 08:18:02 (321): No heartbeat from core client for 30 sec - exiting 08:18:04 (321): No heartbeat from core client for 30 sec - exiting 08:18:05 (321): No heartbeat from core client for 30 sec - exiting 08:18:06 (321): No heartbeat from core client for 30 sec - exiting 08:18:07 (321): No heartbeat from core client for 30 sec - exiting 08:18:08 (321): No heartbeat from core client for 30 sec - exiting 08:18:09 (321): No heartbeat from core client for 30 sec - exiting 08:18:10 (321): No heartbeat from core client for 30 sec - exiting 08:18:11 (321): No heartbeat from core client for 30 sec - exiting 08:18:12 (321): No heartbeat from core client for 30 sec - exiting 08:18:13 (321): No heartbeat from core client for 30 sec - exiting 08:18:14 (321): No heartbeat from core client for 30 sec - exiting 08:18:15 (321): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:05:13 (324): No heartbeat from core client for 30 sec - exiting 08:05:14 (324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:16:56 (4520): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 14:59:11 (16965): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... forrtl: No space left on device forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadam3p_pnw_qap8_2039_1_008357269/dataout/xaakg.out Image PC Routine Line Source hadrm3p_pnw_um_6. 003656A2 Unknown Called boinc_finish SIGSEGV: segmentation violation GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 21 - Return code = 1 Model crashed: READDUMP: BAD BUFFIN OF DATA tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Called boinc_finish GCM: BUFFIN : Read Failed: No such file or directory GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Called boinc_finish GCM: BUFFIN : Read Failed: No such file or directory GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 GCM: BUFFIN : Read Failed: Inappropriate ioctl for device GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 GCM : BUFFIN: C I/O Error feof - Unit 116 - Return code = 1 Model crashed: REPLANCA :I/O ERROR tmp/xaakm.pipe_dummy 2048 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 0 Called boinc_finish </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_6.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_7.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_8.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_9.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_10.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_11.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_12.zip</file_name> <error_code>-161</error_code> </file_xfer_error> <file_xfer_error> <file_name>hadam3p_pnw_qap8_2039_1_008357269_0_13.zip</file_name> <error_code>-161</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 May 2013 15:35:41	1180505	15741090	hadam3p_pnw_qap8_2039_1_008357269_0	57,696	164,378	2.8490
27 Apr 2013 18:14:26	1180505	15741090	hadam3p_pnw_qap8_2039_1_008357269_0	46,176	131,364	2.8449
26 Apr 2013 04:56:45	1180505	15741090	hadam3p_pnw_qap8_2039_1_008357269_0	34,656	98,734	2.8490
25 Apr 2013 13:23:40	1180505	15741090	hadam3p_pnw_qap8_2039_1_008357269_0	23,136	66,164	2.8598
21 Apr 2013 15:50:38	1180505	15741090	hadam3p_pnw_qap8_2039_1_008357269_0	11,616	33,446	2.8793