Task 12172219

Name	hadam3p_pnw_ywix_1968_1_006897217_0
Workunit	7100533
Created	20 Nov 2010, 12:59:27 UTC
Sent	25 Apr 2011, 16:27:00 UTC
Report deadline	6 Apr 2012, 21:47:00 UTC
Received	30 Oct 2011, 10:03:38 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	194 (0x000000C2) EXIT_ABORTED_BY_CLIENT
Computer ID	993192
Run time	27 days 8 hours 33 min 54 sec
CPU time	11 days 20 hours 1 min 56 sec
Validate state	Invalid
Credit	2,505.31
Device peak FLOPS	0.97 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Pacific North West v6.09 windows_intelx86
Stderr	<core_client_version>6.6.36</core_client_version> <![CDATA[ <message> Got ack for job that's till active </message> <stderr_txt> Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4828, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5496, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2216, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5656, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=6020, selfPID=3784, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5424, selfPID=4680, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4144, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4512, selfPID=4696, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5436, selfPID=3448, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4100, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4032, selfPID=5672, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2084, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3408, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5124, selfPID=1836, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3272, selfPID=4244, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4912, selfPID=4356, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5440, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5684, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5052, selfPID=3676, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 19:52:26 (2912): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5884, selfPID=5884, iMonCtr=2 19:52:27 (2912): No heartbeat from core client for 30 sec - exiting 19:52:28 (2912): No heartbeat from core client for 30 sec - exiting 19:52:29 (2912): No heartbeat from core client for 30 sec - exiting 19:52:30 (2912): No heartbeat from core client for 30 sec - exiting 19:52:31 (2912): No heartbeat from core client for 30 sec - exiting 19:52:33 (2912): No heartbeat from core client for 30 sec - exiting 19:52:34 (2912): No heartbeat from core client for 30 sec - exiting 19:52:35 (2912): No heartbeat from core client for 30 sec - exiting 19:52:36 (2912): No heartbeat from core client for 30 sec - exiting 19:52:37 (2912): No heartbeat from core client for 30 sec - exiting Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=476, iMonCtr=2 C17:44:33 (3692): No heartbeat from core client for 30 sec - exiting 17:44:34 (3692): No heartbeat from core client for 30 sec - exiting 17:44:35 (3692): No heartbeat from core client for 30 sec - exiting 17:44:36 (3692): No heartbeat from core client for 30 sec - exiting 17:44:37 (3692): No heartbeat from core client for 30 sec - exiting 17:44:38 (3692): No heartbeat from core client for 30 sec - exiting 17:44:39 (3692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6020, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3980, selfPID=3584, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1344, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5688, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4172, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 3 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=2 Model crash detected, will try to restart... 15:35:11 (3560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=116, selfPID=116, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5892, selfPID=3616, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3392, selfPID=5912, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3748, selfPID=3748, iMonCtr=2 15:48:08 (6008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:14 (3680): No heartbeat from core client for 30 sec - exiting 11:11:15 (3680): No heartbeat from core client for 30 sec - exiting 11:11:16 (3680): No heartbeat from core client for 30 sec - exiting 11:11:17 (3680): No heartbeat from core client for 30 sec - exiting 11:11:18 (3680): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2044, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=648, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 4 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2852, iMonCtr=2 Model crash detected, will try to restart... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5036, selfPID=5280, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3160, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5808, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3628, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4820, iMonCtr Mo del crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4624, selfPID=2012, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5468, selfPID=5468, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5924, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1332, selfPID=4068, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 5 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4420, iMonCtr=2 Model crash detected, will try to restart... 14:24:24 (4716): No heartbeat from core client for 30 sec - exiting 14:24:25 (4716): No heartbeat from core client for 30 sec - exiting 14:24:26 (4716): No heartbeat from core client for 30 sec - exiting 14:24:27 (4716): No heartbeat from core client for 30 sec - exiting 14:24:28 (4716): No heartbeat from core client for 30 sec - exiting 14:24:29 (4716): No heartbeat from core client for 30 sec - exiting 14:24:30 (4716): No heartbeat from core client for 30 sec - exiting 14:24:31 (4716): No heartbeat from core client for 30 sec - exiting 14:24:32 (4716): No heartbeat from core client for 30 sec - exiting 14:24:33 (4716): No heartbeat from core client for 30 sec - exiting 14:24:34 (4716): No heartbeat from core client for 30 sec - exiting 14:24:35 (4716): No heartbeat from core client for 30 sec - exiting 14:24:36 (4716): No heartbeat from core client for 30 sec - exiting 14:24:37 (4716): No heartbeat from core client for 30 sec - exiting 14:24:38 (4716): No heartbeat from core client for 30 sec - exiting 14:24:39 (4716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:06 (2932): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5344, selfPID=5344, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5076, selfPID=4152, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4044, selfPID=5724, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5672, selfPID=5672, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3616, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2740, selfPID=4452, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5512, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=3960, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2340, selfPID=3140, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4860, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5000, selfPID=3776, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4788, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4936, iMonCtr=2 Model crash detected, will try to restart... 00:30:49 (3536): No heartbeat from core client for 30 sec - exiting 00:30:50 (3536): No heartbeat from core client for 30 sec - exiting 00:30:51 (3536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2028, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5756, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2408, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3356, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5272, selfPID=4636, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2248, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4924, selfPID=1268, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4988, selfPID=4048, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4536, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3052, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4720, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4732, selfPID=4088, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 6 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5788, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5924, selfPID=4148, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5776, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4196, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6008, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4120, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4956, iMonCtr=2 Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4620, selfPID=3892, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2716, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 7 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5040, selfPID=6072, iMonCtr=1 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5864, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4284, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4176, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3532, iMonCtr=2 CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5196, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4380, selfPID=1428, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5204, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4348, iMonCtr=2 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 8 19:26:02 (3608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:04 (3608): No heartbeat from core client for 30 sec - exiting 19:26:05 (3608): No heartbeat from core client for 30 sec - exiting 19:26:06 (3608): No heartbeat from core client for 30 sec - exiting 19:26:07 (3608): No heartbeat from core client for 30 sec - exiting 19:26:08 (3608): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4744, iMonCtr=2 Model crash detected, will try to restart... 00:09:53 (4232): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4680, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4368, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... GController:: CPDN process is not running, exiting, bRetVal = 1, checkPID=2904, selfPID=1428, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 9 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5896, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4896, selfPID=3316, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4736, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3740, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5344, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5524, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=2 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3768, iMonCtr=2 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:35:14 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4432, selfPID=4432, iMonCtr=2 Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2200, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4044, iMonCtr=2 Model crash detected, will try to restart... Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1352, iMonCtr=2 BUFFOUT: Write Failed: No space left on device BUFFOUT: C I/O Error - Return code = 32 forrtl: Espacio en disco insuficiente. Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=4476, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=4476, selfPID=3580, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... Regional yearly means requires 12 input files got 10 zip error: Output file write failure (write error on zip file) Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
30 Sep 2011 19:28:23	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	115,299	932,344	8.0863
27 Sep 2011 22:36:52	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	115,296	931,164	8.0763
22 Sep 2011 00:37:31	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	103,776	837,631	8.0715
05 Sep 2011 01:45:17	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	92,256	746,824	8.0951
23 Aug 2011 18:31:59	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	80,736	653,762	8.0975
25 Jul 2011 22:10:31	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	69,216	560,700	8.1007
05 Jul 2011 19:30:42	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	57,697	467,277	8.0988
04 Jul 2011 22:07:59	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	57,696	466,077	8.0782
25 Jun 2011 18:08:20	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	46,176	373,880	8.0968
24 May 2011 17:21:17	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	34,656	282,073	8.1392
10 May 2011 17:58:42	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	23,137	188,619	8.1523
08 May 2011 22:33:37	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	23,136	187,480	8.1034
02 May 2011 17:40:06	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	11,617	95,324	8.2056
01 May 2011 20:47:38	993192	12172219	hadam3p_pnw_ywix_1968_1_006897217_0	11,616	94,203	8.1098