Task 10946831

Name	hadsm3dhet2_jjos_006588510_6
Workunit	6791883
Created	15 Mar 2010, 11:50:25 UTC
Sent	26 Oct 2010, 16:32:00 UTC
Report deadline	8 Oct 2011, 21:52:00 UTC
Received	26 Dec 2010, 16:25:27 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1109697
Run time	12 days 10 hours 35 min 57 sec
CPU time	11 days 14 hours 58 min 3 sec
Validate state	Workunit error - check skipped
Credit	7,145.52
Device peak FLOPS	2.82 GFLOPS
Application version	UK Met Office HadSM3 Slab Model v6.07 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4544, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3224, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3460, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7352, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2736, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=856, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4892, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1596, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3324, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2988, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4124, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1224, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2056, iMonCtr=1 Model crash detected, will try to restart... MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. MainError: 08:30:46 AM No files match the supplied pattern. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3372, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=332, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. MainError: 09:47:00 AM No files match the supplied pattern. CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4984, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3360, iMonCtr=1 Model crash detected, will try to restart... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2528, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2332, iMonCtr=1 Model crash detected, will try to restart... CCPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1512, iMonCtr=1 Model crash detected, will try to restart... CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2624, iMonCtr=1 Model crash detected, will try to restart... MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. MainError: 04:07:46 PM No files match the supplied pattern. called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
26 Dec 2010 16:16:26	1109697	10946831	hadsm3dhet2_jjos_006588510_6	259,248	1,004,283	1.2913
25 Dec 2010 19:08:52	1109697	10946831	hadsm3dhet2_jjos_006588510_6	248,446	990,389	1.2913
24 Dec 2010 23:32:56	1109697	10946831	hadsm3dhet2_jjos_006588510_6	237,644	976,604	1.2916
24 Dec 2010 13:43:10	1109697	10946831	hadsm3dhet2_jjos_006588510_6	226,842	961,983	1.2907
23 Dec 2010 18:21:56	1109697	10946831	hadsm3dhet2_jjos_006588510_6	216,040	948,443	1.2912
22 Dec 2010 20:08:18	1109697	10946831	hadsm3dhet2_jjos_006588510_6	205,238	934,431	1.2911
22 Dec 2010 11:35:10	1109697	10946831	hadsm3dhet2_jjos_006588510_6	194,436	920,441	1.2911
21 Dec 2010 16:59:05	1109697	10946831	hadsm3dhet2_jjos_006588510_6	183,634	905,885	1.2902
20 Dec 2010 22:29:08	1109697	10946831	hadsm3dhet2_jjos_006588510_6	172,832	891,310	1.2893
20 Dec 2010 12:36:20	1109697	10946831	hadsm3dhet2_jjos_006588510_6	162,030	876,582	1.2881
19 Dec 2010 14:23:08	1109697	10946831	hadsm3dhet2_jjos_006588510_6	151,228	862,225	1.2874
18 Dec 2010 21:14:26	1109697	10946831	hadsm3dhet2_jjos_006588510_6	140,426	847,483	1.2862
18 Dec 2010 11:40:46	1109697	10946831	hadsm3dhet2_jjos_006588510_6	129,624	833,333	1.2858
17 Dec 2010 18:42:42	1109697	10946831	hadsm3dhet2_jjos_006588510_6	118,822	818,883	1.2849
16 Dec 2010 16:20:50	1109697	10946831	hadsm3dhet2_jjos_006588510_6	108,020	804,439	1.2840
15 Dec 2010 10:42:36	1109697	10946831	hadsm3dhet2_jjos_006588510_6	97,218	789,498	1.2822
14 Dec 2010 13:21:26	1109697	10946831	hadsm3dhet2_jjos_006588510_6	86,416	774,582	1.2805
13 Dec 2010 18:27:08	1109697	10946831	hadsm3dhet2_jjos_006588510_6	75,614	760,042	1.2793
13 Dec 2010 09:15:41	1109697	10946831	hadsm3dhet2_jjos_006588510_6	64,812	745,863	1.2787
12 Dec 2010 15:43:36	1109697	10946831	hadsm3dhet2_jjos_006588510_6	54,010	731,686	1.2780