Task 11757993

Name	famous_vapi_1999_200_006699644_4
Workunit	6902897
Created	26 Aug 2010, 16:38:46 UTC
Sent	4 Dec 2010, 23:00:09 UTC
Report deadline	6 Mar 2011, 6:27:20 UTC
Received	7 Dec 2010, 11:56:50 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1119173
Run time	16 hours 54 min 1 sec
CPU time	16 hours 29 min 31 sec
Validate state	Invalid
Credit	1,111.83
Device peak FLOPS	2.96 GFLOPS
Application version	UK Met Office FAMOUS v6.11 i686-apple-darwin
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002000c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002000c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002000c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002000c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002000c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002000c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002001c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002001c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002001c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002001c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002001c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002001c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002002c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002002c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002002c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002002c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002002c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002002c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002003c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002003c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002003c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002003c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002003c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002003c1+ CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002004c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002004c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002004c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002004c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002004c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002004c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002005c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002005c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002005c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002005c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002005c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002005c1+ CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002006c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002006c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002006c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002006c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002006c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002006c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002007c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002007c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002007c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002007c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002007c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002007c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002008c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002008c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002008c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002008c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002008c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002008c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002009c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002009c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002009c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002009c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002009c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002009c1+ CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002010c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002010c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002010c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002010c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002010c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002010c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002011c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002011c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002011c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002011c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002011c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002011c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002012c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002012c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002012c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002012c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002012c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002012c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002013c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002013c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002013c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002013c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002013c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002013c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002014c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002014c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002014c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002014c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002014c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002014c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002015c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002015c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002015c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002015c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002015c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002015c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002016c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002016c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002016c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002016c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002016c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002016c1+ CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Mon Dec 6 02:32:37 2010 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x9368946b 0x9368946b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x936230fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c ss: 0x0000001f efl: 0x00000206 eip: 0x936230fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libirc.dylib 0x907ba000 - 0x907bdfff /usr/lib/system/libmathCommon.A.dylib 0x93622000 - 0x937c9fff /usr/lib/libSystem.B.dylib 0x96562000 - 0x96570fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=95898, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002017c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002017c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002017c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002017c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002017c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002017c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002018c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002018c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002018c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002018c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002018c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002018c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002019c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002019c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002019c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002019c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002019c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002019c1+ CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Mon Dec 6 13:04:11 2010 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x9368946b 0x9368946b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x936230fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c ss: 0x0000001f efl: 0x00000206 eip: 0x936230fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libirc.dylib 0x907ba000 - 0x907bdfff /usr/lib/system/libmathCommon.A.dylib 0x93622000 - 0x937c9fff /usr/lib/libSystem.B.dylib 0x96562000 - 0x96570fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1335, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... SIGSEGV: segmentation violation Crashed executable name: famous_um_6.11_i686-apple-darwin built using BOINC library version 6.11.1 Machine type Intel 80486 (32-bit executable) System version: Macintosh OS 10.6.5 build 10H574 Mon Dec 6 13:04:32 2010 0 0x0048fdcf PrintBacktrace (in famous_um_6.11_i686-apple-darwin) + 1221 1 0x0049054a boinc_catch_signal (in famous_um_6.11_i686-apple-darwin) + 474 2 0x9368946b 0x9368946b 3 0xffffffff 0xffffffff 4 0x0134e6b3 0x134e6b3 5 0x0134d44f 0x134d44f 6 0x002eeac6 readcntl (in famous_um_6.11_i686-apple-darwin) + 2598 7 0x003f55ea um_setup (in famous_um_6.11_i686-apple-darwin) + 458 8 0x00452abd um_shell (in famous_um_6.11_i686-apple-darwin) + 11429 9 0x004698c0 main (in famous_um_6.11_i686-apple-darwin) + 1112 10 0x000026b6 _start (in famous_um_6.11_i686-apple-darwin) + 216 11 0x000025dd start (in famous_um_6.11_i686-apple-darwin) + 41 Thread 0 crashed with X86 Thread State (32-bit): eax: 0xffffffe1 ebx: 0x00000003 ecx: 0xbfffc43c edx: 0x936230fa edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc478 esp: 0xbfffc43c ss: 0x0000001f efl: 0x00000206 eip: 0x936230fa cs: 0x00000007 ds: 0x0000001f es: 0x0000001f fs: 0x00000000 gs: 0x00000037 Binary Images Description: 0x1000 - 0x517fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_um_6.11_i686-apple-darwin 0x12a9000 - 0x12c4fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libsvml.dylib 0x131c000 - 0x13b3fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libifcoremt.dylib 0x13fc000 - 0x1556fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libimf.dylib 0x1669000 - 0x1697fff /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/lib/libirc.dylib 0x907ba000 - 0x907bdfff /usr/lib/system/libmathCommon.A.dylib 0x93622000 - 0x937c9fff /usr/lib/libSystem.B.dylib 0x96562000 - 0x96570fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1350, iMonCtr=1 Model crash detected, will try to restart... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002020c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002020c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002020c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002020c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002020c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002020c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002021c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002021c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002021c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002021c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002021c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002021c1+ CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002022c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002022c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002022c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002022c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002022c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002022c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002023c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002023c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002023c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002023c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002023c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002023c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002024c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002024c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002024c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002024c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002024c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002024c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002025c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002025c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002025c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002025c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002025c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002025c1+ CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002026c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002026c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002026c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002026c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002026c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002026c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002027c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002027c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002027c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002027c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002027c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002027c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002028c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002028c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002028c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002028c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002028c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002028c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002029c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002029c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002029c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002029c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002029c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002029c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002030c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002030c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002030c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002030c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002030c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002030c1+ CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002031c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002031c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002031c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002031c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002031c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002031c1+ Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002032c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002032c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002032c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002032c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002032c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002032c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002033c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002033c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002033c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002033c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002033c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002033c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002034c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002034c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002034c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002034c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002034c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002034c1+ CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 60 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 61 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002035c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pa000002035c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002035c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapila#pb000002035c1+ file : /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002035c1+ does not exist Error converting file to netcdf: /Library/Application Support/BOINC Data/projects/climateprediction.net/famous_vapi_1999_200_006699644/dataout/vapilo#pj000002035c1+ Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy Sorry, too many model crashes! :-( (13708): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
07 Dec 2010 11:39:46	1119173	11757993	famous_vapi_1999_200_006699644_4	336,986	58,167	0.1726
07 Dec 2010 11:13:53	1119173	11757993	famous_vapi_1999_200_006699644_4	327,626	56,553	0.1726
07 Dec 2010 09:50:56	1119173	11757993	famous_vapi_1999_200_006699644_4	318,266	54,873	0.1724
07 Dec 2010 09:50:56	1119173	11757993	famous_vapi_1999_200_006699644_4	308,906	53,191	0.1722
07 Dec 2010 09:50:56	1119173	11757993	famous_vapi_1999_200_006699644_4	299,546	51,495	0.1719
07 Dec 2010 09:50:56	1119173	11757993	famous_vapi_1999_200_006699644_4	290,186	49,821	0.1717
07 Dec 2010 00:40:03	1119173	11757993	famous_vapi_1999_200_006699644_4	280,826	48,180	0.1716
07 Dec 2010 00:14:54	1119173	11757993	famous_vapi_1999_200_006699644_4	271,466	46,533	0.1714
06 Dec 2010 21:44:01	1119173	11757993	famous_vapi_1999_200_006699644_4	262,106	44,901	0.1713
06 Dec 2010 21:15:18	1119173	11757993	famous_vapi_1999_200_006699644_4	252,746	43,284	0.1713
06 Dec 2010 19:06:46	1119173	11757993	famous_vapi_1999_200_006699644_4	243,386	41,654	0.1711
06 Dec 2010 18:38:48	1119173	11757993	famous_vapi_1999_200_006699644_4	234,026	40,044	0.1711
06 Dec 2010 16:09:01	1119173	11757993	famous_vapi_1999_200_006699644_4	224,666	38,407	0.1710
06 Dec 2010 15:42:13	1119173	11757993	famous_vapi_1999_200_006699644_4	215,306	36,757	0.1707
06 Dec 2010 13:52:44	1119173	11757993	famous_vapi_1999_200_006699644_4	205,946	35,141	0.1706
06 Dec 2010 13:28:01	1119173	11757993	famous_vapi_1999_200_006699644_4	196,586	33,509	0.1705
06 Dec 2010 12:55:40	1119173	11757993	famous_vapi_1999_200_006699644_4	187,226	31,881	0.1703
06 Dec 2010 09:46:04	1119173	11757993	famous_vapi_1999_200_006699644_4	177,866	30,271	0.1702
06 Dec 2010 09:23:50	1119173	11757993	famous_vapi_1999_200_006699644_4	168,506	28,721	0.1704
06 Dec 2010 09:06:35	1119173	11757993	famous_vapi_1999_200_006699644_4	159,146	27,147	0.1706