Task 16080299

Name	hadcm3n_o7fq_1980_40_008389344_2
Workunit	8540203
Created	14 Nov 2013, 2:19:30 UTC
Sent	14 Nov 2013, 2:19:51 UTC
Report deadline	13 Feb 2014, 9:47:02 UTC
Received	3 Dec 2013, 12:35:10 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID	1286485
Run time	13 days 5 hours 2 min 59 sec
CPU time	6 days 3 hours 44 min 7 sec
Validate state	Invalid
Credit	8,709.12
Device peak FLOPS	2.93 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.2.31</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073741819 (0xc0000005) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x003D0013 write attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... ****************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 12/02/13 20:59:24 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_o7fq_1980_40_008389344;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 772d0000 00168000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows®-besturingssysteem Product Version : 6.3.9600.16384 ModLoad: 75290000 00140000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.3.9600.16441) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76e50000 000cf000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 77010000 0014f000 C:\WINDOWS\SYSTEM32\USER32.dll (6.3.9600.16441) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76740000 00108000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.3.9600.16421) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.3.9600.16421 (winblue_gdr.131004-2100) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16421 ModLoad: 74d00000 00077000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 72aa0000 000d4000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 72d20000 00024000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 75120000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 76f50000 000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9600.16384 ModLoad: 76e10000 0003e000 C:\WINDOWS\SYSTEM32\sechost.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 76970000 000b1000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 73c90000 000e7000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 74ce0000 0001d000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.3.9600.16408 (winblue_gdr.130920-1803) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16408 ModLoad: 73d90000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74cd0000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74c70000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 76f20000 00025000 C:\WINDOWS\system32\IMM32.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74d80000 000f7000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.3.9600.16418) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 74fb0000 0004d000 C:\WINDOWS\SYSTEM32\ws2_32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : ws2_32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76960000 00007000 C:\WINDOWS\SYSTEM32\NSI.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : nsi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 733d0000 00010000 C:\WINDOWS\system32\napinsp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : NapiNSP.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733b0000 00014000 C:\WINDOWS\system32\pnrpnsp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : pnrpnsp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733e0000 00012000 C:\WINDOWS\system32\NLAapi.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : nlaapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 746e0000 00045000 C:\WINDOWS\System32\mswsock.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : mswsock.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 737e0000 0007c000 C:\WINDOWS\SYSTEM32\DNSAPI.dll (6.3.9600.16423) (-exported- Symbols Loaded) Linked PDB Filename : dnsapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733a0000 00009000 C:\WINDOWS\System32\winrnr.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : winrnr.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74140000 0001e000 C:\WINDOWS\SYSTEM32\IPHLPAPI.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : iphlpapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74160000 00008000 C:\WINDOWS\SYSTEM32\WINNSI.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : winnsi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 73350000 00044000 C:\WINDOWS\System32\fwpuclnt.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : fwpuclnt.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 73340000 00007000 C:\Windows\System32\rasadhlp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : rasadhlp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 6a4b0000 00148000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 73fc0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 2860 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x003D0013 write attempt to address 0x00000000 - Registers - eax=00000001 ebx=68747541 ecx=444d4163 edx=69746e65 esi=00000001 edi=003d0000 eip=003d0013 esp=5e10fc68 ebp=5e10fc90 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010246 - Callstack - ChildEBP RetAddr Args to Child 5e10fc90 00366f05 003c0000 00000000 5e10fcd8 5e10fd90 !+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '003d0013' 5e10fd18 752a495d 00000000 00350000 5e10ff0c 00350000 !+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00366f05' 5e10fed0 752a495d 00330000 00000000 00350000 00350000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 5e10ff88 752a495d 0035be93 00350000 5e10ffdc 773198ee KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 5e10ff98 773198ee 00330000 a32658b2 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 5e10ffdc 773198c4 ffffffff 7730e0e5 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198ee' 5e10fff0 772e3fdb 00330000 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198c4' 00000000 00000000 00000000 00000000 00000000 00000000 ntdll!towupper+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '772e3fdb' * Dump of thread ID 3448 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=3f973ca4 ebx=0f9cd624 ecx=10090e68 edx=bf973ca4 esi=000033d6 edi=00001875 eip=007ac417 esp=0f0a8bf0 ebp=0f0a8c04 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 0f0a8c04 006a999b bf973ca4 3d2cf4f7 3d2c929d 3d2b9e20 hadcm3n_um_6.07_windows_intelx8!+0x0 0f9cd618 00486315 0f825264 10090f20 00486315 396c5618 hadcm3n_um_6.07_windows_intelx8!+0x0 0f9cd624 00486315 396c5618 397c9718 3984b798 398cd818 hadcm3n_um_6.07_windows_intelx8!+0x0 10090f20 0043769e 100911f0 1032c0d4 00f09590 00f0958c hadcm3n_um_6.07_windows_intelx8!+0x0 1032c154 00447f59 00f096e0 00f09588 00f095a0 103331e0 hadcm3n_um_6.07_windows_intelx8!+0x0 103332bc 0070640f 1132f820 1132f824 1132f828 1132f82c hadcm3n_um_6.07_windows_intelx8!+0x0 1132f798 006f3667 00881b6c 00881b70 1132f820 1132f824 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa78 004083f3 00000000 00000000 00000000 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fac8 00733dbd 00000034 00000003 00000003 1132ff8c hadcm3n_um_6.07_windows_intelx8!+0x0 1132fb0c 77311e77 773cb73c 00000000 ec045c26 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fb48 77312624 00000000 1132fb78 0000fffe 000f0578 ntdll!RtlFindCharInUnicodeString+0x0 1132fce8 773124d3 13000112 ffffff0a 13000112 00000000 ntdll!LdrGetDllHandleEx+0x0 1132fcec 13000112 ffffff0a 13000112 00000000 ec045a5a ntdll!LdrGetDllHandleEx+0x0 1132fcf0 ffffff0a 13000112 00000000 ec045a5a 75290000 ntdll!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '13000112' 1132fdf0 007d5757 1132fee4 773614b1 8a065086 fffffffe ntdll!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = 'ffffff0a' 1132fe44 007c2e3f 12b20000 00000000 7730bd8c 77316cc2 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007d5757' 1132fe54 77316cc2 ffffffff 00000024 1132fe70 00000004 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007c2e3f' 1132fe74 007c8516 12b21018 12b21018 fffffffe 007f93e8 ntdll!RtlEncodePointer+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '77316cc2' 1132fe90 007c5965 1132fec8 007c85d2 1132fed4 1132fec8 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007c8516' 1132fe98 007c85d2 1132fed4 1132fec8 007c87ac 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007c5965' 1132fec8 007d410c 00000000 12b210f8 12b21520 12b205a8 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007c85d2' 1132fee4 007d4178 00000000 00000022 00000000 00000004 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007d410c' 1132fefc 007bde14 00400000 00000000 000f2b23 0000000a hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007d4178' 1132ff8c 752a495d 7ffde000 1132ffdc 773198ee 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '007bde14' 1132ff98 773198ee 7ffde000 ec0458b2 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 1132ffdc 773198c4 ffffffff 7730e0e5 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198ee' 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198c4' * Dump of thread ID 3108 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=337aff4c ecx=00000000 edx=00000000 esi=00000000 edi=337aff4c eip=7730bf3c esp=337aff0c ebp=337aff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 337aff70 76e511f6 00000064 00000000 337aff8c 00749924 ntdll!ZwDelayExecution+0x0 337aff80 00749924 00000064 337aff98 752a495d 00000000 KERNELBASE!Sleep+0x0 337aff8c 752a495d 00000000 337affdc 773198ee 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 337aff98 773198ee 00000000 ce4c58b2 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 337affdc 773198c4 ffffffff 7730e0e5 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 337affec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data * Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2528, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x003B0013 write attempt to address 0x00000000 Engaging BOINC Windows Runtime Debugger... **************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 12/03/13 02:32:16 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\slots\4;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00111000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 772d0000 00168000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows®-besturingssysteem Product Version : 6.3.9600.16384 ModLoad: 75290000 00140000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.3.9600.16441) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76e50000 000cf000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 77010000 0014f000 C:\WINDOWS\SYSTEM32\USER32.dll (6.3.9600.16441) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 74d00000 00077000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76740000 00108000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.3.9600.16421) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.3.9600.16421 (winblue_gdr.131004-2100) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16421 ModLoad: 76f50000 000be000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9600.16384 ModLoad: 76e10000 0003e000 C:\WINDOWS\SYSTEM32\sechost.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 76970000 000b1000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 74ce0000 0001d000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.3.9600.16408) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.3.9600.16408 (winblue_gdr.130920-1803) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16408 ModLoad: 74cd0000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74c70000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 76f20000 00025000 C:\WINDOWS\system32\IMM32.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74d80000 000f7000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.3.9600.16418) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 73940000 00025000 C:\WINDOWS\SYSTEM32\ntmarta.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : ntmarta.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 74fb0000 0004d000 C:\WINDOWS\SYSTEM32\ws2_32.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : ws2_32.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 76960000 00007000 C:\WINDOWS\SYSTEM32\NSI.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : nsi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 733d0000 00010000 C:\WINDOWS\system32\napinsp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : NapiNSP.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733b0000 00014000 C:\WINDOWS\system32\pnrpnsp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : pnrpnsp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733e0000 00012000 C:\WINDOWS\system32\NLAapi.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : nlaapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 746e0000 00045000 C:\WINDOWS\System32\mswsock.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : mswsock.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 737e0000 0007c000 C:\WINDOWS\SYSTEM32\DNSAPI.dll (6.3.9600.16423) (-exported- Symbols Loaded) Linked PDB Filename : dnsapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 733a0000 00009000 C:\WINDOWS\System32\winrnr.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : winrnr.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74140000 0001e000 C:\WINDOWS\SYSTEM32\IPHLPAPI.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : iphlpapi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 74160000 00008000 C:\WINDOWS\SYSTEM32\WINNSI.DLL (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : winnsi.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 73350000 00044000 C:\WINDOWS\System32\fwpuclnt.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : fwpuclnt.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Besturingssysteem Microsoft® Windows® Product Version : 6.3.9600.16384 ModLoad: 73340000 00007000 C:\Windows\System32\rasadhlp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : rasadhlp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 72950000 00148000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 ModLoad: 73fc0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.3.9600.16384) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.3.9600.16384 (winblue_rtm.130821-1623) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.3.9600.16384 * Dump of the Process Statistics: * - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 * Dump of thread ID 36 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x003B0013 write attempt to address 0x00000000 - Registers - eax=00000001 ebx=68747541 ecx=444d4163 edx=69746e65 esi=00000001 edi=003b0000 eip=003b0013 esp=02d5fc68 ebp=02d5fc90 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00010246 - Callstack - ChildEBP RetAddr Args to Child 02d5fc90 00336f05 003a0000 00000000 02d5fcd8 02d5fd90 !+0x0 SymFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '003b0013' 02d5fd18 752a495d 00000000 00320000 02d5ff0c 00320000 !+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '00336f05' 02d5fed0 752a495d 003e0000 00000000 00320000 00320000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 02d5ff88 752a495d 0032be93 00320000 02d5ffdc 773198ee KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 02d5ff98 773198ee 003e0000 1567fac4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '752a495d' 02d5ffdc 773198c4 ffffffff 7730e0ee 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198ee' 02d5fff0 772e3fdb 003e0000 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '773198c4' 00000000 00000000 00000000 00000000 00000000 00000000 ntdll!towupper+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '772e3fdb' * Dump of thread ID 5004 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=0018f9f0 ecx=00000000 edx=00000000 esi=00000000 edi=0018f9f0 eip=7730bf3c esp=0018f9b0 ebp=0018fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000212 - Callstack - ChildEBP RetAddr Args to Child 0018fa14 76e511f6 000000c8 00000000 0018fa30 0045b078 ntdll!ZwDelayExecution+0x0 0018fa24 0045b078 000000c8 0018fa60 00406caa a0000000 KERNELBASE!Sleep+0x0 0018fa30 00406caa a0000000 3fc99999 00000000 004b73a0 hadcm3n_6.07_windows_intelx86!+0x0 0018fa60 00407c02 00000001 60dd5208 fffffffe 00000000 hadcm3n_6.07_windows_intelx86!+0x0 0018fa98 01fd4410 01000018 00000024 00010003 00000022 hadcm3n_6.07_windows_intelx86!+0x0 0018fa9c 01000018 00000024 00010003 00000022 0000002f hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '01fd4410' 0018faa0 00000000 00010003 00000022 0000002f 00000000 hadcm3n_6.07_windows_intelx86!+0x0 SymFromAddr(): GetLastError = '126' SymGetLineFromAddr(): GetLastError = '126' SymGetModuleInfo(): GetLastError = '126' Address = '01000018' * Dump of thread ID 2472 (state: Initialized): * - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=80000006 ebx=01f5ff4c ecx=00000000 edx=00000000 esi=00000000 edi=01f5ff4c eip=7730bf3c esp=01f5ff0c ebp=01f5ff70 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000206 - Callstack - ChildEBP RetAddr Args to Child 01f5ff70 76e511f6 00000064 00000000 01f5ff8c 00413da4 ntdll!ZwDelayExecution+0x0 01f5ff80 00413da4 00000064 01f5ff98 752a495d 00000000 KERNELBASE!Sleep+0x0 01f5ff8c 752a495d 00000000 01f5ffdc 773198ee 00000000 hadcm3n_6.07_windows_intelx86!+0x0 01f5ff98 773198ee 00000000 1647fac4 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 01f5ffdc 773198c4 ffffffff 7730e0ee 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 01f5ffec 00000000 00413d90 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 * Debug Message Dump ** * Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5648, selfPID=5648, iMonCtr=1 </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
02 Dec 2013 20:00:53	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	725,760	1,044,748	1.4395
02 Dec 2013 05:02:57	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	699,840	1,007,337	1.4394
01 Dec 2013 14:49:33	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	673,920	969,616	1.4388
30 Nov 2013 19:00:25	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	648,000	932,392	1.4389
30 Nov 2013 06:39:33	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	622,080	895,208	1.4391
29 Nov 2013 18:05:43	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	596,160	857,111	1.4377
29 Nov 2013 06:48:44	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	570,240	819,665	1.4374
28 Nov 2013 13:08:26	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	544,320	782,442	1.4375
27 Nov 2013 21:29:44	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	518,400	744,857	1.4368
27 Nov 2013 07:30:36	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	492,480	707,645	1.4369
26 Nov 2013 15:20:44	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	466,560	670,290	1.4367
26 Nov 2013 01:48:31	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	440,640	633,055	1.4367
25 Nov 2013 06:35:16	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	414,720	595,366	1.4356
24 Nov 2013 13:22:39	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	388,800	558,587	1.4367
23 Nov 2013 22:54:19	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	362,880	522,070	1.4387
23 Nov 2013 07:11:52	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	336,960	485,126	1.4397
22 Nov 2013 14:38:27	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	311,040	447,712	1.4394
21 Nov 2013 20:51:36	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	285,120	410,365	1.4393
21 Nov 2013 05:32:17	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	259,200	372,725	1.4380
20 Nov 2013 06:06:02	1286485	16080299	hadcm3n_o7fq_1980_40_008389344_2	233,280	335,711	1.4391