Name | hadcm3n_3jqp_1940_40_008265630_0 |
Workunit | 8420754 |
Created | 21 Dec 2012, 13:19:26 UTC |
Sent | 22 Dec 2012, 18:58:11 UTC |
Report deadline | 24 Mar 2013, 2:25:22 UTC |
Received | 1 Sep 2013, 21:20:59 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1156715 |
Run time | 10 days 22 hours 1 min 38 sec |
CPU time | 10 days 11 hours 57 min |
Validate state | Invalid |
Credit | 6,842.88 |
Device peak FLOPS | 3.22 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.0.64</core_client_version> <![CDATA[ <message> The device does not recognise the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:56:40 (13940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 19:18:51 (11960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:41:21 (10844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:51:31 (7796): No heartbeat from core client for 30 sec - exiting 00:51:32 (7796): No heartbeat from core client for 30 sec - exiting 00:51:33 (7796): No heartbeat from core client for 30 sec - exiting 00:51:34 (7796): No heartbeat from core client for 30 sec - exiting 00:51:35 (7796): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:08:18 (4760): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:24:28 (8596): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:26:05 (3000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:27:33 (8424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:29:36 (7708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:01:38 (3568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:11:28 (10276): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:31:31 (8924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:36:32 (6716): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:14:45 (6868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 07:54:48 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:46 (8868): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:58:53 (9020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:00:23 (3564): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:26 (2784): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:01:28 (2784): No heartbeat from core client for 30 sec - exiting 08:04:40 (7628): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:06:17 (4088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:08:30 (6692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:09:27 (7612): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:20 (2804): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:14:58 (8184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:42:32 (6892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:43:29 (11340): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:00:24 (8020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:50:21 (3288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:08:47 (5016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:39:56 (4696): No heartbeat from core client for 30 sec - exiting 00:39:57 (4696): No heartbeat from core client for 30 sec - exiting 00:39:58 (4696): No heartbeat from core client for 30 sec - exiting 00:39:59 (4696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:02:02 (6244): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:36 (7008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:21:02 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:23:24 (184): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:11:33 (4668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:16:41 (776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:30:25 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:35:27 (748): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:48:17 (1820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:39:26 (11152): No heartbeat from core client for 30 sec - exiting 17:39:29 (11152): No heartbeat from core client for 30 sec - exiting 17:39:30 (11152): No heartbeat from core client for 30 sec - exiting 17:39:31 (11152): No heartbeat from core client for 30 sec - exiting 17:39:34 (11152): No heartbeat from core client for 30 sec - exiting 17:39:35 (11152): No heartbeat from core client for 30 sec - exiting 17:39:36 (11152): No heartbeat from core client for 30 sec - exiting 17:39:39 (11152): No heartbeat from core client for 30 sec - exiting 17:39:40 (11152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:17:14 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:22:14 (8588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:17 (7888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:01:58 (5196): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:01:42 (3264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... ******************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:05 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 ModLoad: 75120000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 750c0000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75390000 00020000 C:\WINDOWS\system32\IMM32.DLL (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77540000 000dd000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.9200.16496) (-exported- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6f5d0000 00129000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74cb0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 *** Dump of the Process Statistics: *** - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 *** Dump of thread ID 9144 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 002a38b1 1132fae8 002a3839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 fe95c451 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Dump of thread ID 3432 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00000000 ebx=43eaff44 ecx=00000000 edx=00000000 esi=43eaff44 edi=00000000 eip=77b4df34 esp=43eaff04 ebp=43eaff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43eaff68 7714119c 00000064 00000000 43eaff84 00749924 ntdll!ZwDelayExecution+0x0 43eaff78 00749924 00000064 43eaff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43eaff84 7728850d 00000000 43eaffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43eaff90 77b7bf39 00000000 ac4dc451 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43eaffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43eaffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Debug Message Dump **** *** Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... ******************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:17 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-nosymbols- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-nosymbols- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 *** Dump of the Process Statistics: *** - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 *** Dump of thread ID 2364 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 001638b1 1132fae8 00163839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 cdeaca0e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Dump of thread ID 1140 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00749910 ebx=43ebff44 ecx=00000000 edx=00000000 esi=43ebff44 edi=00000000 eip=77b4df34 esp=43ebff04 ebp=43ebff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43ebff68 7714119c 00000064 00000000 43ebff84 00749924 ntdll!ZwDelayExecution+0x0 43ebff78 00749924 00000064 43ebff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43ebff84 7728850d 00000000 43ebffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43ebff90 77b7bf39 00000000 9f33ca0e 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43ebffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43ebffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Debug Message Dump **** *** Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restart... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 Engaging BOINC Windows Runtime Debugger... ******************** BOINC Windows Runtime Debugger Version 6.13.0 Dump Timestamp : 08/07/13 13:03:21 Install Directory : Data Directory : C:\ProgramData\BOINC Project Symstore : LoadLibraryA( C:\ProgramData\BOINC\dbghelp.dll ): GetLastError = 126 Loaded Library : dbghelp.dll LoadLibraryA( C:\ProgramData\BOINC\symsrv.dll ): GetLastError = 126 LoadLibraryA( symsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\srcsrv.dll ): GetLastError = 126 LoadLibraryA( srcsrv.dll ): GetLastError = 126 LoadLibraryA( C:\ProgramData\BOINC\version.dll ): GetLastError = 126 Loaded Library : version.dll Debugger Engine : 4.0.5.0 Symbol Search Path: C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_3jqp_1940_40_008265630;C:\ProgramData\BOINC\projects\climateprediction.net ModLoad: 00400000 00b28000 C:\ProgramData\BOINC\projects\climateprediction.net\hadcm3n_um_6.07_windows_intelx86.exe (-nosymbols- Symbols Loaded) Linked PDB Filename : ModLoad: 77b20000 00157000 C:\WINDOWS\SYSTEM32\ntdll.dll (6.2.9200.16578) (-exported- Symbols Loaded) Linked PDB Filename : wntdll.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77260000 00130000 C:\WINDOWS\SYSTEM32\KERNEL32.DLL (6.2.9200.16627) (-exported- Symbols Loaded) Linked PDB Filename : wkernel32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77140000 000a6000 C:\WINDOWS\SYSTEM32\KERNELBASE.dll (6.2.9200.16451) (-exported- Symbols Loaded) Linked PDB Filename : wkernelbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 753b0000 00116000 C:\WINDOWS\SYSTEM32\USER32.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wuser32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 756c0000 000fd000 C:\WINDOWS\SYSTEM32\GDI32.dll (6.2.9200.16622) (-exported- Symbols Loaded) Linked PDB Filename : wgdi32.pdb File Version : 6.2.9200.16622 (win8_gdr.130523-1504) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16622 ModLoad: 77090000 000ae000 C:\WINDOWS\SYSTEM32\ADVAPI32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : advapi32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6a290000 000ce000 C:\WINDOWS\SYSTEM32\OPENGL32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : opengl32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 73d10000 00023000 C:\WINDOWS\SYSTEM32\GLU32.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : glu32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 754d0000 00012000 C:\WINDOWS\SYSTEM32\imagehlp.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : imagehlp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 76fd0000 000b1000 C:\WINDOWS\SYSTEM32\msvcrt.dll (7.0.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : msvcrt.pdb File Version : 7.0.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 7.0.9200.16384 ModLoad: 76920000 00034000 C:\WINDOWS\SYSTEM32\sechost.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : sechost.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77490000 000ac000 C:\WINDOWS\SYSTEM32\RPCRT4.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : wrpcrt4.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74a10000 000d9000 C:\WINDOWS\SYSTEM32\DDRAW.dll (6.2.9200.16384) (-exported- Symbols Loaded) Linked PDB Filename : ddraw.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75130000 0001c000 C:\WINDOWS\SYSTEM32\SspiCli.dll (6.2.9200.16420) (-exported- Symbols Loaded) Linked PDB Filename : wsspicli.pdb File Version : 6.2.9200.16420 (win8_gdr.120919-1813) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16420 ModLoad: 74890000 00007000 C:\WINDOWS\SYSTEM32\DCIMAN32.dll (6.2.9200.16453) (-exported- Symbols Loaded) Linked PDB Filename : dciman32.pdb File Version : 6.2.9200.16453 (win8_gdr.121107-1502) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16453 ModLoad: 75120000 00009000 C:\WINDOWS\SYSTEM32\CRYPTBASE.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : cryptbase.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 750c0000 00051000 C:\WINDOWS\SYSTEM32\bcryptPrimitives.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : bcryptprimitives.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 75390000 00020000 C:\WINDOWS\system32\IMM32.DLL (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : wimm32.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 77540000 000dd000 C:\WINDOWS\SYSTEM32\MSCTF.dll (6.2.9200.16496) (-nosymbols- Symbols Loaded) Linked PDB Filename : msctf.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 6f5d0000 00129000 C:\WINDOWS\SYSTEM32\dbghelp.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : dbghelp.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 ModLoad: 74cb0000 00008000 C:\WINDOWS\SYSTEM32\version.dll (6.2.9200.16384) (-nosymbols- Symbols Loaded) Linked PDB Filename : version.pdb File Version : 6.2.9200.16384 (win8_rtm.120725-1247) Company Name : Microsoft Corporation Product Name : Microsoft® Windows® Operating System Product Version : 6.2.9200.16384 *** Dump of the Process Statistics: *** - I/O Operations Counters - Read: 0, Write: 0, Other 0 - I/O Transfers Counters - Read: 0, Write: 0, Other 0 - Paged Pool Usage - QuotaPagedPoolUsage: 0, QuotaPeakPagedPoolUsage: 0 QuotaNonPagedPoolUsage: 0, QuotaPeakNonPagedPoolUsage: 0 - Virtual Memory Usage - VirtualSize: 0, PeakVirtualSize: 0 - Pagefile Usage - PagefileUsage: 0, PeakPagefileUsage: 0 - Working Set Size - WorkingSetSize: 0, PeakWorkingSetSize: 0, PageFaultCount: 0 *** Dump of thread ID 3580 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Unhandled Exception Record - Reason: Out Of Memory (C++ Exception) (0xe06d7363) at address 0x77154B32 - Registers - eax=1132f9b8 ebx=00000001 ecx=00000003 edx=00000000 esi=009fca88 edi=fffffffe eip=77154b32 esp=1132f9b8 ebp=1132fa14 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000216 - Callstack - ChildEBP RetAddr Args to Child 1132fa14 007bfa90 e06d7363 00000001 00000003 1132fa40 KERNELBASE!RaiseException+0x0 1132fa4c 007bbbcb 1132fa5c 00860978 0082f1b4 0085d354 hadcm3n_um_6.07_windows_intelx8!+0x0 1132fa68 00406e8c 04600000 01000000 00500000 004083ee hadcm3n_um_6.07_windows_intelx8!+0x0 1132fad4 00408130 1132fae8 001638b1 1132fae8 00163839 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff84 7728850d 7ffde000 1132ffd4 77b7bf39 7ffde000 hadcm3n_um_6.07_windows_intelx8!+0x0 1132ff90 77b7bf39 7ffde000 dff4044a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 1132ffd4 77b7bf0c 007bde7f 7ffde000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 1132ffec 00000000 007bde7f 7ffde000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Dump of thread ID 4840 (state: Initialized): *** - Information - Status: Base Priority: Normal, Priority: Normal, , Kernel Time: 0.000000, User Time: 0.000000, Wait Time: 0.000000 - Registers - eax=00749910 ebx=43e4ff44 ecx=00000000 edx=00000000 esi=43e4ff44 edi=00000000 eip=77b4df34 esp=43e4ff04 ebp=43e4ff68 cs=0023 ss=002b ds=002b es=002b fs=0053 gs=002b efl=00000202 - Callstack - ChildEBP RetAddr Args to Child 43e4ff68 7714119c 00000064 00000000 43e4ff84 00749924 ntdll!ZwDelayExecution+0x0 43e4ff78 00749924 00000064 43e4ff90 7728850d 00000000 KERNELBASE!Sleep+0x0 43e4ff84 7728850d 00000000 43e4ffd4 77b7bf39 00000000 hadcm3n_um_6.07_windows_intelx8!+0x0 43e4ff90 77b7bf39 00000000 8d22044a 00000000 00000000 KERNEL32!BaseThreadInitThunk+0x0 43e4ffd4 77b7bf0c 00749910 00000000 ffffffff 77bf1df7 ntdll!RtlInitializeExceptionChain+0x0 43e4ffec 00000000 00749910 00000000 00000000 00000000 ntdll!RtlInitializeExceptionChain+0x0 *** Debug Message Dump **** *** Foreground Window Data *** Window Name : Window Class : Window Process ID: 0 Window Thread ID : 0 Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9248, iMonCtr=1 Model crash detected, will try to restar |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
14 Jan 2013 12:40:12 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 570,240 | 880,250 | 1.5436 |
12 Jan 2013 23:47:58 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 544,320 | 838,188 | 1.5399 |
12 Jan 2013 07:34:04 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 518,400 | 794,595 | 1.5328 |
11 Jan 2013 04:18:33 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 492,480 | 750,289 | 1.5235 |
10 Jan 2013 06:58:21 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 466,560 | 703,817 | 1.5085 |
08 Jan 2013 22:47:50 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 440,640 | 662,463 | 1.5034 |
08 Jan 2013 09:12:08 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 414,720 | 623,779 | 1.5041 |
05 Jan 2013 09:46:01 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 388,800 | 583,332 | 1.5003 |
03 Jan 2013 20:51:27 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 362,880 | 542,073 | 1.4938 |
03 Jan 2013 01:19:17 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 336,960 | 504,213 | 1.4964 |
02 Jan 2013 06:44:39 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 311,040 | 465,437 | 1.4964 |
01 Jan 2013 12:45:22 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 285,120 | 427,247 | 1.4985 |
31 Dec 2012 08:58:29 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 259,200 | 388,702 | 1.4996 |
29 Dec 2012 18:58:26 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 233,280 | 349,225 | 1.4970 |
28 Dec 2012 23:07:57 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 207,360 | 311,209 | 1.5008 |
27 Dec 2012 22:11:50 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 181,440 | 272,126 | 1.4998 |
26 Dec 2012 14:45:15 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 155,520 | 234,165 | 1.5057 |
25 Dec 2012 17:36:37 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 129,600 | 195,857 | 1.5112 |
24 Dec 2012 20:18:13 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 103,680 | 157,130 | 1.5155 |
24 Dec 2012 05:06:57 | 1156715 | 15494835 | hadcm3n_3jqp_1940_40_008265630_0 | 77,760 | 117,763 | 1.5144 |
©2024 cpdn.org