Task 13132401

Name	hadcm3n_ykif_1900_40_007359441_2
Workunit	7556871
Created	8 Jul 2011, 0:42:33 UTC
Sent	8 Jul 2011, 0:45:36 UTC
Report deadline	7 Oct 2011, 8:12:47 UTC
Received	12 Aug 2011, 14:54:00 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1139716
Run time	30 days 9 hours 4 min 58 sec
CPU time	29 days 3 hours 5 min 28 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	0.65 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.33</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 01:31:11 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:31:12 (5960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 00:00:42 (4360): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:50:10 (4316): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:53 (2328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:02:54 (2328): No heartbeat from core client for 30 sec - exiting 14:35:51 (5308): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:35:52 (5308): No heartbeat from core client for 30 sec - exiting 09:57:51 (2780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:39:02 (1984): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:39:03 (1984): No heartbeat from core client for 30 sec - exiting 09:31:11 (4124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:48 (4492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:17:50 (4492): No heartbeat from core client for 30 sec - exiting 09:03:28 (2548): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:03:30 (2548): No heartbeat from core client for 30 sec - exiting 02:29:40 (3828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:29:41 (3828): No heartbeat from core client for 30 sec - exiting 10:16:33 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:09:16 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:09:18 (5692): No heartbeat from core client for 30 sec - exiting 00:32:28 (5072): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:07:56 (3032): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:07:57 (3032): No heartbeat from core client for 30 sec - exiting 02:07:58 (3032): No heartbeat from core client for 30 sec - exiting 10:03:50 (6116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:03:51 (6116): No heartbeat from core client for 30 sec - exiting 17:51:16 (4004): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:08:29 (4852): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:42:30 (4648): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:49 (4452): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:57:50 (4452): No heartbeat from core client for 30 sec - exiting 07:57:51 (4452): No heartbeat from core client for 30 sec - exiting 09:31:48 (4772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:31:49 (4772): No heartbeat from core client for 30 sec - exiting 15:47:47 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:58 (3684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:23:59 (3684): No heartbeat from core client for 30 sec - exiting 01:23:06 (3776): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:23:07 (3776): No heartbeat from core client for 30 sec - exiting 01:23:08 (3776): No heartbeat from core client for 30 sec - exiting 09:13:00 (2824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:13:01 (2824): No heartbeat from core client for 30 sec - exiting 15:26:52 (1516): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:26:54 (1516): No heartbeat from core client for 30 sec - exiting 17:03:00 (2108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:03:01 (2108): No heartbeat from core client for 30 sec - exiting 23:27:18 (6304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:27:20 (6304): No heartbeat from core client for 30 sec - exiting 01:01:31 (7968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:19:01 (5104): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:19:02 (5104): No heartbeat from core client for 30 sec - exiting 08:54:56 (6048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:54:57 (6048): No heartbeat from core client for 30 sec - exiting 10:06:30 (8036): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:06:31 (8036): No heartbeat from core client for 30 sec - exiting 15:17:55 (7000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:57 (7000): No heartbeat from core client for 30 sec - exiting 15:17:58 (7000): No heartbeat from core client for 30 sec - exiting 16:51:32 (8188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:51:34 (8188): No heartbeat from core client for 30 sec - exiting 23:05:59 (7540): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:41:13 (7324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:41:14 (7324): No heartbeat from core client for 30 sec - exiting 07:01:19 (6908): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:01:21 (6908): No heartbeat from core client for 30 sec - exiting 08:36:54 (7328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:36:55 (7328): No heartbeat from core client for 30 sec - exiting 16:34:24 (7920): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:34:25 (7920): No heartbeat from core client for 30 sec - exiting 22:50:50 (6344): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:54 (4876): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:25:55 (4876): No heartbeat from core client for 30 sec - exiting 00:25:56 (4876): No heartbeat from core client for 30 sec - exiting 01:03:40 (6936): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:03:41 (6936): No heartbeat from core client for 30 sec - exiting 01:03:42 (6936): No heartbeat from core client for 30 sec - exiting 00:03:22 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:22 (6112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:56:24 (6112): No heartbeat from core client for 30 sec - exiting 21:36:13 (5384): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:36:14 (5384): No heartbeat from core client for 30 sec - exiting 22:37:37 (5780): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:37:38 (5780): No heartbeat from core client for 30 sec - exiting 00:11:17 (5700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:52 (4980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:30:53 (4980): No heartbeat from core client for 30 sec - exiting 12:35:06 (2052): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:35:08 (2052): No heartbeat from core client for 30 sec - exiting 12:35:09 (2052): No heartbeat from core client for 30 sec - exiting 13:37:35 (5372): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:12:10 (2560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:01 (4968): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:30:02 (4968): No heartbeat from core client for 30 sec - exiting 21:30:04 (4968): No heartbeat from core client for 30 sec - exiting 06:57:42 (4688): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:57:43 (4688): No heartbeat from core client for 30 sec - exiting 06:57:44 (4688): No heartbeat from core client for 30 sec - exiting 22:35:49 (4608): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:30 (4424): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:12:32 (4424): No heartbeat from core client for 30 sec - exiting 06:37:49 (7080): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:37:50 (7080): No heartbeat from core client for 30 sec - exiting 08:11:53 (7112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:11:54 (7112): No heartbeat from core client for 30 sec - exiting 16:00:56 (6656): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:00:58 (6656): No heartbeat from core client for 30 sec - exiting 16:00:59 (6656): No heartbeat from core client for 30 sec - exiting 23:44:52 (4220): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:44:54 (4220): No heartbeat from core client for 30 sec - exiting 23:44:55 (4220): No heartbeat from core client for 30 sec - exiting 06:00:55 (3976): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:23 (3020): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:36:25 (3020): No heartbeat from core client for 30 sec - exiting 13:57:38 (7124): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:57:40 (7124): No heartbeat from core client for 30 sec - exiting 15:31:03 (8112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:31:04 (8112): No heartbeat from core client for 30 sec - exiting 15:31:05 (8112): No heartbeat from core client for 30 sec - exiting 23:16:32 (5840): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:16:33 (5840): No heartbeat from core client for 30 sec - exiting 05:28:23 (6800): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:28:25 (6800): No heartbeat from core client for 30 sec - exiting 05:28:26 (6800): No heartbeat from core client for 30 sec - exiting 05:28:27 (6800): No heartbeat from core client for 30 sec - exiting 07:02:13 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:02:14 (6668): No heartbeat from core client for 30 sec - exiting 14:50:03 (7816): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:56 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:00:58 (2844): No heartbeat from core client for 30 sec - exiting 22:34:17 (6464): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:34:18 (6464): No heartbeat from core client for 30 sec - exiting 02:27:29 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:27:31 (5272): No heartbeat from core client for 30 sec - exiting 06:14:55 (6068): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:14:56 (6068): No heartbeat from core client for 30 sec - exiting 07:49:18 (7872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:49:19 (7872): No heartbeat from core client for 30 sec - exiting 06:21:51 (4288): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:21:53 (4288): No heartbeat from core client for 30 sec - exiting 06:21:54 (4288): No heartbeat from core client for 30 sec - exiting 06:21:55 (4288): No heartbeat from core client for 30 sec - exiting 08:24:03 (5696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:24:04 (5696): No heartbeat from core client for 30 sec - exiting Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4228, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4436, iMonCtr=1 Model crash detected, will try to restart... 06:04:18 (2696): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:23:46 (4568): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:55 (1156): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:59:57 (1156): No heartbeat from core client for 30 sec - exiting 21:57:16 (5856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:57:17 (5856): No heartbeat from core client for 30 sec - exiting 05:54:17 (2888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:54:19 (2888): No heartbeat from core client for 30 sec - exiting 13:37:04 (5400): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:37:06 (5400): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 12:50:09 (5660): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:50:11 (5660): No heartbeat from core client for 30 sec - exiting 12:50:12 (5660): No heartbeat from core client for 30 sec - exiting 09:11:13 (3720): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:11:15 (3720): No heartbeat from core client for 30 sec - exiting 09:11:16 (3720): No heartbeat from core client for 30 sec - exiting 21:48:35 (5008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:48:37 (5008): No heartbeat from core client for 30 sec - exiting 21:48:38 (5008): No heartbeat from core client for 30 sec - exiting 22:05:23 (3324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:36 (3324): No heartbeat from core client for 30 sec - exiting 22:05:38 (3324): No heartbeat from core client for 30 sec - exiting 00:23:06 (3444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:01 (2236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:20:03 (2236): No heartbeat from core client for 30 sec - exiting 06:20:04 (2236): No heartbeat from core client for 30 sec - exiting 06:34:21 (4428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:34:23 (4428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... 08:01:43 (1064): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... 22:53:28 (2228): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:53:29 (2228): No heartbeat from core client for 30 sec - exiting 07:23:27 (2844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:23:29 (2844): No heartbeat from core client for 30 sec - exiting 07:23:31 (2844):11:12:33 (2524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:12:36 (2524): No heartbeat from core client for 30 sec - exiting 11:12:37 (2524): No heartbeat from core client for 30 sec - exiting 11:15:39 (900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:17:36 (4008): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:40 (3892): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:55:41 (3892): No heartbeat from core client for 30 sec - exiting 09:37:12 (328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:37:14 (328): No heartbeat from core client for 30 sec - exiting 09:37:15 (328): No heartbeat from core client for 30 sec - exiting 09:39:31 (6000): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:41:52 (2164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:00 (5132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:03 (5132): No heartbeat from core client for 30 sec - exiting 22:14:04 (5132): No heartbeat from core client for 30 sec - exiting 22:14:05 (5132): No heartbeat from core client for 30 sec - exiting 22:14:06 (5132): No heartbeat from core client for 30 sec - exiting 10:46:14 (5152): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:46:15 (5152): No heartbeat from core client for 30 sec - exiting 10:46:16 (5152): No heartbeat from core client for 30 sec - exiting 10:48:34 (5300): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:28 (6240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:36:29 (6240): No heartbeat from core client for 30 sec - exiting 14:36:30 (6240): No heartbeat from core client for 30 sec - exiting 14:38:52 (8048): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:08 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:19:12 (6668): No heartbeat from core client for 30 sec - exiting 19:19:14 (6668): No heartbeat from core client for 30 sec - exiting 19:19:15 (6668): No heartbeat from core client for 30 sec - exiting 19:19:16 (6668): No heartbeat from core client for 30 sec - exiting 19:23:04 (7012): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:27 (7416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:29 (7416): No heartbeat from core client for 30 sec - exiting 19:26:30 (7416): No heartbeat from core client for 30 sec - exiting 19:29:35 (7120): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:36 (7120): No heartbeat from core client for 30 sec - exiting 19:32:18 (5864): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:32:19 (5864): No heartbeat from core client for 30 sec - exiting 19:32:21 (5864): No heartbeat from core client for 30 sec - exiting 19:32:22 (5864): No heartbeat from core client for 30 sec - exiting 19:32:23 (5864): No heartbeat from core client for 30 sec - exiting 19:35:44 (7980): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:20 (6552): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:38:21 (6552): No heartbeat from core client for 30 sec - exiting Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
12 Aug 2011 13:54:21	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	259,200	2,516,675	9.7094
10 Aug 2011 01:47:38	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	233,280	2,267,726	9.7210
06 Aug 2011 03:52:53	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	207,360	2,018,787	9.7357
06 Aug 2011 03:52:53	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	181,440	1,763,042	9.7169
28 Jul 2011 00:55:21	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	155,520	1,511,088	9.7164
25 Jul 2011 22:17:28	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	129,600	1,262,024	9.7378
25 Jul 2011 19:30:52	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	103,680	1,013,145	9.7718
25 Jul 2011 17:23:36	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	77,760	760,361	9.7783
25 Jul 2011 14:07:12	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	51,840	505,412	9.7495
25 Jul 2011 14:07:12	1139716	13132401	hadcm3n_ykif_1900_40_007359441_2	25,920	252,605	9.7456