climateprediction.net home page
Task 19772824

Task 19772824

Name wah2_sas50_ie3d_201412_13_414_010622375_0
Workunit 10622375
Created 22 Jun 2016, 17:31:18 UTC
Sent 4 Jul 2016, 19:11:16 UTC
Report deadline 17 Jun 2017, 0:31:16 UTC
Received 12 Jul 2016, 10:38:44 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1398515
Run time 2 days 1 hours 14 min 50 sec
CPU time 2 days 0 hours 21 min 59 sec
Validate state Invalid
Credit 6,099.22
Device peak FLOPS 3.80 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.12
windows_intelx86
Peak working set size 235.24 MB
Peak swap size 198.16 MB
Peak disk usage 66.78 MB
Stderr
<core_client_version>7.6.22</core_client_version>
<![CDATA[
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:40:28 (6660): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:28:17 (7252): start_timer_thread(): CreateThread() failed, errno 0
07:28:19 (7188): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:02:08 (2404): start_timer_thread(): CreateThread() failed, errno 0
08:02:10 (1636): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:11:38 (7056): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:44:29 (3360): start_timer_thread(): CreateThread() failed, errno 0
14:44:31 (5200): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:54:49 (6504): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:40:02 (9188): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:44:56 (10076): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:06:23 (7080): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:29:46 (10124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:34:24 (7100): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:08:13 (9872): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:27:17 (1376): start_timer_thread(): CreateThread() failed, errno 0
04:27:18 (9904): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:41:35 (9980): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:53:30 (180): start_timer_thread(): CreateThread() failed, errno 0
04:53:32 (7208): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:16:13 (808): start_timer_thread(): CreateThread() failed, errno 0
05:16:15 (3508): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:53:27 (1904): start_timer_thread(): CreateThread() failed, errno 0
05:53:28 (10168): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:57:06 (8044): start_timer_thread(): CreateThread() failed, errno 0
06:57:08 (6620): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:15:05 (7724): start_timer_thread(): CreateThread() failed, errno 0
07:15:07 (10108): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:32:39 (3580): start_timer_thread(): CreateThread() failed, errno 0
09:32:40 (4780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:47:24 (8296): start_timer_thread(): CreateThread() failed, errno 0
09:47:26 (10076): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:59:09 (8476): start_timer_thread(): CreateThread() failed, errno 0
09:59:11 (3816): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:12:34 (2948): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:24:04 (9272): start_timer_thread(): CreateThread() failed, errno 0
10:24:05 (6512): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:06:25 (8640): start_timer_thread(): CreateThread() failed, errno 0
13:06:26 (2952): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:04:26 (6420): start_timer_thread(): CreateThread() failed, errno 0
20:04:28 (4004): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:44:11 (11248): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:28:29 (8036): start_timer_thread(): CreateThread() failed, errno 0
07:28:31 (9656): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:10:58 (9684): start_timer_thread(): CreateThread() failed, errno 0
08:11:00 (7196): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
11:52:57 (8904): start_timer_thread(): CreateThread() failed, errno 0
11:52:59 (10056): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:51:37 (7220): start_timer_thread(): CreateThread() failed, errno 0
18:51:38 (15280): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:38:08 (12340): start_timer_thread(): CreateThread() failed, errno 0
20:38:09 (14376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:05:11 (12004): start_timer_thread(): CreateThread() failed, errno 0
21:05:12 (6440): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:47:11 (1912): start_timer_thread(): CreateThread() failed, errno 0
21:47:13 (13776): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:59:42 (15208): start_timer_thread(): CreateThread() failed, errno 0
21:59:44 (13800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:13:08 (13596): start_timer_thread(): CreateThread() failed, errno 0
22:13:10 (13740): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:26:16 (14744): start_timer_thread(): CreateThread() failed, errno 0
00:26:18 (1664): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:40:23 (16112): start_timer_thread(): CreateThread() failed, errno 0
00:40:25 (17144): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:55:35 (15492): start_timer_thread(): CreateThread() failed, errno 0
00:55:37 (14244): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:09:00 (16784): start_timer_thread(): CreateThread() failed, errno 0
01:09:02 (1664): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:22:24 (15536): start_timer_thread(): CreateThread() failed, errno 0
01:22:26 (16836): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:40:38 (11964): start_timer_thread(): CreateThread() failed, errno 0
01:40:40 (11532): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:03:07 (14340): start_timer_thread(): CreateThread() failed, errno 0
02:03:09 (14768): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:07:31 (15260): start_timer_thread(): CreateThread() failed, errno 0
02:07:33 (15972): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:18:19 (10100): start_timer_thread(): CreateThread() failed, errno 0
02:18:20 (16748): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:27:54 (1284): start_timer_thread(): CreateThread() failed, errno 0
02:27:55 (1040): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:57:35 (13896): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:10:45 (5012): start_timer_thread(): CreateThread() failed, errno 0
03:10:46 (17340): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:34:21 (15024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:56:57 (13876): start_timer_thread(): CreateThread() failed, errno 0
03:56:59 (13492): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:11:43 (15216): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:36:59 (12004): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:50:03 (4880): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:00:29 (13552): start_timer_thread(): CreateThread() failed, errno 0
05:00:31 (13264): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:13:06 (12520): start_timer_thread(): CreateThread() failed, errno 0
05:13:07 (17188): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:26:17 (5796): start_timer_thread(): CreateThread() failed, errno 0
05:26:19 (16112): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:55:31 (17204): start_timer_thread(): CreateThread() failed, errno 0
05:55:33 (13288): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:25:18 (11272): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:39:21 (14440): start_timer_thread(): CreateThread() failed, errno 0
06:39:23 (3356): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:53:57 (17184): start_timer_thread(): CreateThread() failed, errno 0
06:53:59 (11388): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:23:00 (3544): start_timer_thread(): CreateThread() failed, errno 0
07:23:02 (10060): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:37:25 (15932): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:09:41 (19320): start_timer_thread(): CreateThread() failed, errno 0
08:09:43 (19228): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:21:24 (21252): start_timer_thread(): CreateThread() failed, errno 0
08:21:26 (16300): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:32:26 (18804): start_timer_thread(): CreateThread() failed, errno 0
08:32:28 (19160): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:09:03 (21124): start_timer_thread(): CreateThread() failed, errno 0
09:09:04 (10508): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:21:08 (18452): start_timer_thread(): CreateThread() failed, errno 0
09:21:09 (19024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:42:52 (3644): start_timer_thread(): CreateThread() failed, errno 0
09:42:53 (20336): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:08:00 (20836): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:32:43 (16900): start_timer_thread(): CreateThread() failed, errno 0
13:32:45 (11308): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
13:54:17 (5516): start_timer_thread(): CreateThread() failed, errno 0
13:54:18 (14344): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:09:29 (18928): start_timer_thread(): CreateThread() failed, errno 0
14:09:31 (17800): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:24:47 (20840): start_timer_thread(): CreateThread() failed, errno 0
14:24:49 (16852): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:36:42 (1040): start_timer_thread(): CreateThread() failed, errno 0
14:36:44 (9520): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:48:30 (19576): start_timer_thread(): CreateThread() failed, errno 0
14:48:32 (9848): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:12:00 (15208): start_timer_thread(): CreateThread() failed, errno 0
15:12:02 (17076): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:38:02 (20880): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:57:31 (18656): start_timer_thread(): CreateThread() failed, errno 0
15:57:32 (19124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:11:00 (8924): start_timer_thread(): CreateThread() failed, errno 0
16:11:02 (19040): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:26:35 (17248): start_timer_thread(): CreateThread() failed, errno 0
16:26:36 (16364): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
20:01:35 (19308): start_timer_thread(): CreateThread() failed, errno 0
20:01:36 (20048): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:35:27 (4976): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:17:40 (19736): start_timer_thread(): CreateThread() failed, errno 0
21:17:41 (12124): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:29:30 (20192): start_timer_thread(): CreateThread() failed, errno 0
21:29:31 (19584): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:52:20 (19296): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:02:55 (20604): start_timer_thread(): CreateThread() failed, errno 0
22:02:56 (19924): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:28:14 (14324): start_timer_thread(): CreateThread() failed, errno 0
22:28:16 (15120): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:48:21 (18904): start_timer_thread(): CreateThread() failed, errno 0
22:48:23 (11608): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:09:26 (20520): start_timer_thread(): CreateThread() failed, errno 0
23:09:27 (13816): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:47:21 (18816): start_timer_thread(): CreateThread() failed, errno 0
23:47:23 (6696): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:34:35 (20780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:55:39 (20908): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:07:42 (13880): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:40:38 (15932): start_timer_thread(): CreateThread() failed, errno 0
02:40:39 (20212): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:52:30 (19280): start_timer_thread(): CreateThread() failed, errno 0
02:52:32 (13172): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:20:20 (18204): start_timer_thread(): CreateThread() failed, errno 0
03:20:21 (17928): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:39:14 (3008): start_timer_thread(): CreateThread() failed, errno 0
03:39:15 (15988): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:52:00 (18324): start_timer_thread(): CreateThread() failed, errno 0
03:52:01 (18516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:09:14 (7288): start_timer_thread(): CreateThread() failed, errno 0
04:09:16 (20092): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:22:46 (12312): start_timer_thread(): CreateThread() failed, errno 0
04:22:48 (15028): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:16:31 (3772): start_timer_thread(): CreateThread() failed, errno 0
05:16:33 (14188): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:09:12 (20824): start_timer_thread(): CreateThread() failed, errno 0
06:09:14 (18312): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:40:43 (16784): start_timer_thread(): CreateThread() failed, errno 0
06:40:44 (15724): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:53:10 (16828): start_timer_thread(): CreateThread() failed, errno 0
06:53:11 (18968): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:06:59 (19052): start_timer_thread(): CreateThread() failed, errno 0
07:07:00 (1096): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:31:10 (21384): start_timer_thread(): CreateThread() failed, errno 0
07:31:12 (17216): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:54:22 (17780): start_timer_thread(): CreateThread() failed, errno 0
07:54:23 (13400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:06:47 (13352): start_timer_thread(): CreateThread() failed, errno 0
08:06:48 (17760): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:21:55 (10844): start_timer_thread(): CreateThread() failed, errno 0
08:21:57 (20760): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:40:35 (17836): start_timer_thread(): CreateThread() failed, errno 0
08:40:36 (21304): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:22:45 (19144): start_timer_thread(): CreateThread() failed, errno 0
09:22:46 (20196): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:40:49 (19764): start_timer_thread(): CreateThread() failed, errno 0
09:40:50 (14004): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:51:54 (20764): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:09:26 (19328): start_timer_thread(): CreateThread() failed, errno 0
10:09:27 (18196): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:21:02 (2016): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:56:02 (5224): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:24:01 (18248): start_timer_thread(): CreateThread() failed, errno 0
11:24:03 (19328): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:55:53 (11180): start_timer_thread(): CreateThread() failed, errno 0
11:55:55 (19376): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:32:48 (18884): start_timer_thread(): CreateThread() failed, errno 0
12:32:49 (21212): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:27:41 (10524): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:43:38 (22536): start_timer_thread(): CreateThread() failed, errno 0
20:43:39 (22892): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:12:01 (23296): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:24:59 (19672): start_timer_thread(): CreateThread() failed, errno 0
21:25:01 (14736): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:57:51 (17544): start_timer_thread(): CreateThread() failed, errno 0
21:57:53 (22932): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:09:43 (22788): start_timer_thread(): CreateThread() failed, errno 0
22:09:45 (17144): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:23:36 (22248): start_timer_thread(): CreateThread() failed, errno 0
22:23:38 (22744): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:58:14 (22756): start_timer_thread(): CreateThread() failed, errno 0
22:58:15 (23356): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:33:29 (21308): start_timer_thread(): CreateThread() failed, errno 0
01:33:31 (14736): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:45:33 (25468): start_timer_thread(): CreateThread() failed, errno 0
01:45:35 (25232): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:07:49 (24592): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:36:41 (23456): start_timer_thread(): CreateThread() failed, errno 0
02:36:42 (10936): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:09:21 (13940): start_timer_thread(): CreateThread() failed, errno 0
03:09:23 (16076): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:31:42 (15768): start_timer_thread(): CreateThread() failed, errno 0
03:31:43 (25456): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
03:50:36 (3952): start_timer_thread(): CreateThread() failed, errno 0
03:50:38 (17840): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:10:34 (16264): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:22:01 (6004): start_timer_thread(): CreateThread() failed, errno 0
04:22:03 (17672): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:33:24 (23776): start_timer_thread(): CreateThread() failed, errno 0
04:33:25 (580): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:54:30 (19728): start_timer_thread(): CreateThread() failed, errno 0
04:54:32 (22904): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:40:29 (24516): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:44:16 (10524): start_timer_thread(): CreateThread() failed, errno 0
05:44:17 (20808): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:11:39 (25204): start_timer_thread(): CreateThread() failed, errno 0
06:11:40 (22824): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:35:10 (1096): start_timer_thread(): CreateThread() failed, errno 0
06:35:12 (24448): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:57:04 (22996): start_timer_thread(): CreateThread() failed, errno 0
06:57:06 (24780): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:07:15 (24304): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
07:24:34 (26260): start_timer_thread(): CreateThread() failed, errno 0
07:24:35 (16040): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:38:55 (18564): start_timer_thread(): CreateThread() failed, errno 0
07:38:56 (24620): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
07:49:04 (26508): start_timer_thread(): CreateThread() failed, errno 0
07:49:06 (22912): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:37:57 (18160): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
08:50:46 (17712): start_timer_thread(): CreateThread() failed, errno 0
08:50:48 (17724): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:12:03 (26444): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:27:32 (23920): start_timer_thread(): CreateThread() failed, errno 0
09:27:34 (24720): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:03:05 (25232): start_timer_thread(): CreateThread() failed, errno 0
12:03:06 (17024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:15:14 (24520): start_timer_thread(): CreateThread() failed, errno 0
12:15:15 (3360): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
12:52:09 (17312): start_timer_thread(): CreateThread() failed, errno 0
12:52:11 (17356): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:24:39 (20064): start_timer_thread(): CreateThread() failed, errno 0
13:24:41 (21088): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:39:49 (15456): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:09:24 (24696): start_timer_thread(): CreateThread() failed, errno 0
14:09:26 (25752): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
14:56:09 (17836): start_timer_thread(): CreateThread() failed, errno 0
14:56:11 (25768): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:08:54 (24852): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:22:53 (26060): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:34:42 (23836): start_timer_thread(): CreateThread() failed, errno 0
15:34:44 (21224): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:46:42 (24696): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
18:22:38 (20024): start_timer_thread(): CreateThread() failed, errno 0
18:22:39 (22392): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:24:45 (24520): start_timer_thread(): CreateThread() failed, errno 0
18:24:46 (26400): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:41:20 (26068): start_timer_thread(): CreateThread() failed, errno 0
18:41:22 (24708): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:54:33 (26248): start_timer_thread(): CreateThread() failed, errno 0
18:54:34 (22308): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:08:07 (16376): start_timer_thread(): CreateThread() failed, errno 0
19:08:08 (26368): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:21:40 (24524): start_timer_thread(): CreateThread() failed, errno 0
19:21:42 (25316): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:45:50 (23816): start_timer_thread(): CreateThread() failed, errno 0
19:45:51 (21788): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
19:57:39 (24664): start_timer_thread(): CreateThread() failed, errno 0
19:57:41 (20708): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
20:47:21 (20536): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:27:37 (25736): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
21:38:59 (23464): start_timer_thread(): CreateThread() failed, errno 0
21:39:01 (26104): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:10:41 (4860): start_timer_thread(): CreateThread() failed, errno 0
22:10:43 (24732): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:21:50 (26616): start_timer_thread(): CreateThread() failed, errno 0
22:21:52 (17536): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:35:52 (26176): start_timer_thread(): CreateThread() failed, errno 0
22:35:54 (26452): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:45:57 (22600): start_timer_thread(): CreateThread() failed, errno 0
22:45:58 (21844): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
22:55:41 (24336): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
23:22:26 (25316): start_timer_thread(): CreateThread() failed, errno 0
23:22:27 (17432): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
00:45:23 (924): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:54:31 (13920): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:21:37 (23256): start_timer_thread(): CreateThread() failed, errno 0
01:21:39 (23308): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:28:29 (19340): start_timer_thread(): CreateThread() failed, errno 0
01:28:30 (20088): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
01:45:14 (17712): start_timer_thread(): CreateThread() failed, errno 0
01:45:16 (26304): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:01:47 (7572): start_timer_thread(): CreateThread() failed, errno 0
02:01:48 (13592): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:30:29 (19232): start_timer_thread(): CreateThread() failed, errno 0
02:30:30 (23424): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
02:46:42 (24404): start_timer_thread(): CreateThread() failed, errno 0
02:46:44 (24372): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
04:43:00 (2316): start_timer_thread(): CreateThread() failed, errno 0
04:43:01 (3580): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:06:42 (19204): start_timer_thread(): CreateThread() failed, errno 0
05:06:44 (16224): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:19:04 (20676): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:32:12 (24696): start_timer_thread(): CreateThread() failed, errno 0
05:32:14 (14852): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:54:05 (16264): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
06:06:03 (14012): start_timer_thread(): CreateThread() failed, errno 0
06:06:05 (13908): start_timer_thread(): CreateThread() failed, errno 0
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:58:04 (22512): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:09:59 (13008): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:23:03 (10388): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
09:44:16 (15840): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
10:45:56 (25432): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:08:59 (23004): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
11:31:44 (12024): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
13:54:00 (23792): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:25:10 (15688): start_timer_thread(): CreateThread() failed, errno 0
14:25:12 (11632): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:38:30 (8612): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
14:59:43 (14104): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:11:36 (26008): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
15:55:31 (23976): start_timer_thread(): CreateThread() failed, errno 0
15:55:33 (17900): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:17:38 (13980): start_timer_thread(): CreateThread() failed, errno 0
16:17:40 (13148): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
16:55:42 (21128): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
17:44:22 (13228): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
18:43:58 (4052): start_timer_thread(): CreateThread() failed, errno 0
18:44:00 (14132): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
01:09:29 (7764): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:17:00 (24456): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
03:47:15 (8212): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:07:26 (25340): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:19:17 (11120): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:30:22 (22756): start_timer_thread(): CreateThread() failed, errno 0
04:30:23 (24904): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
04:56:43 (16656): start_timer_thread(): CreateThread() failed, errno 0
CPDN Monitor - Quit request from BOINC...
05:37:43 (11732): start_timer_thread(): CreateThread() failed, errno 0
Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=1
Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=23900, selfPID=23716, iMonCtr=1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
05:37:50 (23716): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_9.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_10.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_11.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_12.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_13.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_sas50_ie3d_201412_13_414_010622375_0_14.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>

</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Jul 2016 15:04:31 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 92,459 170,106 1.8398
12 Jul 2016 15:01:57 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 80,939 148,703 1.8372
12 Jul 2016 14:58:22 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 69,419 127,775 1.8406
12 Jul 2016 14:49:04 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 57,899 106,389 1.8375
12 Jul 2016 14:46:55 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 46,379 85,284 1.8388
12 Jul 2016 14:45:55 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 34,859 63,740 1.8285
12 Jul 2016 14:44:49 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 23,339 42,632 1.8266
12 Jul 2016 14:43:16 1398515 19772824 wah2_sas50_ie3d_201412_13_414_010622375_0 11,819 21,706 1.8365


©2024 climateprediction.net