Task 21348938

Name	wah2_sam25_m001_200012_85_764_011653213_0
Workunit	11653213
Created	4 Nov 2018, 13:07:22 UTC
Sent	4 Nov 2018, 13:07:51 UTC
Report deadline	17 Oct 2019, 18:27:51 UTC
Received	14 Nov 2018, 10:36:05 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1469080
Run time	6 days 1 hours 27 min 15 sec
CPU time	6 days 0 hours 19 min 15 sec
Validate state	Invalid
Credit	4,579.34
Device peak FLOPS	4.22 GFLOPS
Application version	Weather At Home 2 (wah2) v8.24 windows_intelx86
Peak working set size	419.34 MB
Peak swap size	382.80 MB
Peak disk usage	18.10 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_m001_200012_85_764_011653213/dataout\m001ga.pdk0dec Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7124, iMonCtr=2 Model crash detected, will try to restart... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_m001_200012_85_764_011653213/dataout\m001ga.pdk1feb Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_m001_200012_85_764_011653213/dataout\m001ga.pdk1mar Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_m001_200012_85_764_011653213/dataout\m001ga.pdk1apr Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: C:\ProgramData\BOINC/projects/climateprediction.net/wah2_sam25_m001_200012_85_764_011653213/dataout\m001ga.pdk1may Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:42:07 (42824): Can't acquire lockfile (32) - waiting 35s 03:42:42 (42824): Can't acquire lockfile (32) - exiting 03:42:42 (42824): Error: 03:52:46 (46292): Can't acquire lockfile (32) - waiting 35s 03:53:21 (46292): Can't acquire lockfile (32) - exiting 03:53:21 (46292): Error: 04:03:23 (35908): Can't acquire lockfile (32) - waiting 35s 04:03:58 (35908): Can't acquire lockfile (32) - exiting 04:03:58 (35908): Error: 04:14:00 (44244): Can't acquire lockfile (32) - waiting 35s 04:14:35 (44244): Can't acquire lockfile (32) - exiting 04:14:35 (44244): Error: 04:24:37 (45168): Can't acquire lockfile (32) - waiting 35s 04:25:12 (45168): Can't acquire lockfile (32) - exiting 04:25:12 (45168): Error: 04:35:14 (8664): Can't acquire lockfile (32) - waiting 35s 04:35:49 (8664): Can't acquire lockfile (32) - exiting 04:35:49 (8664): Error: 04:46:15 (41212): Can't acquire lockfile (32) - waiting 35s 04:46:50 (41212): Can't acquire lockfile (32) - exiting 04:46:50 (41212): Error: 04:56:51 (35040): Can't acquire lockfile (32) - waiting 35s 04:57:26 (35040): Can't acquire lockfile (32) - exiting 04:57:26 (35040): Error: 05:07:28 (42900): Can't acquire lockfile (32) - waiting 35s 05:08:03 (42900): Can't acquire lockfile (32) - exiting 05:08:03 (42900): Error: 05:18:05 (42724): Can't acquire lockfile (32) - waiting 35s 05:18:40 (42724): Can't acquire lockfile (32) - exiting 05:18:40 (42724): Error: 05:28:42 (45772): Can't acquire lockfile (32) - waiting 35s 05:29:17 (45772): Can't acquire lockfile (32) - exiting 05:29:17 (45772): Error: 05:39:18 (46024): Can't acquire lockfile (32) - waiting 35s 05:39:53 (46024): Can't acquire lockfile (32) - exiting 05:39:53 (46024): Error: 05:49:55 (4464): Can't acquire lockfile (32) - waiting 35s 05:50:30 (4464): Can't acquire lockfile (32) - exiting 05:50:30 (4464): Error: 06:00:32 (46284): Can't acquire lockfile (32) - waiting 35s 06:01:07 (46284): Can't acquire lockfile (32) - exiting 06:01:07 (46284): Error: 06:11:09 (40640): Can't acquire lockfile (32) - waiting 35s 06:11:44 (40640): Can't acquire lockfile (32) - exiting 06:11:44 (40640): Error: 06:21:45 (42120): Can't acquire lockfile (32) - waiting 35s 06:22:20 (42120): Can't acquire lockfile (32) - exiting 06:22:20 (42120): Error: 06:32:22 (46036): Can't acquire lockfile (32) - waiting 35s 06:32:57 (46036): Can't acquire lockfile (32) - exiting 06:32:57 (46036): Error: 06:42:59 (41212): Can't acquire lockfile (32) - waiting 35s 06:43:34 (41212): Can't acquire lockfile (32) - exiting 06:43:34 (41212): Error: 06:53:35 (46140): Can't acquire lockfile (32) - waiting 35s 06:54:10 (46140): Can't acquire lockfile (32) - exiting 06:54:10 (46140): Error: 07:04:12 (46260): Can't acquire lockfile (32) - waiting 35s 07:04:47 (46260): Can't acquire lockfile (32) - exiting 07:04:47 (46260): Error: 07:14:49 (46480): Can't acquire lockfile (32) - waiting 35s 07:15:24 (46480): Can't acquire lockfile (32) - exiting 07:15:24 (46480): Error: 07:25:26 (42304): Can't acquire lockfile (32) - waiting 35s 07:26:01 (42304): Can't acquire lockfile (32) - exiting 07:26:01 (42304): Error: 07:36:02 (43904): Can't acquire lockfile (32) - waiting 35s 07:36:37 (43904): Can't acquire lockfile (32) - exiting 07:36:37 (43904): Error: 07:46:39 (9048): Can't acquire lockfile (32) - waiting 35s 07:47:14 (9048): Can't acquire lockfile (32) - exiting 07:47:14 (9048): Error: 07:57:16 (43668): Can't acquire lockfile (32) - waiting 35s 07:57:51 (43668): Can't acquire lockfile (32) - exiting 07:57:51 (43668): Error: 08:07:52 (43468): Can't acquire lockfile (32) - waiting 35s 08:08:27 (43468): Can't acquire lockfile (32) - exiting 08:08:27 (43468): Error: 08:18:29 (40564): Can't acquire lockfile (32) - waiting 35s 08:19:04 (40564): Can't acquire lockfile (32) - exiting 08:19:04 (40564): Error: 08:29:06 (42132): Can't acquire lockfile (32) - waiting 35s 08:29:41 (42132): Can't acquire lockfile (32) - exiting 08:29:41 (42132): Error: 08:39:43 (45456): Can't acquire lockfile (32) - waiting 35s 08:40:18 (45456): Can't acquire lockfile (32) - exiting 08:40:18 (45456): Error: 08:50:19 (42172): Can't acquire lockfile (32) - waiting 35s 08:50:54 (42172): Can't acquire lockfile (32) - exiting 08:50:54 (42172): Error: 09:00:56 (45540): Can't acquire lockfile (32) - waiting 35s 09:01:31 (45540): Can't acquire lockfile (32) - exiting 09:01:31 (45540): Error: 09:11:33 (40124): Can't acquire lockfile (32) - waiting 35s 09:12:08 (40124): Can't acquire lockfile (32) - exiting 09:12:08 (40124): Error: 09:22:09 (45756): Can't acquire lockfile (32) - waiting 35s 09:22:44 (45756): Can't acquire lockfile (32) - exiting 09:22:44 (45756): Error: 09:32:46 (34480): Can't acquire lockfile (32) - waiting 35s 09:33:21 (34480): Can't acquire lockfile (32) - exiting 09:33:21 (34480): Error: 09:43:23 (45196): Can't acquire lockfile (32) - waiting 35s 09:43:58 (45196): Can't acquire lockfile (32) - exiting 09:43:58 (45196): Error: 09:54:08 (46924): Can't acquire lockfile (32) - waiting 35s 09:54:43 (46924): Can't acquire lockfile (32) - exiting 09:54:43 (46924): Error: 10:04:44 (47052): Can't acquire lockfile (32) - waiting 35s 10:05:19 (47052): Can't acquire lockfile (32) - exiting 10:05:19 (47052): Error: 10:15:21 (44688): Can't acquire lockfile (32) - waiting 35s 10:15:56 (44688): Can't acquire lockfile (32) - exiting 10:15:56 (44688): Error: 10:25:57 (42696): Can't acquire lockfile (32) - waiting 35s 10:26:32 (42696): Can't acquire lockfile (32) - exiting 10:26:32 (42696): Error: 10:36:34 (45396): Can't acquire lockfile (32) - waiting 35s 10:37:09 (45396): Can't acquire lockfile (32) - exiting 10:37:09 (45396): Error: 10:47:11 (45316): Can't acquire lockfile (32) - waiting 35s 10:47:46 (45316): Can't acquire lockfile (32) - exiting 10:47:46 (45316): Error: 10:57:48 (46780): Can't acquire lockfile (32) - waiting 35s 10:58:23 (46780): Can't acquire lockfile (32) - exiting 10:58:23 (46780): Error: 11:08:25 (44512): Can't acquire lockfile (32) - waiting 35s 11:09:00 (44512): Can't acquire lockfile (32) - exiting 11:09:00 (44512): Error: 11:19:01 (43456): Can't acquire lockfile (32) - waiting 35s 11:19:36 (43456): Can't acquire lockfile (32) - exiting 11:19:36 (43456): Error: 11:29:38 (38348): Can't acquire lockfile (32) - waiting 35s 11:30:13 (38348): Can't acquire lockfile (32) - exiting 11:30:13 (38348): Error: 11:40:15 (46224): Can't acquire lockfile (32) - waiting 35s 11:40:50 (46224): Can't acquire lockfile (32) - exiting 11:40:50 (46224): Error: 11:50:52 (14052): Can't acquire lockfile (32) - waiting 35s 11:51:27 (14052): Can't acquire lockfile (32) - exiting 11:51:27 (14052): Error: 12:01:28 (46780): Can't acquire lockfile (32) - waiting 35s 12:02:03 (46780): Can't acquire lockfile (32) - exiting 12:02:03 (46780): Error: 12:12:05 (43676): Can't acquire lockfile (32) - waiting 35s 12:12:40 (43676): Can't acquire lockfile (32) - exiting 12:12:40 (43676): Error: 12:22:41 (46136): Can't acquire lockfile (32) - waiting 35s 12:23:16 (46136): Can't acquire lockfile (32) - exiting 12:23:16 (46136): Error: 12:33:18 (42104): Can't acquire lockfile (32) - waiting 35s 12:33:53 (42104): Can't acquire lockfile (32) - exiting 12:33:53 (42104): Error: 12:43:55 (45728): Can't acquire lockfile (32) - waiting 35s 12:44:30 (45728): Can't acquire lockfile (32) - exiting 12:44:30 (45728): Error: 12:54:31 (43056): Can't acquire lockfile (32) - waiting 35s 12:55:06 (43056): Can't acquire lockfile (32) - exiting 12:55:06 (43056): Error: 13:05:09 (4676): Can't acquire lockfile (32) - waiting 35s 13:05:44 (4676): Can't acquire lockfile (32) - exiting 13:05:44 (4676): Error: 13:15:46 (43752): Can't acquire lockfile (32) - waiting 35s 13:16:21 (43752): Can't acquire lockfile (32) - exiting 13:16:21 (43752): Error: 13:26:22 (39920): Can't acquire lockfile (32) - waiting 35s 13:26:57 (39920): Can't acquire lockfile (32) - exiting 13:26:57 (39920): Error: 13:36:59 (32696): Can't acquire lockfile (32) - waiting 35s 13:37:34 (32696): Can't acquire lockfile (32) - exiting 13:37:34 (32696): Error: 13:47:36 (35812): Can't acquire lockfile (32) - waiting 35s 13:48:11 (35812): Can't acquire lockfile (32) - exiting 13:48:11 (35812): Error: 13:58:15 (41924): Can't acquire lockfile (32) - waiting 35s 13:58:50 (41924): Can't acquire lockfile (32) - exiting 13:58:50 (41924): Error: Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Global Worker:: CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=2936, iMonCtr=1 Regional Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=0, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5280, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_ain::Monitor... 17:32:55 (6124): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_7.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_8.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_9.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_10.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_11.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_12.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_13.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_14.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_15.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_16.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_17.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_18.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_19.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_20.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_21.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_22.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_23.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_24.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_25.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_26.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_27.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_28.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_29.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_30.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_31.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_32.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_33.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_34.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_35.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_36.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_37.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_38.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_39.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_40.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_41.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_42.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_43.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_44.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_45.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_46.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_47.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_48.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_49.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_50.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_51.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_52.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_53.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_54.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_55.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_56.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_57.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_58.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_59.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_60.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_61.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_62.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_63.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_64.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_65.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_66.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_67.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_68.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_69.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_70.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_71.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_72.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_73.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_74.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_75.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_76.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_77.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_78.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_79.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_80.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_81.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_82.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_83.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_84.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_85.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_sam25_m001_200012_85_764_011653213_0_r511359594_restart.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> </message> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Nov 2018 12:17:16	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	69,419	455,306	6.5588
12 Nov 2018 13:44:36	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	57,899	379,708	6.5581
11 Nov 2018 14:39:00	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	46,379	305,091	6.5782
09 Nov 2018 20:41:00	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	34,859	229,409	6.5811
08 Nov 2018 22:05:49	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	23,339	152,452	6.5321
07 Nov 2018 00:57:58	1469080	21348938	wah2_sam25_m001_200012_85_764_011653213_0	11,819	78,014	6.6007