Task 19411352

Name	hadam3p_afr50_bqvi_201412_12_372_010410472_0
Workunit	10410472
Created	19 Mar 2016, 23:07:48 UTC
Sent	20 Mar 2016, 14:50:10 UTC
Report deadline	2 Mar 2017, 20:10:10 UTC
Received	28 Mar 2016, 20:34:04 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	14 (0x0000000E) Unknown error code
Computer ID	1387248
Run time	1 days 15 hours 40 min 4 sec
CPU time	1 days 14 hours 9 min 33 sec
Validate state	Invalid
Credit	3,157.05
Device peak FLOPS	1.60 GFLOPS
Application version	UK Met Office HadAM3P-HadRM3P Africa v7.22 windows_intelx86
Stderr	<core_client_version>7.6.22</core_client_version> <![CDATA[ <message> Not enough storage is available to complete this operation. (0xe) - exit code 14 (0xe) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:03:58 (9512): start_timer_thread(): CreateThread() failed, errno 0 08:04:00 (3848): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 10:12:15 (5876): start_timer_thread(): CreateThread() failed, errno 0 10:12:17 (4752): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:15:43 (560): start_timer_thread(): CreateThread() failed, errno 0 11:15:44 (5352): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:47:29 (2928): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:55:53 (832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:10:53 (9556): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:09:40 (1036): start_timer_thread(): CreateThread() failed, errno 0 13:09:42 (9864): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:31:26 (3280): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:43:48 (1416): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:07:04 (5824): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:15:24 (6916): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:21:52 (2852): start_timer_thread(): CreateThread() failed, errno 0 14:21:54 (8104): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 14:43:04 (4360): start_timer_thread(): CreateThread() failed, errno 0 14:43:05 (3468): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:47:16 (7120): start_timer_thread(): CreateThread() failed, errno 0 14:47:18 (7688): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:22:35 (2844): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:33:20 (9296): start_timer_thread(): CreateThread() failed, errno 0 15:33:21 (9056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:46:04 (8044): start_timer_thread(): CreateThread() failed, errno 0 15:46:06 (8108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:06:45 (5660): start_timer_thread(): CreateThread() failed, errno 0 16:06:46 (9340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:13:18 (6256): start_timer_thread(): CreateThread() failed, errno 0 16:13:19 (3644): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:18:30 (5128): start_timer_thread(): CreateThread() failed, errno 0 16:18:32 (4032): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:23:43 (6020): start_timer_thread(): CreateThread() failed, errno 0 16:23:45 (1168): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:28:49 (4936): start_timer_thread(): CreateThread() failed, errno 0 16:28:51 (5932): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:34:36 (7080): start_timer_thread(): CreateThread() failed, errno 0 16:34:37 (912): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 16:54:50 (9944): start_timer_thread(): CreateThread() failed, errno 0 16:54:52 (9220): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:19:43 (1232): start_timer_thread(): CreateThread() failed, errno 0 17:19:45 (980): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:36:14 (7268): start_timer_thread(): CreateThread() failed, errno 0 18:36:16 (1292): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:40:05 (516): start_timer_thread(): CreateThread() failed, errno 0 18:40:07 (136): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:13:37 (6288): start_timer_thread(): CreateThread() failed, errno 0 19:13:39 (10092): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:27:09 (7436): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:57:40 (4108): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:31:50 (7684): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:17:50 (7228): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:23:00 (8172): start_timer_thread(): CreateThread() failed, errno 0 18:23:01 (8592): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:34:01 (768): start_timer_thread(): CreateThread() failed, errno 0 18:34:03 (5636): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:43:49 (8232): start_timer_thread(): CreateThread() failed, errno 0 18:43:51 (980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:26:53 (4660): start_timer_thread(): CreateThread() failed, errno 0 19:26:55 (9104): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:01:09 (7304): start_timer_thread(): CreateThread() failed, errno 0 20:01:11 (6056): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:00:42 (5336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:12:30 (2408): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:37:08 (7712): start_timer_thread(): CreateThread() failed, errno 0 21:37:09 (7832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:00:24 (8728): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 08:07:30 (5936): start_timer_thread(): CreateThread() failed, errno 0 08:07:31 (6356): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 09:18:01 (6196): start_timer_thread(): CreateThread() failed, errno 0 09:18:02 (524): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:12:37 (5628): start_timer_thread(): CreateThread() failed, errno 0 11:12:39 (8376): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:35:10 (2436): start_timer_thread(): CreateThread() failed, errno 0 11:35:12 (7144): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:38:54 (7512): start_timer_thread(): CreateThread() failed, errno 0 11:38:55 (7768): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 13:06:21 (8648): start_timer_thread(): CreateThread() failed, errno 0 13:06:22 (768): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:39:25 (3644): start_timer_thread(): CreateThread() failed, errno 0 14:39:26 (1536): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 16:04:06 (7780): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 17:24:20 (4600): start_timer_thread(): CreateThread() failed, errno 0 17:24:21 (6856): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:32:59 (1528): start_timer_thread(): CreateThread() failed, errno 0 17:33:01 (6540): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:47:36 (8656): start_timer_thread(): CreateThread() failed, errno 0 17:47:38 (884): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:55:14 (2796): start_timer_thread(): CreateThread() failed, errno 0 17:55:15 (6764): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:24:22 (9800): start_timer_thread(): CreateThread() failed, errno 0 19:24:23 (9240): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:56:22 (8980): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:46:45 (10212): start_timer_thread(): CreateThread() failed, errno 0 20:46:46 (8360): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 21:50:16 (5084): start_timer_thread(): CreateThread() failed, errno 0 21:50:18 (4088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 22:41:13 (8620): start_timer_thread(): CreateThread() failed, errno 0 22:41:15 (5552): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 22:09:04 (8236): start_timer_thread(): CreateThread() failed, errno 0 22:09:06 (29108): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 03:36:53 (1340): start_timer_thread(): CreateThread() failed, errno 0 03:36:55 (28780): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 05:21:15 (29744): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 06:44:46 (30464): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:34:43 (25572): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:38:51 (29500): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:21:29 (2816): start_timer_thread(): CreateThread() failed, errno 0 11:21:30 (28972): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 11:43:18 (29804): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 12:51:51 (30632): start_timer_thread(): CreateThread() failed, errno 0 12:51:53 (28832): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:07:35 (29148): start_timer_thread(): CreateThread() failed, errno 0 13:07:36 (30496): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:29:36 (30520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 14:14:05 (8996): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:20:57 (8512): start_timer_thread(): CreateThread() failed, errno 0 15:20:59 (432): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 15:35:23 (29588): start_timer_thread(): CreateThread() failed, errno 0 15:35:25 (29852): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:17:37 (29336): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:26:44 (8796): start_timer_thread(): CreateThread() failed, errno 0 18:26:45 (29084): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:07:53 (29040): start_timer_thread(): CreateThread() failed, errno 0 23:07:55 (3032): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 23:43:00 (30272): start_timer_thread(): CreateThread() failed, errno 0 23:43:01 (29260): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 00:16:49 (29324): start_timer_thread(): CreateThread() failed, errno 0 00:16:51 (30656): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 01:32:08 (7376): start_timer_thread(): CreateThread() failed, errno 0 01:32:10 (30708): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:43:02 (32080): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 08:53:41 (30296): start_timer_thread(): CreateThread() failed, errno 0 08:53:43 (32340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:09:32 (31988): start_timer_thread(): CreateThread() failed, errno 0 09:09:34 (30924): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 09:52:04 (30592): start_timer_thread(): CreateThread() failed, errno 0 09:52:06 (30892): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:08:54 (29888): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 10:25:49 (29544): start_timer_thread(): CreateThread() failed, errno 0 10:25:50 (32400): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 11:57:57 (31340): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:08:06 (32280): start_timer_thread(): CreateThread() failed, errno 0 13:08:07 (29324): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:18:50 (33056): start_timer_thread(): CreateThread() failed, errno 0 13:18:51 (32088): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 13:50:59 (31868): start_timer_thread(): CreateThread() failed, errno 0 13:51:00 (1456): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:35:27 (33728): start_timer_thread(): CreateThread() failed, errno 0 17:35:28 (30400): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 17:50:26 (33404): start_timer_thread(): CreateThread() failed, errno 0 17:50:27 (32696): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:28:20 (28992): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:32:47 (28304): start_timer_thread(): CreateThread() failed, errno 0 18:32:48 (30380): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:45:06 (4236): start_timer_thread(): CreateThread() failed, errno 0 18:45:08 (29136): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 18:58:03 (28692): start_timer_thread(): CreateThread() failed, errno 0 18:58:04 (27876): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:25:12 (31756): start_timer_thread(): CreateThread() failed, errno 0 19:25:13 (33032): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 19:47:04 (32976): start_timer_thread(): CreateThread() failed, errno 0 19:47:06 (8700): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:05:54 (33636): start_timer_thread(): CreateThread() failed, errno 0 20:05:55 (33520): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:14:26 (33468): start_timer_thread(): CreateThread() failed, errno 0 20:14:27 (31660): start_timer_thread(): CreateThread() failed, errno 0 CPDN Monitor - Quit request from BOINC... 20:17:48 (30148): start_timer_thread(): CreateThread() failed, errno 0 20:17:49 (32748): start_timer_thread(): CreateThread() failed, errno 0 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 11 received, exiting... 20:24:33 (32748): called boinc_finish Global Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=30148, iMonCtr=2 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=32748, selfPID=33780, iMonCtr=1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Mar 2016 07:33:34	1387248	19411352	hadam3p_afr50_bqvi_201412_12_372_010410472_0	34,859	114,901	3.2962
27 Mar 2016 09:12:29	1387248	19411352	hadam3p_afr50_bqvi_201412_12_372_010410472_0	23,339	77,268	3.3107
25 Mar 2016 18:13:29	1387248	19411352	hadam3p_afr50_bqvi_201412_12_372_010410472_0	11,819	39,294	3.3246