Task 15724149

Name	hadcm3n_3ie4_1940_40_008259212_3
Workunit	8414336
Created	14 Apr 2013, 6:45:13 UTC
Sent	14 Apr 2013, 6:45:45 UTC
Report deadline	14 Jul 2013, 14:12:56 UTC
Received	17 Apr 2013, 8:45:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1101937
Run time	2 days 7 hours 0 min
CPU time	1 days 6 hours 37 min 14 sec
Validate state	Invalid
Credit	311.04
Device peak FLOPS	1.08 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> 03:41:47 (6768): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 08:40:42 (3448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:28:16 (5272): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 07:08:44 (47492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:08:45 (47492): No heartbeat from core client for 30 sec - exiting 07:09:59 (57284): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:56:07 (60988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:56:08 (60988): No heartbeat from core client for 30 sec - exiting 22:57:01 (89960): No heartbeat from core client for 30 sec - exiting 22:57:02 (89960): No heartbeat from core client for 30 sec - exiting 22:57:03 (89960): No heartbeat from core client for 30 sec - exiting 22:57:04 (89960): No heartbeat from core client for 30 sec - exiting 22:57:05 (89960): No heartbeat from core client for 30 sec - exiting 22:57:06 (89960): No heartbeat from core client for 30 sec - exiting 22:57:07 (89960): No heartbeat from core client for 30 sec - exiting 22:57:08 (89960): No heartbeat from core client for 30 sec - exiting 22:57:09 (89960): No heartbeat from core client for 30 sec - exiting 22:57:10 (89960): No heartbeat from core client for 30 sec - exiting 22:57:11 (89960): No heartbeat from core client for 30 sec - exiting 22:57:12 (89960): No heartbeat from core client for 30 sec - exiting 22:57:13 (89960): No heartbeat from core client for 30 sec - exiting 22:57:14 (89960): No heartbeat from core client for 30 sec - exiting 22:57:15 (89960): No heartbeat from core client for 30 sec - exiting 22:57:16 (89960): No heartbeat from core client for 30 sec - exiting 22:57:17 (89960): No heartbeat from core client for 30 sec - exiting 22:57:18 (89960): No heartbeat from core client for 30 sec - exiting 22:57:19 (89960): No heartbeat from core client for 30 sec - exiting 22:57:20 (89960): No heartbeat from core client for 30 sec - exiting 22:57:21 (89960): No heartbeat from core client for 30 sec - exiting 22:57:22 (89960): No heartbeat from core client for 30 sec - exiting 22:57:23 (89960): No heartbeat from core client for 30 sec - exiting 22:57:24 (89960): No heartbeat from core client for 30 sec - exiting 22:57:25 (89960): No heartbeat from core client for 30 sec - exiting 22:57:26 (89960): No heartbeat from core client for 30 sec - exiting 22:57:27 (89960): No heartbeat from core client for 30 sec - exiting 22:57:28 (89960): No heartbeat from core client for 30 sec - exiting 22:57:29 (89960): No heartbeat from core client for 30 sec - exiting 22:57:30 (89960): No heartbeat from core client for 30 sec - exiting 22:57:31 (89960): No heartbeat from core client for 30 sec - exiting 22:57:32 (89960): No heartbeat from core client for 30 sec - exiting 22:57:33 (89960): No heartbeat from core client for 30 sec - exiting 22:57:34 (89960): No heartbeat from core client for 30 sec - exiting 22:57:35 (89960): No heartbeat from core client for 30 sec - exiting 22:57:37 (89960): No heartbeat from core client for 30 sec - exiting 22:57:38 (89960): No heartbeat from core client for 30 sec - exiting 22:57:39 (89960): No heartbeat from core client for 30 sec - exiting 22:57:40 (89960): No heartbeat from core client for 30 sec - exiting 22:57:41 (89960): No heartbeat from core client for 30 sec - exiting 22:57:42 (89960): No heartbeat from core client for 30 sec - exiting 22:57:43 (89960): No heartbeat from core client for 30 sec - exiting 22:57:44 (89960): No heartbeat from core client for 30 sec - exiting 22:57:45 (89960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:57:46 (89960): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:31:12 (87428): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:31:13 (87428): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:01:13 (82788): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:01:14 (82788): No heartbeat from core client for 30 sec - exiting 00:02:23 (85828): No heartbeat from core client for 30 sec - exiting 00:02:24 (85828): No heartbeat from core client for 30 sec - exiting 00:02:25 (85828): No heartbeat from core client for 30 sec - exiting 00:02:26 (85828): No heartbeat from core client for 30 sec - exiting 00:02:27 (85828): No heartbeat from core client for 30 sec - exiting 00:02:28 (85828): No heartbeat from core client for 30 sec - exiting 00:02:29 (85828): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
16 Apr 2013 10:10:09	1101937	15724149	hadcm3n_3ie4_1940_40_008259212_3	25,920	122,527	4.7271