Task 14792953

Name	hadcm3n_o3da_2100_40_008000636_0
Workunit	8155750
Created	15 Jun 2012, 21:04:33 UTC
Sent	15 Jun 2012, 21:04:43 UTC
Report deadline	15 Sep 2012, 4:31:54 UTC
Received	24 Jun 2012, 9:50:09 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1221792
Run time	6 days 9 hours 16 min 14 sec
CPU time	5 days 1 hours 43 min 13 sec
Validate state	Invalid
Credit	3,110.40
Device peak FLOPS	2.91 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.25</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:24:39 (5692): No heartbeat from core client for 30 sec - exiting 12:24:40 (5692): No heartbeat from core client for 30 sec - exiting 12:24:41 (5692): No heartbeat from core client for 30 sec - exiting 12:24:42 (5692): No heartbeat from core client for 30 sec - exiting 12:24:43 (5692): No heartbeat from core client for 30 sec - exiting 12:24:44 (5692): No heartbeat from core client for 30 sec - exiting 12:24:45 (5692): No heartbeat from core client for 30 sec - exiting 12:24:46 (5692): No heartbeat from core client for 30 sec - exiting 12:24:47 (5692): No heartbeat from core client for 30 sec - exiting 12:24:48 (5692): No heartbeat from core client for 30 sec - exiting 12:24:49 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:24:50 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:14:10 (8888): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 02:40:05 (8412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:59:47 (2044): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 12:30:09 (8916): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 18:20:07 (1576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 23:27:01 (6324): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 01:16:23 (6668): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3dako.pju4c10 Error converting file to netcdf: dataout/o3dako.piu4c10 Error converting file to netcdf: dataout/o3dako.pfu4c10 Error converting file to netcdf: dataout/o3daka.phu4c10 Error converting file to netcdf: dataout/o3daka.pgu4c10 Error converting file to netcdf: dataout/o3daka.peu4c10 Error converting file to netcdf: dataout/o3daka.pdu4c10 18:03:34 (5736): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error converting file to netcdf: dataout/o3dako.pju4c10 Error converting file to netcdf: dataout/o3dako.piu4c10 Error converting file to netcdf: dataout/o3dako.pfu4c10 Error converting file to netcdf: dataout/o3daka.phu4c10 Error converting file to netcdf: dataout/o3daka.pgu4c10 Error converting file to netcdf: dataout/o3daka.peu4c10 Error converting file to netcdf: dataout/o3daka.pdu4c10 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... 08:46:59 (4524): No heartbeat from core client for 30 sec - exiting 08:47:00 (4524): No heartbeat from core client for 30 sec - exiting 08:47:01 (4524): No heartbeat from core client for 30 sec - exiting 08:47:02 (4524): No heartbeat from core client for 30 sec - exiting 08:47:03 (4524): No heartbeat from core client for 30 sec - exiting 08:47:04 (4524): No heartbeat from core client for 30 sec - exiting 08:47:05 (4524): No heartbeat from core client for 30 sec - exiting 08:47:06 (4524): No heartbeat from core client for 30 sec - exiting 08:47:07 (4524): No heartbeat from core client for 30 sec - exiting 08:47:08 (4524): No heartbeat from core client for 30 sec - exiting 08:47:09 (4524): No heartbeat from core client for 30 sec - exiting 08:47:10 (4524): No heartbeat from core client for 30 sec - exiting 08:47:11 (4524): No heartbeat from core client for 30 sec - exiting 08:47:12 (4524): No heartbeat from core client for 30 sec - exiting 08:47:13 (4524): No heartbeat from core client for 30 sec - exiting 08:47:14 (4524): No heartbeat from core client for 30 sec - exiting 08:47:15 (4524): No heartbeat from core client for 30 sec - exiting 08:47:16 (4524): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:17 (4524): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 11:41:29 (4544): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:23:26 (3616): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:55:31 (4532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Unhandled Exception Detected... - Unhandled Exception Record - Reason: Access Violation (0xc0000005) at address 0x77323F99 read attempt to address 0xFFFFFFF8 Engaging BOINC Windows Runtime Debugger... Cannot serialize file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o3da_2100_40_008000636/dataout/shmem_restart.day Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 Jun 2012 09:50:53	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	259,200	438,185	1.6905
23 Jun 2012 15:56:21	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	233,280	393,016	1.6847
22 Jun 2012 22:36:12	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	207,360	347,599	1.6763
22 Jun 2012 06:48:41	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	181,440	302,219	1.6657
21 Jun 2012 14:12:29	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	155,520	258,403	1.6615
20 Jun 2012 19:46:31	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	129,600	216,461	1.6702
20 Jun 2012 01:10:40	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	103,680	172,382	1.6626
19 Jun 2012 08:25:49	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	77,760	128,497	1.6525
17 Jun 2012 22:31:14	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	51,840	85,299	1.6454
17 Jun 2012 01:23:29	1221792	14792953	hadcm3n_o3da_2100_40_008000636_0	25,920	42,714	1.6479