Name | hadcm3n_xd5z_1940_40_009153357_0 |
Workunit | 9283693 |
Created | 6 Nov 2014, 15:56:11 UTC |
Sent | 6 Nov 2014, 16:50:08 UTC |
Report deadline | 6 Feb 2015, 0:17:19 UTC |
Received | 19 Nov 2014, 20:12:57 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1170811 |
Run time | 10 days 3 hours 57 min 34 sec |
CPU time | 9 days 9 hours 49 min 39 sec |
Validate state | Invalid |
Credit | 7,153.92 |
Device peak FLOPS | 3.37 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.4.26</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> 16:29:20 (3539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:43:44 (17900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:48:50 (21589): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:49:03 (57306): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:02:50 (77885): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:14:34 (88502): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:58:50 (98856): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:35:55 (9742): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:29:04 (17600): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:33:42 (21658): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:26:47 (64064): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:28:05 (16266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:56 (19681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:15:52 (23799): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:17:19 (34878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:33:19 (41710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:25 (45823): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:53:26 (45823): No heartbeat from core client for 30 sec - exiting 18:19:19 (60181): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:23:43 (63883): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:50:14 (67803): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:52:02 (71383): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:32:48 (78686): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:03:24 (89855): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:42:01 (96900): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:50:11 (719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:07:11 (68304): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x181e404: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x181e400: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(2487,0xa0cb71d4) malloc: *** error for object 0x280dc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:16:09 (2487): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:06:03 (97440): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:26:38 (978): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 09:29:12 (713): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:40:42 (5310): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:37:15 (8838): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:05:47 (19824): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:15:19 (23555): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:12:54 (27062): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:43:38 (32287): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:45:55 (40388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:47:31 (43791): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:23:39 (47189): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:10:48 (51030): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:13:16 (55634): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:17 (59037): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:12:36 (62710): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:54:15 (67169): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:20:18 (71054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:45:21 (75512): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:45:06 (81053): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 16:56:01 (85167): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:51:04 (88685): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:55:32 (94137): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:04:08 (98136): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:00:29 (2699): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:26:03 (7435): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:16:36 (11051): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:32:52 (14849): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:31:24 (18767): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:43:35 (23226): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:21 (26678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:08:35 (32593): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 12:12:18 (36286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
19 Nov 2014 17:51:26 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 596,160 | 813,578 | 1.3647 |
19 Nov 2014 06:20:37 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 570,240 | 778,345 | 1.3649 |
18 Nov 2014 17:02:50 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 544,320 | 744,122 | 1.3671 |
17 Nov 2014 23:05:31 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 518,400 | 709,078 | 1.3678 |
17 Nov 2014 12:13:06 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 492,480 | 674,744 | 1.3701 |
17 Nov 2014 01:24:53 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 466,560 | 641,713 | 1.3754 |
16 Nov 2014 14:36:48 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 440,640 | 609,805 | 1.3839 |
15 Nov 2014 03:53:48 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 414,720 | 577,980 | 1.3937 |
14 Nov 2014 18:13:07 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 388,800 | 546,006 | 1.4043 |
14 Nov 2014 07:18:26 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 362,880 | 513,982 | 1.4164 |
13 Nov 2014 21:48:19 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 336,960 | 482,207 | 1.4311 |
13 Nov 2014 10:38:26 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 311,040 | 450,034 | 1.4469 |
12 Nov 2014 18:53:23 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 285,120 | 417,955 | 1.4659 |
11 Nov 2014 15:26:20 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 259,200 | 386,093 | 1.4896 |
11 Nov 2014 05:51:49 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 233,280 | 354,228 | 1.5185 |
10 Nov 2014 16:16:52 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 207,360 | 320,978 | 1.5479 |
10 Nov 2014 04:32:42 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 181,440 | 281,509 | 1.5515 |
09 Nov 2014 17:13:59 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 155,520 | 242,748 | 1.5609 |
09 Nov 2014 05:50:34 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 129,600 | 203,579 | 1.5708 |
08 Nov 2014 16:38:40 | 1170811 | 17358009 | hadcm3n_xd5z_1940_40_009153357_0 | 103,680 | 160,001 | 1.5432 |
©2024 cpdn.org