 |
|
| Name | hadcm3n_49jv_2020_40_008365543_0 |
| Workunit | 8516402 |
| Created | 11 May 2013, 1:24:59 UTC |
| Sent | 11 May 2013, 1:25:59 UTC |
| Report deadline | 10 Aug 2013, 8:53:10 UTC |
| Received | 30 May 2013, 14:46:56 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1179592 |
| Run time | 19 days 8 hours 12 min 39 sec |
| CPU time | 18 days 4 hours 15 min 25 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 1.77 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 20:08:12 (27627): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:16:26 (29954): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:39:57 (30835): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:13:32 (33297): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:01 (33297): No heartbeat from core client for 30 sec - exiting 22:14:02 (33297): No heartbeat from core client for 30 sec - exiting 22:14:03 (33297): No heartbeat from core client for 30 sec - exiting 22:14:04 (33297): No heartbeat from core client for 30 sec - exiting 22:14:05 (33297): No heartbeat from core client for 30 sec - exiting 22:14:06 (33297): No heartbeat from core client for 30 sec - exiting 22:14:07 (33297): No heartbeat from core client for 30 sec - exiting 23:00:24 (38205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:38 (38457): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:27 (38759): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:15 (39013): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:27 (39264): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:18 (39623): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:56 (39879): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:29 (40358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:43 (40572): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:47 (40810): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:46 (41204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:38 (41674): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:35 (41904): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:53 (42262): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:18:20 (42537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:47 (43140): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:25 (43341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:30 (43577): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:26 (43789): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:05 (44006): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:26 (44238): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:46 (44671): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:22 (44875): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:01 (45112): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:42 (45364): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:44 (45634): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:05 (45944): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:46 (46177): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:16 (46447): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:48 (46652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:16:29 (47700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:21 (2650): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:16:55 (3378): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:38 (6301): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:43 (6629): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:29 (6897): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:38 (7259): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:51 (7468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:35 (7698): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:15 (8235): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:27 (8468): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:26 (8671): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:22 (8872): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:05 (9073): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:02 (9302): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:53 (9536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:29 (9769): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:26 (9971): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:28 (10204): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:48 (10500): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:08 (10740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:32 (11028): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:33 (11028): No heartbeat from core client for 30 sec - exiting 08:47:34 (11028): No heartbeat from core client for 30 sec - exiting 08:47:35 (11028): No heartbeat from core client for 30 sec - exiting 09:47:12 (11243): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:58 (11459): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:35 (11689): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:23 (11895): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:17 (12131): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:27 (12409): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:37 (12409): No heartbeat from core client for 30 sec - exiting 15:52:38 (12409): No heartbeat from core client for 30 sec - exiting 15:52:39 (12409): No heartbeat from core client for 30 sec - exiting 15:52:40 (12409): No heartbeat from core client for 30 sec - exiting 15:52:41 (12409): No heartbeat from core client for 30 sec - exiting 15:52:42 (12409): No heartbeat from core client for 30 sec - exiting 15:52:43 (12409): No heartbeat from core client for 30 sec - exiting 15:52:44 (12409): No heartbeat from core client for 30 sec - exiting 15:52:45 (12409): No heartbeat from core client for 30 sec - exiting 15:52:46 (12409): No heartbeat from core client for 30 sec - exiting 15:52:47 (12409): No heartbeat from core client for 30 sec - exiting 15:52:48 (12409): No heartbeat from core client for 30 sec - exiting 15:52:49 (12409): No heartbeat from core client for 30 sec - exiting 15:52:50 (12409): No heartbeat from core client for 30 sec - exiting 15:52:51 (12409): No heartbeat from core client for 30 sec - exiting 17:55:58 (12678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:13 (12947): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:33 (13194): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:23 (13448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:11 (13653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:34 (14019): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:25:41 (14223): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:43 (14484): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:48:44 (14484): No heartbeat from core client for 30 sec - exiting 13:39:23 (14878): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:51:34 (15171): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09bd99e8 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bff1)[0xf7575ff1] /lib32/libc.so.6(+0x6d880)[0xf7577880] /lib32/libc.so.6(cfree+0x6d)[0xf757a92d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77517b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf775180d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7520ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:02 3514599 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:02 3514599 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09b84000-09be9000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f708c000-f7507000 rw-s 00000000 08:02 6357105 /var/lib/boinc-client/slots/39/134550 f7507000-f750a000 rw-p 00000000 00:00 0 f750a000-f765e000 r-xp 00000000 08:02 9879703 /lib32/libc-2.12.1.so f765e000-f765f000 ---p 00154000 08:02 9879703 /lib32/libc-2.12.1.so f765f000-f7661000 r--p 00154000 08:02 9879703 /lib32/libc-2.12.1.so f7661000-f7662000 rw-p 00156000 08:02 9879703 /lib32/libc-2.12.1.so f7662000-f7665000 rw-p 00000000 00:00 0 f7665000-f767f000 r-xp 00000000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f767f000-f7680000 r--p 00019000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f7680000-f7681000 rw-p 0001a000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f7681000-f76a5000 r-xp 00000000 08:02 9879707 /lib32/libm-2.12.1.so f76a5000-f76a6000 r--p 00023000 08:02 9879707 /lib32/libm-2.12.1.so f76a6000-f76a7000 rw-p 00024000 08:02 9879707 /lib32/libm-2.12.1.so f76a7000-f7786000 r-xp 00000000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f7786000-f778a000 r--p 000de000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f778a000-f778b000 rw-p 000e2000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f778b000-f7792000 rw-p 00000000 00:00 0 f7792000-f7794000 r-xp 00000000 08:02 9879706 /lib32/libdl-2.12.1.so f7794000-f7795000 r--p 00001000 08:02 9879706 /lib32/libdl-2.12.1.so f7795000-f7796000 rw-p 00002000 08:02 9879706 /lib32/libdl-2.12.1.so f7796000-f7797000 rw-p 00000000 00:00 0 f7797000-f77ac000 r-xp 00000000 08:02 9879717 /lib32/libpthread-2.12.1.so f77ac000-f77ad000 r--p 00014000 08:02 9879717 /lib32/libpthread-2.12.1.so f77ad000-f77ae000 rw-p 00015000 08:02 9879717 /lib32/libpthread-2.12.1.so f77ae000-f77b0000 rw-p 00000000 00:00 0 f77c1000-f77c2000 rw-p 00000000 00:00 0 f77c2000-f77c3000 ---p 00000000 00:00 0 f77c3000-f77c6000 rw-p 00000000 00:00 0 f77c6000-f77c8000 rw-s 00000000 08:02 6357014 /var/lib/boinc-client/slots/39/boinc_mmap_file f77c8000-f77ca000 rw-p 00000000 00:00 0 f77ca000-f77cb000 r-xp 00000000 00:00 0 [vdso] f77cb000-f77e7000 r-xp 00000000 08:02 9879700 /lib32/ld-2.12.1.so f77e7000-f77e8000 r--p 0001b000 08:02 9879700 /lib32/ld-2.12.1.so f77e8000-f77e9000 rw-p 0001c000 08:02 9879700 /lib32/ld-2.12.1.so ffc3b000-ffcab000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77ca400] [0xf77ca425] /lib32/libc.so.6(gsignal+0x51)[0xf7534a01] /lib32/libc.so.6(abort+0x182)[0xf7537e42] /lib32/libc.so.6(+0x61f15)[0xf756bf15] /lib32/libc.so.6(+0x6bff1)[0xf7575ff1] /lib32/libc.so.6(+0x6d880)[0xf7577880] /lib32/libc.so.6(cfree+0x6d)[0xf757a92d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77517b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf775180d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf7520ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 30 May 2013 14:48:00 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 518,400 | 1,570,498 | 3.0295 |
| 29 May 2013 18:56:08 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 492,480 | 1,499,107 | 3.0440 |
| 28 May 2013 17:57:35 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 466,560 | 1,415,929 | 3.0348 |
| 27 May 2013 19:16:19 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 440,640 | 1,333,462 | 3.0262 |
| 26 May 2013 21:59:48 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 414,720 | 1,258,891 | 3.0355 |
| 26 May 2013 00:42:48 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 388,800 | 1,184,373 | 3.0462 |
| 25 May 2013 04:45:50 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 362,880 | 1,111,430 | 3.0628 |
| 24 May 2013 08:22:46 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 336,960 | 1,037,346 | 3.0785 |
| 23 May 2013 12:04:12 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 311,040 | 965,481 | 3.1040 |
| 22 May 2013 17:55:02 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 285,120 | 902,599 | 3.1657 |
| 21 May 2013 21:38:33 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 259,200 | 827,461 | 3.1924 |
| 20 May 2013 20:17:00 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 233,280 | 740,578 | 3.1746 |
| 19 May 2013 21:56:32 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 207,360 | 665,004 | 3.2070 |
| 19 May 2013 01:04:24 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 181,440 | 589,919 | 3.2513 |
| 18 May 2013 04:37:00 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 155,520 | 515,984 | 3.3178 |
| 17 May 2013 07:44:55 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 129,600 | 441,085 | 3.4034 |
| 16 May 2013 04:00:32 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 103,680 | 343,377 | 3.3119 |
| 14 May 2013 16:16:39 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 77,760 | 214,712 | 2.7612 |
| 13 May 2013 19:09:42 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 51,840 | 137,906 | 2.6602 |
| 12 May 2013 23:44:09 | 1179592 | 15775472 | hadcm3n_49jv_2020_40_008365543_0 | 25,920 | 68,027 | 2.6245 |
©2024 cpdn.org