Name | hadcm3n_zc57_1880_40_008253908_3 |
Workunit | 8409032 |
Created | 27 Dec 2012, 14:33:55 UTC |
Sent | 27 Dec 2012, 16:04:54 UTC |
Report deadline | 28 Mar 2013, 23:32:05 UTC |
Received | 10 Mar 2013, 15:37:32 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1260329 |
Run time | 20 days 15 hours 48 min 42 sec |
CPU time | 19 days 21 hours 58 min 4 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 1.47 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:20:17 (1366): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:26:39 (5857): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:29:53 (5867): No heartbeat from core client for 30 sec - exiting 19:29:56 (5867): No heartbeat from core client for 30 sec - exiting 19:29:57 (5867): No heartbeat from core client for 30 sec - exiting 19:29:58 (5867): No heartbeat from core client for 30 sec - exiting 19:29:59 (5867): No heartbeat from core client for 30 sec - exiting 19:30:00 (5867): No heartbeat from core client for 30 sec - exiting 19:30:01 (5867): No heartbeat from core client for 30 sec - exiting 19:30:02 (5867): No heartbeat from core client for 30 sec - exiting 19:30:33 (5867): No heartbeat from core client for 30 sec - exiting 19:30:48 (5867): No heartbeat from core client for 30 sec - exiting 19:30:49 (5867): No heartbeat from core client for 30 sec - exiting 19:30:50 (5867): No heartbeat from core client for 30 sec - exiting 19:30:51 (5867): No heartbeat from core client for 30 sec - exiting 19:30:52 (5867): No heartbeat from core client for 30 sec - exiting 19:30:53 (5867): No heartbeat from core client for 30 sec - exiting 19:30:54 (5867): No heartbeat from core client for 30 sec - exiting 19:30:55 (5867): No heartbeat from core client for 30 sec - exiting 19:30:56 (5867): No heartbeat from core client for 30 sec - exiting 19:30:57 (5867): No heartbeat from core client for 30 sec - exiting 19:30:58 (5867): No heartbeat from core client for 30 sec - exiting 19:30:59 (5867): No heartbeat from core client for 30 sec - exiting 19:31:00 (5867): No heartbeat from core client for 30 sec - exiting 19:31:01 (5867): No heartbeat from core client for 30 sec - exiting 19:31:02 (5867): No heartbeat from core client for 30 sec - exiting 19:31:03 (5867): No heartbeat from core client for 30 sec - exiting 19:31:04 (5867): No heartbeat from core client for 30 sec - exiting 19:31:05 (5867): No heartbeat from core client for 30 sec - exiting 19:31:09 (5867): No heartbeat from core client for 30 sec - exiting 19:31:10 (5867): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:34:06 (5877): No heartbeat from core client for 30 sec - exiting 19:34:08 (5877): No heartbeat from core client for 30 sec - exiting 19:34:09 (5877): No heartbeat from core client for 30 sec - exiting 19:34:10 (5877): No heartbeat from core client for 30 sec - exiting 19:34:11 (5877): No heartbeat from core client for 30 sec - exiting 19:34:12 (5877): No heartbeat from core client for 30 sec - exiting 19:34:13 (5877): No heartbeat from core client for 30 sec - exiting 19:34:14 (5877): No heartbeat from core client for 30 sec - exiting 19:34:15 (5877): No heartbeat from core client for 30 sec - exiting 19:34:16 (5877): No heartbeat from core client for 30 sec - exiting 19:34:17 (5877): No heartbeat from core client for 30 sec - exiting 19:34:18 (5877): No heartbeat from core client for 30 sec - exiting 19:34:19 (5877): No heartbeat from core client for 30 sec - exiting 19:34:20 (5877): No heartbeat from core client for 30 sec - exiting 19:34:21 (5877): No heartbeat from core client for 30 sec - exiting 19:34:22 (5877): No heartbeat from core client for 30 sec - exiting 19:34:23 (5877): No heartbeat from core client for 30 sec - exiting 19:34:24 (5877): No heartbeat from core client for 30 sec - exiting 19:34:25 (5877): No heartbeat from core client for 30 sec - exiting 19:34:26 (5877): No heartbeat from core client for 30 sec - exiting 19:34:27 (5877): No heartbeat from core client for 30 sec - exiting 19:34:28 (5877): No heartbeat from core client for 30 sec - exiting 19:34:29 (5877): No heartbeat from core client for 30 sec - exiting 19:34:30 (5877): No heartbeat from core client for 30 sec - exiting 19:34:36 (5877): No heartbeat from core client for 30 sec - exiting 19:34:37 (5877): No heartbeat from core client for 30 sec - exiting 19:34:38 (5877): No heartbeat from core client for 30 sec - exiting 19:34:39 (5877): No heartbeat from core client for 30 sec - exiting 19:34:40 (5877): No heartbeat from core client for 30 sec - exiting 19:34:41 (5877): No heartbeat from core client for 30 sec - exiting 19:34:42 (5877): No heartbeat from core client for 30 sec - exiting 19:34:43 (5877): No heartbeat from core client for 30 sec - exiting 19:34:44 (5877): No heartbeat from core client for 30 sec - exiting 19:34:45 (5877): No heartbeat from core client for 30 sec - exiting 19:34:46 (5877): No heartbeat from core client for 30 sec - exiting 19:34:47 (5877): No heartbeat from core client for 30 sec - exiting 19:34:48 (5877): No heartbeat from core client for 30 sec - exiting 19:34:49 (5877): No heartbeat from core client for 30 sec - exiting 19:34:50 (5877): No heartbeat from core client for 30 sec - exiting 19:34:51 (5877): No heartbeat from core client for 30 sec - exiting 19:34:52 (5877): No heartbeat from core client for 30 sec - exiting 19:34:53 (5877): No heartbeat from core client for 30 sec - exiting 19:34:54 (5877): No heartbeat from core client for 30 sec - exiting 19:34:55 (5877): No heartbeat from core client for 30 sec - exiting 19:34:56 (5877): No heartbeat from core client for 30 sec - exiting 19:34:57 (5877): No heartbeat from core client for 30 sec - exiting 19:34:58 (5877): No heartbeat from core client for 30 sec - exiting 19:34:59 (5877): No heartbeat from core client for 30 sec - exiting 19:35:00 (5877): No heartbeat from core client for 30 sec - exiting 19:35:01 (5877): No heartbeat from core client for 30 sec - exiting 19:35:02 (5877): No heartbeat from core client for 30 sec - exiting 19:35:03 (5877): No heartbeat from core client for 30 sec - exiting 19:35:04 (5877): No heartbeat from core client for 30 sec - exiting 19:35:05 (5877): No heartbeat from core client for 30 sec - exiting 19:35:06 (5877): No heartbeat from core client for 30 sec - exiting 19:35:07 (5877): No heartbeat from core client for 30 sec - exiting 19:35:08 (5877): No heartbeat from core client for 30 sec - exiting 19:35:09 (5877): No heartbeat from core client for 30 sec - exiting 19:35:10 (5877): No heartbeat from core client for 30 sec - exiting 19:35:11 (5877): No heartbeat from core client for 30 sec - exiting 19:35:12 (5877): No heartbeat from core client for 30 sec - exiting 19:35:13 (5877): No heartbeat from core client for 30 sec - exiting 19:35:14 (5877): No heartbeat from core client for 30 sec - exiting 19:35:35 (5877): No heartbeat from core client for 30 sec - exiting 19:35:38 (5877): No heartbeat from core client for 30 sec - exiting 19:35:39 (5877): No heartbeat from core client for 30 sec - exiting 19:35:40 (5877): No heartbeat from core client for 30 sec - exiting 19:35:41 (5877): No heartbeat from core client for 30 sec - exiting 19:35:42 (5877): No heartbeat from core client for 30 sec - exiting 19:35:43 (5877): No heartbeat from core client for 30 sec - exiting 19:35:44 (5877): No heartbeat from core client for 30 sec - exiting 19:35:45 (5877): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:35:46 (5877): No heartbeat from core client for 30 sec - exiting 19:39:08 (5907): No heartbeat from core client for 30 sec - exiting 19:39:11 (5907): No heartbeat from core client for 30 sec - exiting 19:39:12 (5907): No heartbeat from core client for 30 sec - exiting 19:39:13 (5907): No heartbeat from core client for 30 sec - exiting 19:39:14 (5907): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09c67e50 *** ======= Backtrace: ========= /lib/i686/cmov/libc.so.6(+0x6af71)[0xb7526f71] /lib/i686/cmov/libc.so.6(+0x6c7c8)[0xb75287c8] /lib/i686/cmov/libc.so.6(cfree+0x6d)[0xb752b8ad] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7702701] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb770275d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb74d2ca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fe:01 426082 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fe:01 426082 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09c12000-09c77000 rw-p 00000000 00:00 0 [heap] b6f00000-b6f21000 rw-p 00000000 00:00 0 b6f21000-b7000000 ---p 00000000 00:00 0 b703f000-b74ba000 rw-s 00000000 fe:01 516640 /var/lib/boinc-client/slots/2/134270 b74ba000-b74bc000 rw-p 00000000 00:00 0 b74bc000-b75fc000 r-xp 00000000 fe:01 11862562 /lib/i686/cmov/libc-2.11.3.so b75fc000-b75fd000 ---p 00140000 fe:01 11862562 /lib/i686/cmov/libc-2.11.3.so b75fd000-b75ff000 r--p 00140000 fe:01 11862562 /lib/i686/cmov/libc-2.11.3.so b75ff000-b7600000 rw-p 00142000 fe:01 11862562 /lib/i686/cmov/libc-2.11.3.so b7600000-b7603000 rw-p 00000000 00:00 0 b7603000-b7620000 r-xp 00000000 fe:01 11845635 /lib/libgcc_s.so.1 b7620000-b7621000 rw-p 0001c000 fe:01 11845635 /lib/libgcc_s.so.1 b7621000-b7645000 r-xp 00000000 fe:01 11862544 /lib/i686/cmov/libm-2.11.3.so b7645000-b7646000 r--p 00023000 fe:01 11862544 /lib/i686/cmov/libm-2.11.3.so b7646000-b7647000 rw-p 00024000 fe:01 11862544 /lib/i686/cmov/libm-2.11.3.so b7647000-b7730000 r-xp 00000000 fe:01 4647185 /usr/lib/libstdc++.so.6.0.13 b7730000-b7734000 r--p 000e9000 fe:01 4647185 /usr/lib/libstdc++.so.6.0.13 b7734000-b7735000 rw-p 000ed000 fe:01 4647185 /usr/lib/libstdc++.so.6.0.13 b7735000-b773d000 rw-p 00000000 00:00 0 b773d000-b773f000 r-xp 00000000 fe:01 11862543 /lib/i686/cmov/libdl-2.11.3.so b773f000-b7740000 r--p 00001000 fe:01 11862543 /lib/i686/cmov/libdl-2.11.3.so b7740000-b7741000 rw-p 00002000 fe:01 11862543 /lib/i686/cmov/libdl-2.11.3.so b7741000-b7756000 r-xp 00000000 fe:01 11862552 /lib/i686/cmov/libpthread-2.11.3.so b7756000-b7757000 r--p 00014000 fe:01 11862552 /lib/i686/cmov/libpthread-2.11.3.so b7757000-b7758000 rw-p 00015000 fe:01 11862552 /lib/i686/cmov/libpthread-2.11.3.so b7758000-b775a000 rw-p 00000000 00:00 0 b7763000-b7764000 rw-p 00000000 00:00 0 b7764000-b7765000 ---p 00000000 00:00 0 b7765000-b7768000 rw-p 00000000 00:00 0 b7768000-b776a000 rw-s 00000000 fe:01 516549 /var/lib/boinc-client/slots/2/boinc_mmap_file b776a000-b776c000 rw-p 00000000 00:00 0 b776c000-b776d000 r-xp 00000000 00:00 0 [vdso] b776d000-b7788000 r-xp 00000000 fe:01 11845648 /lib/ld-2.11.3.so b7788000-b7789000 r--p 0001b000 fe:01 11845648 /lib/ld-2.11.3.so b7789000-b778a000 rw-p 0001c000 fe:01 11845648 /lib/ld-2.11.3.so bfa5a000-bfac9000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xb776c400] [0xb776c424] /lib/i686/cmov/libc.so.6(gsignal+0x51)[0xb74e6781] /lib/i686/cmov/libc.so.6(abort+0x182)[0xb74e9bb2] /lib/i686/cmov/libc.so.6(+0x60e75)[0xb751ce75] /lib/i686/cmov/libc.so.6(+0x6af71)[0xb7526f71] /lib/i686/cmov/libc.so.6(+0x6c7c8)[0xb75287c8] /lib/i686/cmov/libc.so.6(cfree+0x6d)[0xb752b8ad] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7702701] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb770275d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i686/cmov/libc.so.6(__libc_start_main+0xe6)[0xb74d2ca6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 Mar 2013 15:40:28 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 777,600 | 1,720,678 | 2.2128 |
09 Mar 2013 00:05:05 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 751,680 | 1,665,006 | 2.2150 |
08 Mar 2013 08:41:25 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 725,760 | 1,609,444 | 2.2176 |
07 Mar 2013 17:11:02 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 699,840 | 1,553,904 | 2.2204 |
28 Feb 2013 20:02:20 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 673,920 | 1,498,390 | 2.2234 |
27 Feb 2013 14:45:29 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 648,000 | 1,442,557 | 2.2262 |
24 Feb 2013 16:26:36 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 622,080 | 1,386,769 | 2.2292 |
23 Feb 2013 12:12:51 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 596,160 | 1,330,841 | 2.2324 |
21 Feb 2013 21:13:39 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 570,240 | 1,275,324 | 2.2365 |
20 Feb 2013 15:55:41 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 544,320 | 1,219,879 | 2.2411 |
18 Feb 2013 15:40:40 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 518,400 | 1,164,441 | 2.2462 |
17 Feb 2013 09:07:01 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 492,480 | 1,108,950 | 2.2518 |
16 Feb 2013 16:50:57 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 466,560 | 1,050,946 | 2.2525 |
16 Feb 2013 00:22:08 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 440,640 | 992,685 | 2.2528 |
15 Feb 2013 07:41:56 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 414,720 | 934,597 | 2.2536 |
14 Feb 2013 13:25:14 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 388,800 | 875,695 | 2.2523 |
12 Feb 2013 11:05:08 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 362,880 | 817,967 | 2.2541 |
10 Feb 2013 18:35:42 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 336,960 | 759,536 | 2.2541 |
09 Feb 2013 12:27:43 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 311,040 | 701,032 | 2.2538 |
07 Feb 2013 16:46:58 | 1260329 | 15513883 | hadcm3n_zc57_1880_40_008253908_3 | 285,120 | 642,420 | 2.2532 |
©2024 cpdn.org