|
Name | hadcm3n_t0go_1940_40_007614345_0 |
Workunit | 7792475 |
Created | 8 Dec 2011, 0:51:04 UTC |
Sent | 8 Dec 2011, 0:53:20 UTC |
Report deadline | 8 Mar 2012, 8:20:31 UTC |
Received | 5 Jan 2012, 0:08:27 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1158301 |
Run time | 17 days 13 hours 44 min 53 sec |
CPU time | 15 days 14 hours 53 min 28 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 1.86 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.12.33</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 05:40:27 (3539): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x090d9030 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6eb72)[0xf754eb72] /lib32/libc.so.6(+0x6f812)[0xf754f812] /lib32/libc.so.6(cfree+0x6d)[0xf75528cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774fbaf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774fc0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f90f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:11 3415317 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:11 3415317 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09083000-090e9000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7062000-f74dd000 rw-s 00000000 08:11 3437058 /var/lib/boinc-client/slots/3/136395 f74dd000-f74e0000 rw-p 00000000 00:00 0 f74e0000-f7653000 r-xp 00000000 08:11 2493387 /lib32/libc-2.13.so f7653000-f7654000 ---p 00173000 08:11 2493387 /lib32/libc-2.13.so f7654000-f7656000 r--p 00173000 08:11 2493387 /lib32/libc-2.13.so f7656000-f7657000 rw-p 00175000 08:11 2493387 /lib32/libc-2.13.so f7657000-f765a000 rw-p 00000000 00:00 0 f765a000-f7676000 r-xp 00000000 08:11 262171 /usr/lib32/libgcc_s.so.1 f7676000-f7677000 r--p 0001b000 08:11 262171 /usr/lib32/libgcc_s.so.1 f7677000-f7678000 rw-p 0001c000 08:11 262171 /usr/lib32/libgcc_s.so.1 f7678000-f76a0000 r-xp 00000000 08:11 2493397 /lib32/libm-2.13.so f76a0000-f76a1000 r--p 00028000 08:11 2493397 /lib32/libm-2.13.so f76a1000-f76a2000 rw-p 00029000 08:11 2493397 /lib32/libm-2.13.so f76a2000-f7780000 r-xp 00000000 08:11 264433 /usr/lib32/libstdc++.so.6.0.16 f7780000-f7781000 ---p 000de000 08:11 264433 /usr/lib32/libstdc++.so.6.0.16 f7781000-f7785000 r--p 000de000 08:11 264433 /usr/lib32/libstdc++.so.6.0.16 f7785000-f7786000 rw-p 000e2000 08:11 264433 /usr/lib32/libstdc++.so.6.0.16 f7786000-f778e000 rw-p 00000000 00:00 0 f778e000-f7791000 r-xp 00000000 08:11 2493388 /lib32/libdl-2.13.so f7791000-f7792000 r--p 00002000 08:11 2493388 /lib32/libdl-2.13.so f7792000-f7793000 rw-p 00003000 08:11 2493388 /lib32/libdl-2.13.so f7793000-f77aa000 r-xp 00000000 08:11 2493395 /lib32/libpthread-2.13.so f77aa000-f77ab000 r--p 00016000 08:11 2493395 /lib32/libpthread-2.13.so f77ab000-f77ac000 rw-p 00017000 08:11 2493395 /lib32/libpthread-2.13.so f77ac000-f77ae000 rw-p 00000000 00:00 0 f77cc000-f77cd000 rw-p 00000000 00:00 0 f77cd000-f77ce000 ---p 00000000 00:00 0 f77ce000-f77d1000 rw-p 00000000 00:00 0 f77d1000-f77d3000 rw-s 00000000 08:11 3436958 /var/lib/boinc-client/slots/3/boinc_mmap_file f77d3000-f77d5000 rw-p 00000000 00:00 0 f77d5000-f77d6000 r-xp 00000000 00:00 0 [vdso] f77d6000-f77f4000 r-xp 00000000 08:11 1703965 /lib/i386-linux-gnu/ld-2.13.so f77f4000-f77f5000 r--p 0001d000 08:11 1703965 /lib/i386-linux-gnu/ld-2.13.so f77f5000-f77f6000 rw-p 0001e000 08:11 1703965 /lib/i386-linux-gnu/ld-2.13.so ffc1a000-ffc8a000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77d5400] [0xf77d5425] /lib32/libc.so.6(gsignal+0x4f)[0xf750dc4f] /lib32/libc.so.6(abort+0x175)[0xf7511175] /lib32/libc.so.6(+0x63e8c)[0xf7543e8c] /lib32/libc.so.6(+0x6eb72)[0xf754eb72] /lib32/libc.so.6(+0x6f812)[0xf754f812] /lib32/libc.so.6(cfree+0x6d)[0xf75528cd] /usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf774fbaf] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1b)[0xf774fc0b] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xf3)[0xf74f90f3] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
05 Jan 2012 00:12:16 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 518,400 | 1,349,601 | 2.6034 |
04 Jan 2012 01:09:13 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 492,480 | 1,276,972 | 2.5929 |
02 Jan 2012 15:21:22 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 466,560 | 1,209,562 | 2.5925 |
31 Dec 2011 23:30:15 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 440,640 | 1,141,754 | 2.5911 |
30 Dec 2011 07:19:37 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 414,720 | 1,073,894 | 2.5894 |
28 Dec 2011 16:36:37 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 388,800 | 1,006,096 | 2.5877 |
27 Dec 2011 03:11:12 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 362,880 | 937,760 | 2.5842 |
25 Dec 2011 11:59:35 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 336,960 | 869,868 | 2.5815 |
23 Dec 2011 13:07:13 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 311,040 | 805,343 | 2.5892 |
21 Dec 2011 11:58:41 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 285,120 | 740,681 | 2.5978 |
19 Dec 2011 20:09:09 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 259,200 | 674,428 | 2.6020 |
18 Dec 2011 20:59:40 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 233,280 | 605,608 | 2.5961 |
17 Dec 2011 14:30:10 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 207,360 | 538,285 | 2.5959 |
15 Dec 2011 23:14:00 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 181,440 | 470,687 | 2.5942 |
14 Dec 2011 12:33:53 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 155,520 | 404,068 | 2.5982 |
13 Dec 2011 02:28:46 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 129,600 | 336,884 | 2.5994 |
11 Dec 2011 15:53:35 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 103,680 | 268,736 | 2.5920 |
10 Dec 2011 11:56:45 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 77,760 | 202,155 | 2.5997 |
09 Dec 2011 16:04:23 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 51,840 | 134,907 | 2.6024 |
08 Dec 2011 20:24:15 | 1158301 | 13748943 | hadcm3n_t0go_1940_40_007614345_0 | 25,920 | 67,610 | 2.6084 |
©2024 climateprediction.net