climateprediction.net home page
Task 16021658

Task 16021658

Name hadcm3n_n0x0_1920_40_008404083_3
Workunit 8554939
Created 17 Sep 2013, 20:33:25 UTC
Sent 17 Sep 2013, 20:54:54 UTC
Report deadline 18 Dec 2013, 4:22:05 UTC
Received 6 Nov 2013, 23:18:40 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1286585
Run time 10 days 5 hours 12 min 18 sec
CPU time 10 days 2 hours 18 min 55 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 2.41 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
05:29:46 (3463): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:29:49 (3463): No heartbeat from core client for 30 sec - exiting
05:32:43 (14359): No heartbeat from core client for 30 sec - exiting
05:32:45 (14359): No heartbeat from core client for 30 sec - exiting
05:32:46 (14359): No heartbeat from core client for 30 sec - exiting
05:32:47 (14359): No heartbeat from core client for 30 sec - exiting
05:32:48 (14359): No heartbeat from core client for 30 sec - exiting
05:32:49 (14359): No heartbeat from core client for 30 sec - exiting
05:32:50 (14359): No heartbeat from core client for 30 sec - exiting
05:32:51 (14359): No heartbeat from core client for 30 sec - exiting
05:32:52 (14359): No heartbeat from core client for 30 sec - exiting
05:32:53 (14359): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:38:32 (14405): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:20:47 (14479): No heartbeat from core client for 30 sec - exiting
09:21:23 (14479): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:21:24 (14479): No heartbeat from core client for 30 sec - exiting
09:21:25 (14479): No heartbeat from core client for 30 sec - exiting
09:21:26 (14479): No heartbeat from core client for 30 sec - exiting
09:21:27 (14479): No heartbeat from core client for 30 sec - exiting
09:21:29 (14479): No heartbeat from core client for 30 sec - exiting
09:21:30 (14479): No heartbeat from core client for 30 sec - exiting
09:21:31 (14479): No heartbeat from core client for 30 sec - exiting
09:21:32 (14479): No heartbeat from core client for 30 sec - exiting
09:21:34 (14479): No heartbeat from core client for 30 sec - exiting
09:21:35 (14479): No heartbeat from core client for 30 sec - exiting
09:21:36 (14479): No heartbeat from core client for 30 sec - exiting
09:21:40 (14479): No heartbeat from core client for 30 sec - exiting
09:21:41 (14479): No heartbeat from core client for 30 sec - exiting
09:21:42 (14479): No heartbeat from core client for 30 sec - exiting
09:21:43 (14479): No heartbeat from core client for 30 sec - exiting
09:21:44 (14479): No heartbeat from core client for 30 sec - exiting
09:21:45 (14479): No heartbeat from core client for 30 sec - exiting
09:21:47 (14479): No heartbeat from core client for 30 sec - exiting
09:21:48 (14479): No heartbeat from core client for 30 sec - exiting
09:21:49 (14479): No heartbeat from core client for 30 sec - exiting
09:21:50 (14479): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
10:40:58 (17590): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:41:04 (17590): No heartbeat from core client for 30 sec - exiting
10:41:05 (17590): No heartbeat from core client for 30 sec - exiting
10:41:06 (17590): No heartbeat from core client for 30 sec - exiting
10:41:07 (17590): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
17:41:32 (7538): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
16:49:37 (14266): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x086c7d18 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d49ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c2a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c2aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bf6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:06 1442361                            /home/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:06 1442361                            /home/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08672000-086d7000 rw-p 00000000 00:00 0                                  [heap]
f6e00000-f6e21000 rw-p 00000000 00:00 0 
f6e21000-f6f00000 ---p 00000000 00:00 0 
f6fe4000-f745f000 rw-s 00000000 08:06 1442399                            /home/boinc-client/slots/2/133005
f745f000-f7461000 rw-p 00000000 00:00 0 
f7461000-f75bb000 r-xp 00000000 08:01 3418632                            /lib32/libc-2.11.1.so
f75bb000-f75bc000 ---p 0015a000 08:01 3418632                            /lib32/libc-2.11.1.so
f75bc000-f75be000 r--p 0015a000 08:01 3418632                            /lib32/libc-2.11.1.so
f75be000-f75bf000 rw-p 0015c000 08:01 3418632                            /lib32/libc-2.11.1.so
f75bf000-f75c2000 rw-p 00000000 00:00 0 
f75c2000-f75df000 r-xp 00000000 08:01 2226944                            /usr/lib32/libgcc_s.so.1
f75df000-f75e0000 r--p 0001c000 08:01 2226944                            /usr/lib32/libgcc_s.so.1
f75e0000-f75e1000 rw-p 0001d000 08:01 2226944                            /usr/lib32/libgcc_s.so.1
f75e1000-f7605000 r-xp 00000000 08:01 3418637                            /lib32/libm-2.11.1.so
f7605000-f7606000 r--p 00023000 08:01 3418637                            /lib32/libm-2.11.1.so
f7606000-f7607000 rw-p 00024000 08:01 3418637                            /lib32/libm-2.11.1.so
f7607000-f76f0000 r-xp 00000000 08:01 2226951                            /usr/lib32/libstdc++.so.6.0.13
f76f0000-f76f4000 r--p 000e9000 08:01 2226951                            /usr/lib32/libstdc++.so.6.0.13
f76f4000-f76f5000 rw-p 000ed000 08:01 2226951                            /usr/lib32/libstdc++.so.6.0.13
f76f5000-f76fc000 rw-p 00000000 00:00 0 
f76fc000-f76fe000 r-xp 00000000 08:01 3418627                            /lib32/libdl-2.11.1.so
f76fe000-f76ff000 r--p 00001000 08:01 3418627                            /lib32/libdl-2.11.1.so
f76ff000-f7700000 rw-p 00002000 08:01 3418627                            /lib32/libdl-2.11.1.so
f7700000-f7701000 rw-p 00000000 00:00 0 
f7701000-f7716000 r-xp 00000000 08:01 3418623                            /lib32/libpthread-2.11.1.so
f7716000-f7717000 r--p 00014000 08:01 3418623                            /lib32/libpthread-2.11.1.so
f7717000-f7718000 rw-p 00015000 08:01 3418623                            /lib32/libpthread-2.11.1.so
f7718000-f771a000 rw-p 00000000 00:00 0 
f7749000-f774a000 rw-p 00000000 00:00 0 
f774a000-f774b000 ---p 00000000 00:00 0 
f774b000-f774e000 rw-p 00000000 00:00 0 
f774e000-f7750000 rw-s 00000000 08:06 1442304                            /home/boinc-client/slots/2/boinc_mmap_file
f7750000-f7752000 rw-p 00000000 00:00 0 
f7752000-f7753000 r-xp 00000000 00:00 0                                  [vdso]
f7753000-f776f000 r-xp 00000000 08:01 3418628                            /lib32/ld-2.11.1.so
f776f000-f7770000 r--p 0001b000 08:01 3418628                            /lib32/ld-2.11.1.so
f7770000-f7771000 rw-p 0001c000 08:01 3418628                            /lib32/ld-2.11.1.so
fff56000-fffc6000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf7752400]
[0xf7752430]
/lib32/libc.so.6(gsignal+0x51)[0xf748b971]
/lib32/libc.so.6(abort+0x182)[0xf748eda2]
/lib32/libc.so.6(+0x64eed)[0xf74c5eed]
/lib32/libc.so.6(+0x6efe1)[0xf74cffe1]
/lib32/libc.so.6(+0x70868)[0xf74d1868]
/lib32/libc.so.6(cfree+0x6d)[0xf74d49ad]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf76c2a91]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf76c2aed]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7477bf6]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
06 Nov 2013 23:17:41 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 518,400 872,328 1.6827
06 Nov 2013 02:10:26 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 492,480 826,744 1.6787
04 Nov 2013 03:32:36 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 466,560 781,549 1.6751
02 Nov 2013 01:30:37 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 440,640 739,824 1.6790
25 Oct 2013 01:19:35 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 414,720 697,876 1.6828
24 Oct 2013 00:44:53 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 388,800 655,843 1.6868
22 Oct 2013 06:07:13 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 362,880 603,558 1.6632
21 Oct 2013 07:58:16 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 336,960 560,598 1.6637
20 Oct 2013 19:43:36 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 311,040 517,077 1.6624
16 Oct 2013 09:19:36 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 285,120 473,568 1.6609
15 Oct 2013 08:56:05 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 259,200 431,384 1.6643
08 Oct 2013 21:07:07 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 233,280 388,739 1.6664
26 Sep 2013 07:41:45 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 207,360 341,748 1.6481
25 Sep 2013 09:29:31 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 181,440 300,076 1.6539
24 Sep 2013 09:34:33 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 155,520 257,903 1.6583
23 Sep 2013 21:48:38 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 129,600 215,914 1.6660
23 Sep 2013 18:57:20 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 103,680 172,860 1.6672
20 Sep 2013 19:56:29 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 77,760 130,815 1.6823
19 Sep 2013 21:45:00 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 51,840 88,682 1.7107
18 Sep 2013 09:33:29 1286585 16021658 hadcm3n_n0x0_1920_40_008404083_3 25,920 41,482 1.6004


©2024 cpdn.org