climateprediction.net home page
Task 15450570

Task 15450570

Name hadcm3n_zmfe_1880_40_008249965_0
Workunit 8405089
Created 22 Nov 2012, 2:29:10 UTC
Sent 22 Nov 2012, 2:30:45 UTC
Report deadline 21 Feb 2013, 9:57:56 UTC
Received 1 Dec 2012, 5:06:37 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1155132
Run time 7 days 12 hours 18 min 43 sec
CPU time 6 days 9 hours 32 min 17 sec
Validate state Invalid
Credit 3,110.40
Device peak FLOPS 2.59 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.59</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
06:26:16 (3362): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:27:08 (6820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:27:55 (6956): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:29:38 (7080): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:31:21 (7318): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:33:01 (7567): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:35:25 (7806): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:42:28 (8136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:54:45 (9116): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:29:45 (10737): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:31:28 (15416): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:33:07 (15666): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:34:53 (15906): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:36:53 (16155): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:41:55 (16441): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:44:19 (17150): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:48:38 (17581): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:24:02 (18073): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:51:38 (22661): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:31:27 (26050): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:33:10 (30687): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:34:54 (30910): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:36:37 (31132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:38:18 (31355): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:41:29 (31567): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:48:11 (31985): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:02:57 (323): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:21:55 (2214): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:12:10 (4482): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:15:02 (10331): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:16:42 (10673): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:43:09 (10896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:03:48 (14136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x08a8df10 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b511)[0xf753d511]
/lib32/libc.so.6(+0x6ce1b)[0xf753ee1b]
/lib32/libc.so.6(cfree+0x6d)[0xf7541f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771b841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771b89d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74e8e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:01 24249584                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:01 24249584                           /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
08a38000-08a9d000 rw-p 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7054000-f74cf000 rw-s 00000000 08:01 132131                             /var/lib/boinc-client/slots/7/140760
f74cf000-f74d2000 rw-p 00000000 00:00 0 
f74d2000-f7628000 r-xp 00000000 08:01 1048581                            /lib32/libc-2.13.so
f7628000-f7629000 ---p 00156000 08:01 1048581                            /lib32/libc-2.13.so
f7629000-f762b000 r--p 00156000 08:01 1048581                            /lib32/libc-2.13.so
f762b000-f762c000 rw-p 00158000 08:01 1048581                            /lib32/libc-2.13.so
f762c000-f762f000 rw-p 00000000 00:00 0 
f762f000-f7649000 r-xp 00000000 08:01 13113737                           /usr/lib32/libgcc_s.so.1
f7649000-f764a000 r--p 00019000 08:01 13113737                           /usr/lib32/libgcc_s.so.1
f764a000-f764b000 rw-p 0001a000 08:01 13113737                           /usr/lib32/libgcc_s.so.1
f764b000-f766f000 r-xp 00000000 08:01 1048585                            /lib32/libm-2.13.so
f766f000-f7670000 r--p 00023000 08:01 1048585                            /lib32/libm-2.13.so
f7670000-f7671000 rw-p 00024000 08:01 1048585                            /lib32/libm-2.13.so
f7671000-f7750000 r-xp 00000000 08:01 13113743                           /usr/lib32/libstdc++.so.6.0.14
f7750000-f7754000 r--p 000de000 08:01 13113743                           /usr/lib32/libstdc++.so.6.0.14
f7754000-f7755000 rw-p 000e2000 08:01 13113743                           /usr/lib32/libstdc++.so.6.0.14
f7755000-f775c000 rw-p 00000000 00:00 0 
f775c000-f775e000 r-xp 00000000 08:01 1048584                            /lib32/libdl-2.13.so
f775e000-f775f000 r--p 00001000 08:01 1048584                            /lib32/libdl-2.13.so
f775f000-f7760000 rw-p 00002000 08:01 1048584                            /lib32/libdl-2.13.so
f7760000-f7775000 r-xp 00000000 08:01 1048595                            /lib32/libpthread-2.13.so
f7775000-f7776000 r--p 00014000 08:01 1048595                            /lib32/libpthread-2.13.so
f7776000-f7777000 rw-p 00015000 08:01 1048595                            /lib32/libpthread-2.13.so
f7777000-f777a000 rw-p 00000000 00:00 0 
f7796000-f7797000 rw-p 00000000 00:00 0 
f7797000-f7798000 ---p 00000000 00:00 0 
f7798000-f779b000 rw-p 00000000 00:00 0 
f779b000-f779d000 rw-s 00000000 08:01 131627                             /var/lib/boinc-client/slots/7/boinc_mmap_file
f779d000-f779e000 rw-p 00000000 00:00 0 
f779e000-f779f000 r-xp 00000000 00:00 0                                  [vdso]
f779f000-f77bb000 r-xp 00000000 08:01 1048578                            /lib32/ld-2.13.so
f77bb000-f77bc000 r--p 0001b000 08:01 1048578                            /lib32/ld-2.13.so
f77bc000-f77bd000 rw-p 0001c000 08:01 1048578                            /lib32/ld-2.13.so
fff15000-fff85000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf779e400]
[0xf779e430]
/lib32/libc.so.6(gsignal+0x51)[0xf74fcea1]
/lib32/libc.so.6(abort+0x17e)[0xf75002ce]
/lib32/libc.so.6(+0x61277)[0xf7533277]
/lib32/libc.so.6(+0x6b511)[0xf753d511]
/lib32/libc.so.6(+0x6ce1b)[0xf753ee1b]
/lib32/libc.so.6(cfree+0x6d)[0xf7541f8d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf771b841]
/usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf771b89d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe7)[0xf74e8e37]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
01 Dec 2012 05:10:29 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 259,200 552,734 2.1325
30 Nov 2012 07:36:34 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 233,280 497,019 2.1306
29 Nov 2012 15:43:35 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 207,360 445,392 2.1479
28 Nov 2012 19:15:04 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 181,440 389,588 2.1472
27 Nov 2012 20:32:50 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 155,520 333,976 2.1475
27 Nov 2012 00:16:52 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 129,600 278,621 2.1499
26 Nov 2012 00:23:20 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 103,680 222,182 2.1430
24 Nov 2012 20:46:59 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 77,760 166,443 2.1405
23 Nov 2012 23:51:22 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 51,840 111,279 2.1466
23 Nov 2012 02:09:15 1155132 15450570 hadcm3n_zmfe_1880_40_008249965_0 25,920 55,664 2.1475


©2024 cpdn.org