climateprediction.net home page
Task 13615393

Task 13615393

Name hadcm3n_o5ea_1940_40_007444399_3
Workunit 7641902
Created 7 Nov 2011, 9:14:09 UTC
Sent 8 Nov 2011, 21:19:22 UTC
Report deadline 8 Feb 2012, 4:46:33 UTC
Received 9 Jan 2012, 18:01:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1129391
Run time 53 days 21 hours 44 min 14 sec
CPU time 53 days 21 hours 44 min 14 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 0.50 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.4.5</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
08:24:28 (6753): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x087bdf40 ***
======= Backtrace: =========
/lib/tls/i686/cmov/libc.so.6[0xb7e42454]
/lib/tls/i686/cmov/libc.so.6(cfree+0x96)[0xb7e444b6]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb801f0b1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb801f10d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7de9685]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 00:11 2656       /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 00:11 2656       /home/boinc/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 080e4000 00:00 0 
086fa000-087fa000 rwxp 086fa000 00:00 0          [heap]
b7800000-b7821000 rwxp b7800000 00:00 0 
b7821000-b7900000 ---p b7821000 00:00 0 
b7956000-b7dd1000 rwxs 00000000 00:11 2970       /home/boinc/BOINC/slots/1/136965
b7dd1000-b7dd3000 rwxp b7dd1000 00:00 0 
b7dd3000-b7f2b000 r-xp 00000000 00:11 70         /lib/tls/i686/cmov/libc-2.8.90.so
b7f2b000-b7f2d000 r-xp 00158000 00:11 70         /lib/tls/i686/cmov/libc-2.8.90.so
b7f2d000-b7f2e000 rwxp 0015a000 00:11 70         /lib/tls/i686/cmov/libc-2.8.90.so
b7f2e000-b7f31000 rwxp b7f2e000 00:00 0 
b7f31000-b7f3e000 r-xp 00000000 00:11 1607       /lib/libgcc_s.so.1
b7f3e000-b7f3f000 r-xp 0000c000 00:11 1607       /lib/libgcc_s.so.1
b7f3f000-b7f40000 rwxp 0000d000 00:11 1607       /lib/libgcc_s.so.1
b7f40000-b7f64000 r-xp 00000000 00:11 84         /lib/tls/i686/cmov/libm-2.8.90.so
b7f64000-b7f65000 r-xp 00023000 00:11 84         /lib/tls/i686/cmov/libm-2.8.90.so
b7f65000-b7f66000 rwxp 00024000 00:11 84         /lib/tls/i686/cmov/libm-2.8.90.so
b7f66000-b8049000 r-xp 00000000 00:11 1606       /usr/lib/libstdc++.so.6.0.10
b8049000-b804d000 r-xp 000e3000 00:11 1606       /usr/lib/libstdc++.so.6.0.10
b804d000-b804e000 rwxp 000e7000 00:11 1606       /usr/lib/libstdc++.so.6.0.10
b804e000-b8055000 rwxp b804e000 00:00 0 
b8055000-b8057000 r-xp 00000000 00:11 82         /lib/tls/i686/cmov/libdl-2.8.90.so
b8057000-b8058000 r-xp 00001000 00:11 82         /lib/tls/i686/cmov/libdl-2.8.90.so
b8058000-b8059000 rwxp 00002000 00:11 82         /lib/tls/i686/cmov/libdl-2.8.90.so
b8059000-b806e000 r-xp 00000000 00:11 86         /lib/tls/i686/cmov/libpthread-2.8.90.so
b806e000-b806f000 r-xp 00014000 00:11 86         /lib/tls/i686/cmov/libpthread-2.8.90.so
b806f000-b8070000 rwxp 00015000 00:11 86         /lib/tls/i686/cmov/libpthread-2.8.90.so
b8070000-b8072000 rwxp b8070000 00:00 0 
b8078000-b8079000 rwxp b8078000 00:00 0 
b8079000-b807a000 ---p b8079000 00:00 0 
b807a000-b807d000 rwxp b807a000 00:00 0 
b807d000-b807f000 rwxs 00000000 00:11 2973       /home/boinc/BOINC/slots/1/boinc_mmap_file
b807f000-b8081000 rwxp b807f000 00:00 0 
b8081000-b809b000 r-xp 00000000 00:11 64         /lib/ld-2.8.90.so
b809b000-b809c000 r-xp b809b000 00:00 0          [vdso]
b809c000-b809d000 r-xp 0001a000 00:11 64         /lib/ld-2.8.90.so
b809d000-b809e000 rwxp 0001b000 00:11 64         /lib/ld-2.8.90.so
bff2e000-bff9e000 rw-p bff90000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (18 frames):
hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb809b400]
[0xb809b430]
/lib/tls/i686/cmov/libc.so.6(gsignal+0x50)[0xb7dfe8a0]
/lib/tls/i686/cmov/libc.so.6(abort+0x188)[0xb7e00268]
/lib/tls/i686/cmov/libc.so.6[0xb7e3c16d]
/lib/tls/i686/cmov/libc.so.6[0xb7e42454]
/lib/tls/i686/cmov/libc.so.6(cfree+0x96)[0xb7e444b6]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb801f0b1]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb801f10d]
hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/tls/i686/cmov/libc.so.6(__libc_start_main+0xe5)[0xb7de9685]
hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jan 2012 18:05:59 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 518,400 4,657,452 8.9843
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 492,480 4,568,756 9.2770
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 466,560 4,311,415 9.2409
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 440,640 4,054,507 9.2014
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 414,720 3,797,281 9.1563
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 388,800 3,540,906 9.1073
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 362,880 3,284,242 9.0505
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 336,960 3,027,234 8.9840
09 Jan 2012 17:45:47 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 311,040 2,771,441 8.9102
14 Dec 2011 18:01:02 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 285,120 2,527,280 8.8639
14 Dec 2011 18:01:02 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 259,200 2,284,061 8.8120
07 Dec 2011 16:54:43 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 233,280 2,306,372 9.8867
07 Dec 2011 16:54:42 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 207,360 2,049,904 9.8857
07 Dec 2011 16:54:42 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 181,440 1,793,398 9.8842
07 Dec 2011 16:54:42 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 155,520 1,537,219 9.8844
07 Dec 2011 16:54:43 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 129,600 1,281,853 9.8908
07 Dec 2011 16:54:43 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 103,680 1,025,406 9.8901
07 Dec 2011 16:54:43 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 77,760 769,296 9.8932
07 Dec 2011 16:54:43 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 51,840 512,908 9.8941
07 Dec 2011 16:54:42 1129391 13615393 hadcm3n_o5ea_1940_40_007444399_3 25,920 256,443 9.8936


©2024 cpdn.org