climateprediction.net home page
Task 12732748

Task 12732748

Name hadcm3n_o0co_1900_40_007195787_0
Workunit 7394067
Created 28 Mar 2011, 13:56:41 UTC
Sent 3 Apr 2011, 4:39:22 UTC
Report deadline 3 Jul 2011, 12:06:33 UTC
Received 15 May 2011, 12:45:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1127100
Run time 15 days 0 hours 58 min 58 sec
CPU time 12 days 19 hours 35 min 16 sec
Validate state Invalid
Credit 6,220.80
Device peak FLOPS 1.60 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
15:32:13 (11794): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:33:25 (14263): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:34:07 (14273): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:35:49 (14277): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  2048    
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09a6b740 ***
======= Backtrace: =========
/lib/libc.so.6(+0x6c501)[0xb7559501]
/lib/libc.so.6(+0x6dd70)[0xb755ad70]
/lib/libc.so.6(cfree+0x6d)[0xb755de5d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7736441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb773649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0xb7503ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:04 526149     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 08:04 526149     /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
09a16000-09a7b000 rw-p 00000000 00:00 0          [heap]
b6f00000-b6f21000 rw-p 00000000 00:00 0 
b6f21000-b7000000 ---p 00000000 00:00 0 
b706f000-b74ea000 rw-s 00000000 08:04 545155     /var/lib/boinc-client/slots/3/137615
b74ea000-b74ed000 rw-p 00000000 00:00 0 
b74ed000-b7644000 r-xp 00000000 08:04 2100859    /lib/libc-2.12.1.so
b7644000-b7646000 r--p 00157000 08:04 2100859    /lib/libc-2.12.1.so
b7646000-b7647000 rw-p 00159000 08:04 2100859    /lib/libc-2.12.1.so
b7647000-b764a000 rw-p 00000000 00:00 0 
b764a000-b7664000 r-xp 00000000 08:04 2097157    /lib/libgcc_s.so.1
b7664000-b7665000 r--p 00019000 08:04 2097157    /lib/libgcc_s.so.1
b7665000-b7666000 rw-p 0001a000 08:04 2097157    /lib/libgcc_s.so.1
b7666000-b768a000 r-xp 00000000 08:04 2100863    /lib/libm-2.12.1.so
b768a000-b768b000 r--p 00023000 08:04 2100863    /lib/libm-2.12.1.so
b768b000-b768c000 rw-p 00024000 08:04 2100863    /lib/libm-2.12.1.so
b768c000-b776b000 r-xp 00000000 08:04 10466      /usr/lib/libstdc++.so.6.0.14
b776b000-b776f000 r--p 000de000 08:04 10466      /usr/lib/libstdc++.so.6.0.14
b776f000-b7770000 rw-p 000e2000 08:04 10466      /usr/lib/libstdc++.so.6.0.14
b7770000-b7778000 rw-p 00000000 00:00 0 
b7778000-b777a000 r-xp 00000000 08:04 2100862    /lib/libdl-2.12.1.so
b777a000-b777b000 r--p 00001000 08:04 2100862    /lib/libdl-2.12.1.so
b777b000-b777c000 rw-p 00002000 08:04 2100862    /lib/libdl-2.12.1.so
b777c000-b7791000 r-xp 00000000 08:04 2100873    /lib/libpthread-2.12.1.so
b7791000-b7792000 ---p 00015000 08:04 2100873    /lib/libpthread-2.12.1.so
b7792000-b7793000 r--p 00015000 08:04 2100873    /lib/libpthread-2.12.1.so
b7793000-b7794000 rw-p 00016000 08:04 2100873    /lib/libpthread-2.12.1.so
b7794000-b7796000 rw-p 00000000 00:00 0 
b77aa000-b77ab000 rw-p 00000000 00:00 0 
b77ab000-b77ac000 ---p 00000000 00:00 0 
b77ac000-b77af000 rw-p 00000000 00:00 0 
b77af000-b77b1000 rw-s 00000000 08:04 543514     /var/lib/boinc-client/slots/3/boinc_mmap_file
b77b1000-b77b3000 rw-p 00000000 00:00 0 
b77b3000-b77b4000 r-xp 00000000 00:00 0          [vdso]
b77b4000-b77d0000 r-xp 00000000 08:04 2097336    /lib/ld-2.12.1.so
b77d0000-b77d1000 r--p 0001b000 08:04 2097336    /lib/ld-2.12.1.so
b77d1000-b77d2000 rw-p 0001c000 08:04 2097336    /lib/ld-2.12.1.so
bfe26000-bfe96000 rw-p 00000000 00:00 0          [stack]
SIGABRT: abort called
Stack trace (19 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xb77b3400]
[0xb77b3424]
/lib/libc.so.6(gsignal+0x51)[0xb7517941]
/lib/libc.so.6(abort+0x182)[0xb751ae42]
/lib/libc.so.6(+0x62305)[0xb754f305]
/lib/libc.so.6(+0x6c501)[0xb7559501]
/lib/libc.so.6(+0x6dd70)[0xb755ad70]
/lib/libc.so.6(cfree+0x6d)[0xb755de5d]
/usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xb7736441]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xb773649d]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe7)[0xb7503ce7]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
15 May 2011 12:49:41 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 518,400 1,107,310 2.1360
14 May 2011 09:45:12 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 492,480 1,055,512 2.1433
13 May 2011 09:24:47 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 466,560 1,000,267 2.1439
12 May 2011 06:40:58 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 440,640 943,840 2.1420
07 May 2011 20:24:40 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 414,720 893,360 2.1541
07 May 2011 05:40:22 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 388,800 853,442 2.1951
06 May 2011 14:55:57 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 362,880 800,880 2.2070
06 May 2011 00:42:45 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 336,960 750,131 2.2262
05 May 2011 10:19:54 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 311,040 698,721 2.2464
01 May 2011 18:40:26 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 285,120 645,365 2.2635
01 May 2011 02:01:09 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 259,200 588,944 2.2722
25 Apr 2011 06:58:58 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 233,280 530,907 2.2758
23 Apr 2011 21:08:41 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 207,360 472,186 2.2771
22 Apr 2011 11:37:16 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 181,440 414,085 2.2822
21 Apr 2011 17:30:50 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 155,520 353,808 2.2750
21 Apr 2011 02:47:07 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 129,600 294,994 2.2762
20 Apr 2011 18:29:46 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 103,680 235,704 2.2734
20 Apr 2011 18:29:46 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 77,760 176,160 2.2654
20 Apr 2011 18:29:46 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 51,840 115,619 2.2303
20 Apr 2011 18:29:46 1127100 12732748 hadcm3n_o0co_1900_40_007195787_0 25,920 54,142 2.0888


©2024 cpdn.org