|
Name | hadcm3n_zn4c_1880_40_008251055_0 |
Workunit | 8406179 |
Created | 22 Nov 2012, 9:45:53 UTC |
Sent | 22 Nov 2012, 9:46:10 UTC |
Report deadline | 21 Feb 2013, 17:13:21 UTC |
Received | 12 Jan 2013, 4:52:25 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 1100148 |
Run time | 19 days 20 hours 49 min 42 sec |
CPU time | 19 days 3 hours 8 min 11 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 2.51 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.10.17</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 18:40:35 (2731): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:00:03 (27559): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:01:14 (5681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 00:29:20 (5820): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:05:47 (13448): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:07:12 (6881): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:58:25 (7022): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:36:19 (27913): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 06:38:38 (13048): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0845bff0 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6efe1)[0xf748afe1] /lib32/libc.so.6(+0x70868)[0xf748c868] /lib32/libc.so.6(cfree+0x6d)[0xf748f94d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf767ca91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf767caed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7432bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:01 1835691 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:01 1835691 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 08406000-0846c000 rw-p 00000000 00:00 0 [heap] f6e00000-f6e21000 rw-p 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6f9f000-f741a000 rw-s 00000000 08:01 1583348 /var/lib/boinc-client/slots/10/135925 f741a000-f741c000 rw-p 00000000 00:00 0 f741c000-f7575000 r-xp 00000000 08:01 2360089 /lib32/libc-2.11.1.so f7575000-f7576000 ---p 00159000 08:01 2360089 /lib32/libc-2.11.1.so f7576000-f7578000 r--p 00159000 08:01 2360089 /lib32/libc-2.11.1.so f7578000-f7579000 rw-p 0015b000 08:01 2360089 /lib32/libc-2.11.1.so f7579000-f757c000 rw-p 00000000 00:00 0 f757c000-f7599000 r-xp 00000000 08:01 5639359 /usr/lib32/libgcc_s.so.1 f7599000-f759a000 r--p 0001c000 08:01 5639359 /usr/lib32/libgcc_s.so.1 f759a000-f759b000 rw-p 0001d000 08:01 5639359 /usr/lib32/libgcc_s.so.1 f759b000-f75bf000 r-xp 00000000 08:01 2359871 /lib32/libm-2.11.1.so f75bf000-f75c0000 r--p 00023000 08:01 2359871 /lib32/libm-2.11.1.so f75c0000-f75c1000 rw-p 00024000 08:01 2359871 /lib32/libm-2.11.1.so f75c1000-f76aa000 r-xp 00000000 08:01 5637858 /usr/lib32/libstdc++.so.6.0.13 f76aa000-f76ae000 r--p 000e9000 08:01 5637858 /usr/lib32/libstdc++.so.6.0.13 f76ae000-f76af000 rw-p 000ed000 08:01 5637858 /usr/lib32/libstdc++.so.6.0.13 f76af000-f76b6000 rw-p 00000000 00:00 0 f76b6000-f76b8000 r-xp 00000000 08:01 2360087 /lib32/libdl-2.11.1.so f76b8000-f76b9000 r--p 00001000 08:01 2360087 /lib32/libdl-2.11.1.so f76b9000-f76ba000 rw-p 00002000 08:01 2360087 /lib32/libdl-2.11.1.so f76ba000-f76bb000 rw-p 00000000 00:00 0 f76bb000-f76d0000 r-xp 00000000 08:01 2359991 /lib32/libpthread-2.11.1.so f76d0000-f76d1000 r--p 00014000 08:01 2359991 /lib32/libpthread-2.11.1.so f76d1000-f76d2000 rw-p 00015000 08:01 2359991 /lib32/libpthread-2.11.1.so f76d2000-f76d4000 rw-p 00000000 00:00 0 f76eb000-f76ec000 rw-p 00000000 00:00 0 f76ec000-f76ed000 ---p 00000000 00:00 0 f76ed000-f76f0000 rw-p 00000000 00:00 0 f76f0000-f76f2000 rw-s 00000000 08:01 1583413 /var/lib/boinc-client/slots/10/boinc_mmap_file f76f2000-f76f4000 rw-p 00000000 00:00 0 f76f4000-f76f5000 r-xp 00000000 00:00 0 [vdso] f76f5000-f7711000 r-xp 00000000 08:01 2359983 /lib32/ld-2.11.1.so f7711000-f7712000 r--p 0001b000 08:01 2359983 /lib32/ld-2.11.1.so f7712000-f7713000 rw-p 0001c000 08:01 2359983 /lib32/ld-2.11.1.so ffb21000-ffb91000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf76f4400] [0xf76f4430] /lib32/libc.so.6(gsignal+0x51)[0xf7446951] /lib32/libc.so.6(abort+0x182)[0xf7449d82] /lib32/libc.so.6(+0x64eed)[0xf7480eed] /lib32/libc.so.6(+0x6efe1)[0xf748afe1] /lib32/libc.so.6(+0x70868)[0xf748c868] /lib32/libc.so.6(cfree+0x6d)[0xf748f94d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf767ca91] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf767caed] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe6)[0xf7432bd6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
12 Jan 2013 04:53:39 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 777,600 | 1,652,888 | 2.1256 |
10 Jan 2013 13:40:22 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 751,680 | 1,595,280 | 2.1223 |
09 Jan 2013 05:09:26 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 725,760 | 1,538,983 | 2.1205 |
08 Jan 2013 12:25:08 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 699,840 | 1,483,195 | 2.1193 |
07 Jan 2013 17:42:36 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 673,920 | 1,426,574 | 2.1168 |
07 Jan 2013 01:09:23 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 648,000 | 1,370,008 | 2.1142 |
06 Jan 2013 09:26:13 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 622,080 | 1,315,016 | 2.1139 |
05 Jan 2013 17:51:37 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 596,160 | 1,260,390 | 2.1142 |
05 Jan 2013 00:18:41 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 570,240 | 1,204,362 | 2.1120 |
03 Jan 2013 10:56:25 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 544,320 | 1,148,931 | 2.1108 |
02 Jan 2013 15:16:36 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 518,400 | 1,092,922 | 2.1083 |
01 Jan 2013 22:47:43 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 492,480 | 1,036,264 | 2.1042 |
01 Jan 2013 05:55:48 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 466,560 | 980,790 | 2.1022 |
27 Dec 2012 09:49:36 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 440,640 | 924,759 | 2.0987 |
24 Dec 2012 02:39:56 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 414,720 | 867,271 | 2.0912 |
20 Dec 2012 16:07:36 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 388,800 | 810,362 | 2.0843 |
19 Dec 2012 23:39:18 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 362,880 | 754,027 | 2.0779 |
19 Dec 2012 07:11:39 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 336,960 | 697,359 | 2.0696 |
18 Dec 2012 14:35:33 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 311,040 | 640,718 | 2.0599 |
14 Dec 2012 21:05:26 | 1100148 | 15453183 | hadcm3n_zn4c_1880_40_008251055_0 | 285,120 | 583,809 | 2.0476 |
©2024 climateprediction.net