 |
|
| Name | hadcm3n_3bwj_2020_40_008406084_2 |
| Workunit | 8556940 |
| Created | 4 Nov 2013, 11:23:09 UTC |
| Sent | 4 Nov 2013, 11:23:19 UTC |
| Report deadline | 3 Feb 2014, 18:50:30 UTC |
| Received | 13 Dec 2013, 10:23:37 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1239443 |
| Run time | 9 days 18 hours 2 min 30 sec |
| CPU time | 9 days 2 hours 52 min 37 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 2.65 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.45</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:16:14 (28704): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Atmos Hold Restart file rename failed on atmos_restart.hold CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 Error: Input file: dataout/3bwjko.pjm2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjko.pjm2c10 Error: Input file: dataout/3bwjko.pim2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjko.pim2c10 Error: Input file: dataout/3bwjko.pfm2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjko.pfm2c10 Error: Input file: dataout/3bwjka.phm2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjka.phm2c10 Error: Input file: dataout/3bwjka.pgm2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjka.pgm2c10 Error: Input file: dataout/3bwjka.pem2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjka.pem2c10 Error: Input file: dataout/3bwjka.pdm2c10 is not a valid UM file. Error converting file to netcdf: dataout/3bwjka.pdm2c10 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:02:28 (19565): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:47:18 (4077): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 04:28:02 (31965): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:19:00 (4173): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:06:10 (8016): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:10:33 (15017): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:51:47 (15164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:53:45 (15988): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0956dfc0 *** ======= Backtrace: ========= /lib/libc.so.6[0x7e3df1] /lib/libc.so.6[0x7e6531] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x611552] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x6115ae] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x789ce6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 00562000-00643000 r-xp 00000000 fd:00 36863 /usr/lib/libstdc++.so.6.0.13 00643000-00647000 r--p 000e0000 fd:00 36863 /usr/lib/libstdc++.so.6.0.13 00647000-00649000 rw-p 000e4000 fd:00 36863 /usr/lib/libstdc++.so.6.0.13 00649000-0064f000 rw-p 00000000 00:00 0 00651000-0066e000 r-xp 00000000 fd:00 260173 /lib/libgcc_s-4.4.7-20120601.so.1 0066e000-0066f000 rw-p 0001d000 fd:00 260173 /lib/libgcc_s-4.4.7-20120601.so.1 00751000-0076f000 r-xp 00000000 fd:00 262388 /lib/ld-2.12.so 0076f000-00770000 r--p 0001d000 fd:00 262388 /lib/ld-2.12.so 00770000-00771000 rw-p 0001e000 fd:00 262388 /lib/ld-2.12.so 00773000-00903000 r-xp 00000000 fd:00 266969 /lib/libc-2.12.so 00903000-00904000 ---p 00190000 fd:00 266969 /lib/libc-2.12.so 00904000-00906000 r--p 00190000 fd:00 266969 /lib/libc-2.12.so 00906000-00907000 rw-p 00192000 fd:00 266969 /lib/libc-2.12.so 00907000-0090a000 rw-p 00000000 00:00 0 0090c000-0090f000 r-xp 00000000 fd:00 266972 /lib/libdl-2.12.so 0090f000-00910000 r--p 00002000 fd:00 266972 /lib/libdl-2.12.so 00910000-00911000 rw-p 00003000 fd:00 266972 /lib/libdl-2.12.so 00913000-0092a000 r-xp 00000000 fd:00 266982 /lib/libpthread-2.12.so 0092a000-0092b000 r--p 00016000 fd:00 266982 /lib/libpthread-2.12.so 0092b000-0092c000 rw-p 00017000 fd:00 266982 /lib/libpthread-2.12.so 0092c000-0092e000 rw-p 00000000 00:00 0 00930000-00958000 r-xp 00000000 fd:00 266974 /lib/libm-2.12.so 00958000-00959000 r--p 00027000 fd:00 266974 /lib/libm-2.12.so 00959000-0095a000 rw-p 00028000 fd:00 266974 /lib/libm-2.12.so 00ae1000-00ae2000 r-xp 00000000 00:00 0 [vdso] 08048000-080e3000 r-xp 00000000 fd:02 11011483 /home/boinc/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 fd:02 11011483 /home/boinc/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 09518000-0959f000 rw-p 00000000 00:00 0 [heap] f7100000-f7121000 rw-p 00000000 00:00 0 f7121000-f7200000 ---p 00000000 00:00 0 f72f8000-f7773000 rw-s 00000000 fd:02 11929663 /home/boinc/boinc/slots/3/135875 f7773000-f7776000 rw-p 00000000 00:00 0 f778a000-f778b000 rw-p 00000000 00:00 0 f778b000-f778c000 ---p 00000000 00:00 0 f778c000-f778f000 rw-p 00000000 00:00 0 f778f000-f7791000 rw-s 00000000 fd:02 11929548 /home/boinc/boinc/slots/3/boinc_mmap_file f7791000-f7793000 rw-p 00000000 00:00 0 ff873000-ff8e4000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (18 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xae1400] [0xae1430] /lib/libc.so.6(gsignal+0x51)[0x79dad1] /lib/libc.so.6(abort+0x17a)[0x79f3aa] /lib/libc.so.6[0x7dd995] /lib/libc.so.6[0x7e3df1] /lib/libc.so.6[0x7e6531] /usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0x611552] /usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0x6115ae] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0x789ce6] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 13 Dec 2013 10:23:39 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 518,400 | 787,955 | 1.5200 |
| 12 Dec 2013 22:45:13 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 492,480 | 748,412 | 1.5197 |
| 12 Dec 2013 11:06:30 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 466,560 | 708,963 | 1.5196 |
| 11 Dec 2013 23:45:14 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 440,640 | 669,658 | 1.5197 |
| 11 Dec 2013 11:14:02 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 414,720 | 630,571 | 1.5205 |
| 11 Dec 2013 00:09:59 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 388,800 | 591,259 | 1.5207 |
| 10 Dec 2013 10:27:05 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 362,880 | 550,877 | 1.5181 |
| 09 Dec 2013 22:37:46 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 336,960 | 510,572 | 1.5152 |
| 09 Dec 2013 10:29:51 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 311,040 | 470,848 | 1.5138 |
| 08 Dec 2013 22:40:11 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 285,120 | 431,499 | 1.5134 |
| 08 Dec 2013 10:55:51 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 259,200 | 392,130 | 1.5128 |
| 07 Dec 2013 23:04:45 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 233,280 | 352,920 | 1.5129 |
| 07 Dec 2013 12:22:42 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 207,360 | 313,669 | 1.5127 |
| 06 Dec 2013 23:42:28 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 181,440 | 274,658 | 1.5138 |
| 06 Dec 2013 12:09:13 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 155,520 | 235,961 | 1.5172 |
| 05 Dec 2013 20:07:04 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 129,600 | 196,993 | 1.5200 |
| 05 Dec 2013 03:05:55 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 103,680 | 157,630 | 1.5204 |
| 04 Dec 2013 09:30:25 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 77,760 | 118,066 | 1.5183 |
| 03 Dec 2013 16:18:57 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 51,840 | 78,785 | 1.5198 |
| 02 Dec 2013 23:41:41 | 1239443 | 16077669 | hadcm3n_3bwj_2020_40_008406084_2 | 25,920 | 39,431 | 1.5213 |
©2024 cpdn.org