climateprediction.net home page
Task 19324191

Task 19324191

Name hadcm3n_scf6_198012_480_352_010333865_2
Workunit 10333865
Created 2 Mar 2016, 20:33:58 UTC
Sent 2 Mar 2016, 20:36:24 UTC
Report deadline 13 Feb 2017, 1:56:24 UTC
Received 22 May 2016, 20:57:46 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1241909
Run time 16 days 12 hours 5 min 49 sec
CPU time 16 days 9 hours 4 min 2 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 3.10 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 63 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 64 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 65 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 66 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 67 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
Error: Input file: dataout/scf6ko.pji1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ko.pji1c10
Error: Input file: dataout/scf6ko.pii1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ko.pii1c10
Error: Input file: dataout/scf6ko.pfi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ko.pfi1c10
Error: Input file: dataout/scf6ka.phi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ka.phi1c10
Error: Input file: dataout/scf6ka.pgi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ka.pgi1c10
Error: Input file: dataout/scf6ka.pei1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ka.pei1c10
Error: Input file: dataout/scf6ka.pdi1c10 is not a valid UM file.
Error converting file to netcdf: dataout/scf6ka.pdi1c10
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
12:20:15 (3610): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:21:14 (8104): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:22:14 (8127): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
*** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x0a206160 ***
======= Backtrace: =========
/lib/libc.so.6[0x4e638c91]
/lib/libc.so.6[0x4e63b6f1]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xf7799df2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xf7799e4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x4e5ded26]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 09:03 1569873                            /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rw-p 0009b000 09:03 1569873                            /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rw-p 00000000 00:00 0 
0a107000-0a279000 rw-p 00000000 00:00 0                                  [heap]
4e5a6000-4e5c4000 r-xp 00000000 fb:00 526455                             /lib/ld-2.12.so
4e5c4000-4e5c5000 r--p 0001e000 fb:00 526455                             /lib/ld-2.12.so
4e5c5000-4e5c6000 rw-p 0001f000 fb:00 526455                             /lib/ld-2.12.so
4e5c8000-4e759000 r-xp 00000000 fb:00 529100                             /lib/libc-2.12.so
4e759000-4e75b000 r--p 00191000 fb:00 529100                             /lib/libc-2.12.so
4e75b000-4e75c000 rw-p 00193000 fb:00 529100                             /lib/libc-2.12.so
4e75c000-4e75f000 rw-p 00000000 00:00 0 
4e864000-4e87b000 r-xp 00000000 fb:00 529102                             /lib/libpthread-2.12.so
4e87b000-4e87c000 r--p 00016000 fb:00 529102                             /lib/libpthread-2.12.so
4e87c000-4e87d000 rw-p 00017000 fb:00 529102                             /lib/libpthread-2.12.so
4e87d000-4e87f000 rw-p 00000000 00:00 0 
f6f00000-f6f21000 rw-p 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f7100000-f7121000 rw-p 00000000 00:00 0 
f7121000-f7200000 ---p 00000000 00:00 0 
f7227000-f76a2000 rw-s 00000000 09:03 915836                             /var/lib/boinc/slots/4/202150
f76a2000-f76a4000 rw-p 00000000 00:00 0 
f76a4000-f76c1000 r-xp 00000000 fb:00 531276                             /lib/libgcc_s-4.4.7-20120601.so.1
f76c1000-f76c2000 rw-p 0001d000 fb:00 531276                             /lib/libgcc_s-4.4.7-20120601.so.1
f76c2000-f76c3000 rw-p 00000000 00:00 0 
f76c3000-f76eb000 r-xp 00000000 fb:00 545106                             /lib/libm-2.12.so
f76eb000-f76ec000 r--p 00027000 fb:00 545106                             /lib/libm-2.12.so
f76ec000-f76ed000 rw-p 00028000 fb:00 545106                             /lib/libm-2.12.so
f76ed000-f77cc000 r-xp 00000000 fb:00 153154                             /usr/lib/libstdc++.so.6.0.13
f77cc000-f77d0000 r--p 000de000 fb:00 153154                             /usr/lib/libstdc++.so.6.0.13
f77d0000-f77d1000 rw-p 000e2000 fb:00 153154                             /usr/lib/libstdc++.so.6.0.13
f77d1000-f77d8000 rw-p 00000000 00:00 0 
f77d8000-f77db000 r-xp 00000000 fb:00 538225                             /lib/libdl-2.12.so
f77db000-f77dc000 r--p 00002000 fb:00 538225                             /lib/libdl-2.12.so
f77dc000-f77dd000 rw-p 00003000 fb:00 538225                             /lib/libdl-2.12.so
f77eb000-f77ed000 rw-p 00000000 00:00 0 
f77ed000-f77ee000 ---p 00000000 00:00 0 
f77ee000-f77f1000 rw-p 00000000 00:00 0                                  [stack:10843]
f77f1000-f77f3000 rw-s 00000000 09:03 915831                             /var/lib/boinc/slots/4/boinc_mmap_file
f77f3000-f77f4000 rw-p 00000000 00:00 0 
f77f4000-f77f6000 r--p 00000000 00:00 0                                  [vvar]
f77f6000-f77f8000 r-xp 00000000 00:00 0                                  [vdso]
ff7f1000-ff861000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (18 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77f6e50]
[0xf77f6e80]
/lib/libc.so.6(gsignal+0x51)[0x4e5f2861]
/lib/libc.so.6(abort+0x17a)[0x4e5f413a]
/lib/libc.so.6[0x4e632725]
/lib/libc.so.6[0x4e638c91]
/lib/libc.so.6[0x4e63b6f1]
/usr/lib/libstdc++.so.6(_ZdlPv+0x22)[0xf7799df2]
/usr/lib/libstdc++.so.6(_ZdaPv+0x1e)[0xf7799e4e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib/libc.so.6(__libc_start_main+0xe6)[0x4e5ded26]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 May 2016 21:01:34 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 1,036,800 1,415,039 1.3648
22 May 2016 07:52:19 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 1,010,880 1,379,634 1.3648
21 May 2016 17:00:54 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 984,960 1,343,827 1.3643
21 May 2016 04:22:55 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 959,040 1,308,270 1.3641
20 May 2016 11:30:09 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 933,120 1,273,008 1.3642
20 May 2016 01:37:13 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 907,200 1,237,581 1.3642
19 May 2016 12:26:39 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 881,280 1,202,432 1.3644
19 May 2016 02:58:24 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 855,360 1,167,370 1.3648
18 May 2016 08:42:01 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 829,440 1,131,959 1.3647
17 May 2016 18:13:38 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 803,520 1,096,809 1.3650
17 May 2016 06:02:05 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 777,600 1,061,591 1.3652
16 May 2016 11:59:37 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 751,680 1,026,275 1.3653
16 May 2016 01:08:10 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 725,760 990,974 1.3654
15 May 2016 09:17:48 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 699,840 955,418 1.3652
14 May 2016 18:50:52 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 673,920 919,500 1.3644
14 May 2016 08:48:32 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 648,000 883,934 1.3641
13 May 2016 19:08:29 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 622,080 848,672 1.3642
13 May 2016 05:44:56 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 596,160 813,469 1.3645
12 May 2016 12:46:04 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 570,240 778,291 1.3648
11 May 2016 21:42:27 1241909 19324191 hadcm3n_scf6_198012_480_352_010333865_2 544,320 742,878 1.3648


©2024 climateprediction.net