search for: utf

Hi all, I have 2 linux distro ?? ubuntu and centos. My problem is that the sort command has different behavior when sorting Chinese string encoded in utf8 file. On Ubuntu, it is OK. But on CentOS, it WRONG. I google this problem and it seems that's because of LC_COLLATE. So I change "/etc/sysconfig/i18n" on CentOS and now the 2 have the same LC_** like this: CentOS: ============================= [root at localhost ~]# locale LANG=...

...former is below. > | > | Here's what I see: If I set the locale, and trigger a namespace load, a > | version comparison gives NA, and I get an error. For example, in a new > | session started with R --vanilla from the terminal: > | > | > Sys.setlocale(locale='en_US.UTF-8');grid::gpar() > | [1] "en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_CA.UTF-8" > | Error in if (R_version_built_under < "3.0.0") stop(gettextf("package %s > | was built before R 3.0.0: please re-install it", : > | missing value where TRU...

"R version 3.4.0 (2017-04-21)" on "x86_64-w64-mingw32" platform I am using CSVs and other text tables, and text in general (including regular expressions), on Windows 10. For me, that means dealing with Windows-1252 and UTF-8 encoding, with UTF-16 and UTF-32 as helpful curiosities. Something as simple as iconv ("\n", to = "UTF-16") causes an error, due to an embedded nul. Then there is write.csv (or write.table) with its fileEncoding parameter: not working correctly for UTF-16 and UTF-32. Of cou...

I think R from EPEL 8 is missing a dependency on glibc-langpack-en or similar. Testing with the new CentOS 8 docker image: docker run -it centos:8 bash And then in docker: yum install epel-release yum config-manager --set-enabled PowerTools yum install R-devel Installation succeeds but when I start R: During startup - Warning messages: 1: Setting LC_CTYPE failed, using

Dear R devels Yesterday I was slightly surprised to notice that R incorrectly detected some of the locale settings. I am not sure whether this is important, but I preferred to drop a message. In the R output below, some entries that should have been "en_GB.UTF-8" are presented as "C". Regards Liviu > sessionInfo() R version 2.9.1 (2009-06-26) x86_64-pc-linux-gnu locale: LC_CTYPE=en_GB.UTF-8;LC_NUMERIC=C;LC_TIME=en_GB.UTF-8;LC_COLLATE=en_GB.UTF-8;LC_MONETARY=C;LC_MESSAGES=en_GB.UTF-8;LC_PAPER=en_GB.UTF-8;LC_NAME=C;LC_ADDRESS=C;LC_TELEP...

On 30/04/2017 12:23 PM, Duncan Murdoch wrote: > No, I don't think anyone is working on this. > > There's a fairly simple workaround for the UTF-16 and UTF-32 iconv > issues: don't attempt to produce character vectors, produce raw vectors > instead. (The "toRaw" argument to iconv() asks for this.) Raw vectors > can contain embedded nulls. Character vectors can't, because > internally, R is using 8 bit C strin...

...multibyte string ... > parse(text='"\\xFF"') Error: invalid multibyte string However, cat("\x7F\n\x80\n...\xFF\n") works. Using R --vanilla. SYSTEMS GIVING THE ERROR: > sessionInfo() R version 2.4.0 (2006-10-03) x86_64-unknown-linux-gnu locale: LC_CTYPE=en_AU.UTF-8;LC_NUMERIC=C;LC_TIME=en_AU.UTF-8;LC_COLLATE=en_AU.UTF-8;LC_MONETARY=en_AU.UTF-8;LC_MESSAGES=en_AU.UTF-8;LC_PAPER=en_AU.UTF-8;LC_NAME=C;LC_ADDRESS=C;LC_TELEPHONE=C;LC_MEASUREMENT=en_AU.UTF-8;LC_IDENTIFICATION=C R version 2.4.0 Patched (2006-10-03 r39576) i686-pc-linux-gnu locale: LC_CTYPE=en_US.U...

...2 not handled: Error decoding input string. Check that you have the locale set correctly however it looks to me like my locale matches the file type. Running the file command on the files returns $ file /media/.../raw/abc/20Jan2007_abc_001041_67.es /media/.../raw/abc/20Jan2007_abc_001041_67.es: UTF-8 Unicode text and my locale is $ locale LANG=en_US.UTF-8 LC_CTYPE="en_US.UTF-8" LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_PAPER="en_US.UTF-8"...

...2770 doing parameter directory security mask = 2770 doing parameter read only = No doing parameter force create mode = 2770 doing parameter force directory mode = 2770 pm_process() returned Yes Attempting to register new charset UCS-2LE Registered charset UCS-2LE Attempting to register new charset UTF-16LE Registered charset UTF-16LE Attempting to register new charset UCS-2BE Registered charset UCS-2BE Attempting to register new charset UTF-16BE Registered charset UTF-16BE Attempting to register new charset UTF8 Registered charset UTF8 Attempting to register new charset UTF-8 Registered charset...

Full_Name: Mikhail Bocharov Version: 2.2.1 OS: Linux Submission from: (NULL) (62.148.130.28) Cyrillic UTF8 letters are imaged incorrectly Sorry, but English is not my native language My operating system is Gentoo-linux. Now i want get the gparhics with russian title for example: plot(1:20, type='l', main='&#1059;&#1090;&#1077;&#1095;&#1082;&#1072;') instead of...

Looks like this could be locale related. Both of you are using non-US locales, and Sys.setlocale is not changing the last entry (LC_MESSAGES), which is as documented, but maybe somehow related. I can reproduce with Peters-iMac:r-release-branch pd$ LC_ALL=da_DK.UTF-8 BUILD-dist/bin/R --vanilla R version 3.2.1 beta (2015-06-07 r68485) -- "World-Famous Astronaut" Copyright (C) 2015 The R Foundation for Statistical Computing Platform: x86_64-apple-darwin13.4.0/x86_64 (64-bit) R is free software and comes with ABSOLUTELY NO WARRANTY. You are welcome t...

need to use romanian chars in wine. under KDE all is fine, with romanian and english languages, keyboard layout "winkeys", i can switch between english an romanian. but under wine i don't have romanian language. how can i fix that ? -- George Enescu 16/13 Hunedoara mobil: 0720301842 tel. : 0354401534

Hello, here is my problem: I have Wine-1.2.2 (on Ubuntu 10.10) and I'm trying to run windows application (writted on Visual Fox Pro 9 ) my command line is: Code: LC_ALL="ru_RU.UTF-8" wine shop.exe (without LC_ALL an error "Collating squesnce RUSSIAN not fund" ) In this case wine shows normalyy most of the windows and textboxes, and the MAINMRNU. But SUBMENUS are shown not in UTF-8 collation. http://img593.imageshack.us/i/encodingerror.jpg/ How can I fix th...

No, I don't think anyone is working on this. There's a fairly simple workaround for the UTF-16 and UTF-32 iconv issues: don't attempt to produce character vectors, produce raw vectors instead. (The "toRaw" argument to iconv() asks for this.) Raw vectors can contain embedded nulls. Character vectors can't, because internally, R is using 8 bit C strings, and the null...

On 01/05/2017 8:49 PM, Jack Kelley wrote: > Thanks for looking into this. > > A few notes regarding all the UTF encodings on Windows 10 ... This all stems from the ancient bad decision by Microsoft to translate LF characters to CR LF when writing text files. R passes 0A or 0A 00 or 0A 00 00 00 to the output routine (part of the C run-time), and it needs to figure out how many characters there are in tho...

...ld of R-devel. The sessioninfo() from the former is below. Here's what I see: If I set the locale, and trigger a namespace load, a version comparison gives NA, and I get an error. For example, in a new session started with R --vanilla from the terminal: > Sys.setlocale(locale='en_US.UTF-8');grid::gpar() [1] "en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_CA.UTF-8" Error in if (R_version_built_under < "3.0.0") stop(gettextf("package %s was built before R 3.0.0: please re-install it", : missing value where TRUE/FALSE needed I've tri...

R-devel community: I have encountered some unexpected behavior using iconv, which may be the source of errors I am getting when connecting to a UTF-16 -encoded SQL Server database. A simple example is below. When researching this problem, I found r-devel reports of the same problem in threads from June 2010 and February, 2016, and that bug #16738 was posted to Bugzilla as a result. However, I have not been able to determine if the error is...

...o this. This has nothing to do with R. This is the issue: $ locale locale: Cannot set LC_CTYPE to default locale: No such file or directory locale: Cannot set LC_MESSAGES to default locale: No such file or directory locale: Cannot set LC_ALL to default locale: No such file or directory LANG=en_US.UTF-8 LC_CTYPE="en_US.UTF-8" LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_PAPER="en_US.UTF-8" LC_NAME="en_US.UTF-8" LC_ADDRESS="en_US.UT...

...t;> Rebuilding the temporary build tree >>> stage 1.1: legacy release compatibility shims >>> stage 1.2: bootstrap tools >>> stage 2.1: cleaning up the object tree [...] rm -f termcap termcap.db termcap.5.gz termcap.5.cat.gz ===> share/timedef (cleandir) rm -f am_ET.UTF-8.out be_BY.CP1131.out be_BY.CP1251.out be_BY.ISO8859-5.out be_BY.UTF-8.out bg_BG.CP1251.out bg_BG.UTF-8.out ca_ES.ISO8859-1.out ca_ES.UTF-8.out cs_CZ.ISO8859-2.out cs_CZ.UTF-8.out da_DK.ISO8859-1.out da_DK.UTF-8.out de_AT.ISO8859-1.out de_AT.UTF-8.out de_DE.ISO8859-1.out de_DE.UTF-8.out el_GR.ISO8...

...6 2017 13947 ... /path to/a/file/with/only/ascii/characters Thu Feb 2 14:17:16 2017 If i use debug=3, for every bugged line, I see a message : convert_string_internal: Conversion error: Illegal multibyte sequence() I'm using samba-3.6.25. the output of "locale" is : LANG=en_US.UTF-8 LANGUAGE= LC_CTYPE="en_US.UTF-8" LC_NUMERIC="en_US.UTF-8" LC_TIME="en_US.UTF-8" LC_COLLATE="en_US.UTF-8" LC_MONETARY="en_US.UTF-8" LC_MESSAGES="en_US.UTF-8" LC_PAPER="en_US.UTF-8" LC_NAME="en_US.UTF-8" LC_ADDRESS=&quo...