search for: latin1

...ned there. > > I'm giving some easier reproducible examples: no need to install > half of tidyverse just to get citation("readr") : > >> x <- c("Ekstr\xf8m", "J\xf6reskog", "bi\xdfchen Z\xfcrcher") >> Encoding(x1) <- "latin1" >> xU <- iconv(x1, "latin1", "UTF-8") > >> Sys.setlocale("LC_CTYPE", "Chinese") > [1] "Chinese (Simplified)_People's Republic of China.936" >> >> iconv(x1, "latin1", "") # NA NA NA >...

...le", in the case mentioned there. I'm giving some easier reproducible examples: no need to install half of tidyverse just to get citation("readr") : > x <- c("Ekstr\xf8m", "J\xf6reskog", "bi\xdfchen Z\xfcrcher") > Encoding(x1) <- "latin1" > xU <- iconv(x1, "latin1", "UTF-8") > Sys.setlocale("LC_CTYPE", "Chinese") [1] "Chinese (Simplified)_People's Republic of China.936" > > iconv(x1, "latin1", "") # NA NA NA [1] NA NA NA > iconv(xU, &...

...xample. I would expect from reading the help for Encoding() that strsplit preserves the encoding for each resulting element, but for simple letters it gets lost. Also it seems that an Encoding() cannot be declared for simple letters. They remain in any case "unknown". In paste() "latin1" seems to dominate "unknown". What kind of characteristic of an object is the encoding? It does not show up as attribute and also str() does not give me any hint. Where can I find some explanation regarding encoding? Thanks Heinz ### Encoding() and strsplit u <- 'abc???...

...TIONS: 1 user has 1 blog 1 blog has 1 style and belongs to 1 category 1 blog has many articles 1 blog has many links 1 article has many comments MySQL database script: DROP TABLE IF EXISTS `users`; CREATE TABLE `users` ( `id` int(11) NOT NULL auto_increment, `login` varchar(80) character set latin1 default NULL, `cryptpassword` varchar(40) character set latin1 default NULL, `validkey` varchar(40) character set latin1 default NULL, `email` varchar(100) character set latin1 NOT NULL default '''', `newemail` varchar(100) character set latin1 default NULL, `ipaddr` varch...

...lved the problem when my characters on my website started showing the special characters. This was a partial success though. When I went back to phpMyAdmin and entered new text the problem was the same, but reversed. What now happens is that the original text I typed is now converted to gibberish(Latin1 to UTF8) and new text entered, in phpMyAdmin, is output to website as "?" again See:- http://donsgarden.co.uk/pests/228?telephone=2 What I did, as I could not change the server Craracter_set and Collation (Shared Server). I got my host to change everything back to Latin1. I was going t...

...swfdec_as_interpret.c index 53116cb..57e6605 100644 --- a/libswfdec/swfdec_as_interpret.c +++ b/libswfdec/swfdec_as_interpret.c @@ -1942,7 +1942,7 @@ swfdec_action_char_to_ascii_5 (SwfdecAsC const char *s = swfdec_as_value_to_string (cx, val); char *ascii; - ascii = g_convert (s, -1, "LATIN1", "UTF8", NULL, NULL, NULL); + ascii = g_convert (s, -1, "LATIN1", "UTF-8", NULL, NULL, NULL); if (ascii == NULL) { /* This can happen if a Flash 5 movie gets loaded into a Flash 7 movie */ SWFDEC_FIXME ("Someone threw unconvertible text %s at F...

Hi everyone! I think I stumbled over a bug in the latest R 2.9.2 patched for OS X: > R version 2.9.2 Patched (2009-09-24 r49861) > i386-apple-darwin9.8.0 When I try to sort latin1-encoded character vectors, R sometimes crashes with a segmentation fault. I'm running OS X 10.5.8 and have observed this behaviour both with the i386 and x86_64 builds, in the R.app GUI as well as on the command line. Here's a minimal example that reliably triggers the crash on my m...

...ry's reply (https://stat.ethz.ch/pipermail/r-devel/2017-August/074830.html) in particular (thank you for the links and the bug report!). My initial posts were quite chaotic (and partly wrong), so I am trying to clear things up a bit. Actually, the title of my original message "special latin1 [characters] do not print as glyphs in current devel on windows" is already wrong, because the problem exists with characters with CP1252 encoding in the 80-9F (hex) range. Like Brian Ripley rightfully pointed out, latin1 != CP1252. The characters in the 80-9F code point range are not even...

Upon further inspection, I think these are at least two problems. First the issue with printing latin1/cp1252 characters in the "80" to "9F" code range. x <- c("?", "?", "?") Encoding(x) print(x) I assume that these are Unicode escapes!? (Given that Encoding(x) shows "latin1" I'd rather expect latin1/cp1252 escapes here, but these...

Hi Nir, I think latin1, How do you think we should handle latin1 errors then? Replace on latin1 or replace on utf-8? for codec in ["utf8", "latin1"]: try: return decode(b, codec) except: pass return decode(b, "utf8", errors="replace") (Pseudocode, will be implemente...

Thank you!. My apologies again for not including the console output in my message before. I sent another e-mail with the output in the meantime, so it should be a bit clearer now, what I am seeing. In case I missed something, please let me know. Yes, I am using latin1 and cp1252 interchangebly here, mostly because Encoding() is reporting the encoding as "latin1". You presumed correctly that my current/default locale's encoding is CP1252. (I also mentioned that my locale is LC_COLLATE=German_Germany.1252 before). As you are changing encodings, you...

...ting at line 244 in src/main/platform.c: #ifdef Win32 { char *ctype = setlocale(LC_CTYPE, NULL), *p; p = strrchr(ctype, '.'); if (p && isdigit(p[1])) localeCP = atoi(p+1); else localeCP = 0; /* Not 100% correct, but CP1252 is a superset */ known_to_be_latin1 = latin1locale = (localeCP == 1252); } #endif The "1252" should be "28591"; see https://msdn.microsoft.com/en-us/library/windows/desktop/dd317756(v=vs.85).aspx . > Daniel Possenriede <mailto:possenriede at gmail.com> > September 14, 2017 at 3:40 AM > This...

...jects from application strings on the guest (i.e. installed rpm, deb packages). It is documented that rpm package fields such as description should be utf8 encoded - however in some cases they are not a valid unicode string, on SLES11 SP4 the encoding of the description of the following packages is latin1 and they fail to be converted to unicode using guestfs_int_py_fromstring() (which invokes PyUnicode_FromString()): PackageKit aaa_base coreutils dejavu desktop-data-SLED gnome-utils hunspell hunspell-32bit hunspell-tools libblocxx6 libexif libgphoto2 libgtksourceview-2_0-0 libmpfr1...

...hey are using Latin-1 encodings. If they use extensions to Latin-1 then there are no guarantees that code written for strict Latin-1 will work.] On 01/08/2017 10:19, Daniel Possenriede wrote: > Upon further inspection, I think these are at least two problems. > First the issue with printing latin1/cp1252 characters in the "80" to "9F" > code range. > > x <- c("?", "?", "?") > Encoding(x) > print(x) > > I assume that these are Unicode escapes!? (Given that Encoding(x) shows > "latin1" I'd rather expec...

...or updates, and for various other reasons. Slackware is one of the rare distros that does not default to an utf8 system locale. The default is en_US, and since I use a french system, I chose fr_FR at euro for localization. There's a caveat in /etc/profile.d/lang.sh, justifying the choice of latin1 over utf8, so I complied to that. When working with PMB, I often go under the hood, open up a MySQL console and isse SQL statements from there. The app itself seems to favour latin1 over utf8. For example, when doing a backup database dump, the resulting dumpfile will be iso-8859-1. Now, as e...

Hi list! Short version: How do I convert a whole data.frame from latin1 encoding to utf8? I get SPSS files with latin1 encoding. My OS is GNU/Linux and the locale sv_SE.utf8, and I normally interface R with Emacs/ESS. I have used the following hack to convert a data.frame in latin1 to utf8: > Sys.setlocale(category = "LC_ALL", locale = "sv_SE.iso885...

...explains the observed behaviour. I am not very familiar with encodings/locales/codepages, but I will try to explain my observations as best I can. In R-2.9.2pat, when invoking R via Rgui --vanilla (output of seesionInfo() below), the output of Sweave for .rnw files containing german umlaute (latin1-encoded) is again latin1-encoded (the resulting .tex-file compiles with \usepackage[latin1]{inputenc} and \usepackage[german]{babel}). In R-2.10.0beta, however, when invoking R via Rgui --vanilla (output of seesionInfo() below), some of Sweave's output (more precisely, Soutput environments...

...es not seem to work whichever way I try. Following the recommendations on the R site and using the 'file' function to set the encoding breaks down at the first encounter with a Scandinavian character: THINK <- read.table(file("R_data/hs+sfnet.T.060505.tbl4", encoding="latin1"),header=TRUE) Warning messages: 1: invalid input found on input connection 'R_data/hs+sfnet.T.060505.tbl4' 2: incomplete final line found by readTableHeader on 'R_data/hs+sfnet.T.060505.tbl4' A sample exemplifying such characters as variable labels is below (for which the...

...ving some easier reproducible examples: no need to install >> half of tidyverse just to get citation("readr") : >> >>> x <- c("Ekstr\xf8m", "J\xf6reskog", "bi\xdfchen Z\xfcrcher") >>> Encoding(x1) <- "latin1" >>> xU <- iconv(x1, "latin1", "UTF-8") >> >>> Sys.setlocale("LC_CTYPE", "Chinese") >> [1] "Chinese (Simplified)_People's Republic of China.936" >>> >>> iconv(x1,...

Recent functionality in jsonlite allows for streaming json to a user supplied connection object, such as a file, pipe or socket. RFC7159 prescribes json must be encoded as unicode; ISO-8859 (including latin1) is invalid. Hence I would like R to write strings as utf8, irrespective of the type of connection, platform or locale. Implementing this turns out to be unsurprisingly difficult on windows. > string <- enc2utf8("Z?rich") > Encoding(string) [1] "UTF-8" For example whe...