sup talk - Jan 2009 - UTF-8 woes

Sup is awesome! Good job, William! :-)

Yet, when using it for one day, some minor and less minor suckiness
and breakage in regard of non-english mails emerged as my recipients
started complaining about broken emails. I''m using sup/git under
64-bit arch linux with msmtp for sending, so maybe it would be better
with something sendmail-ish, have no idea, but still:

1. the subject with non-english (e.g, latvian accented) chars gets no
special treatment and safe encoding, and as such gets broken somewhere
on the wire,

2. something about the message text, probably missing
"Content-Transfer-Encoding: 8bit" makes my emails with latvian
characters explode with ugliness for my poor recipients on Outlook;

3. The minor glitch that the Sup''s display is slightly messed up, if
the message contains multi-byte characters in headers -- fixed either
very nicely by extending String with length_utf8 (and substr_utf8, and
others as needed) function, and replacing s.length with s.length_utf8
in lib/sup/buffer.rb or by going the ugly way of assuming that all
strings are and will be utf-8 and dropping a horrendous monkeypatch
into the lib/sup/util.rb with

class String
+  def length
+    self.scan(/./u).size
+  end


To see what exactly is wrong with the sending of mails I compared of
how the same mail is sent by mutt and how -- by sup. You can see the
mails here: http://spicausis.lv/sup/ where mail-mutt.txt is good,
mail-sup.txt is bad.

My ruby skills are non-existant yet, but I guess I''ll try to whip up
patches for these things today, if somebody with more ruby and sup and
mta shizzle don''t beat me to that.


Cheers,

Einar Lielmanis

Hi,

I''m also struck by Sup''s UTF-8 weirdnesses,
and can''t get German szetz to display correctly
(and they mess with the line width as well).
The other umlauts work though, and I don''t know why.

I''d also appreciate work on sending utf-8,
though subject encoding is a weird beast.
(And my ruby skills are ''by transfer'' only as well).

So long,
Tyberius Prime
> 2. something about the message text, probably missing
> "Content-Transfer-Encoding: 8bit" makes my emails with latvian
> characters explode with ugliness for my poor recipients on Outlook;
> 
> 3. The minor glitch that the Sup''s display is slightly messed up,
if
> the message contains multi-byte characters in headers -- fixed either
> very nicely by extending String with length_utf8 (and substr_utf8, and
> others as needed) function, and replacing s.length with s.length_utf8
> in lib/sup/buffer.rb or by going the ugly way of assuming that all
> strings are and will be utf-8 and dropping a horrendous monkeypatch
> into the lib/sup/util.rb with
> 
> class String
> +  def length
> +    self.scan(/./u).size
> +  end
> 
> 
> To see what exactly is wrong with the sending of mails I compared of
> how the same mail is sent by mutt and how -- by sup. You can see the
> mails here: http://spicausis.lv/sup/ where mail-mutt.txt is good,
> mail-sup.txt is bad.
> 
> My ruby skills are non-existant yet, but I guess I''ll try to whip
up
> patches for these things today, if somebody with more ruby and sup and
> mta shizzle don''t beat me to that.
> 
> 
> Cheers,
> 
> Einar Lielmanis