UnicodeDecodeError

[mapopescu]

Hi,

Thanks for the great work so far!

I had this error:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 152: ordinal not in range(128)

I am using an account with 2-steps authentication (sign in OK).
My system is Windows 7 32 bit English, Python 2.7.

I modified one file
messageinfo.py
__newestMessageSec = time.mktime([1970, 1, 1, 0, 0, 0, 0, 0, 0])
->
__newestMessageSec = time.mktime([1980, 1, 1, 0, 0, 0, 0, 0, 0])

Here is the full error message:
..
[2012-01-30 16:37:21,589] Logging out
[2012-01-30 16:37:22,026] Identifying "me" messages
Traceback (most recent call last):
File "main.py", line 251, in
message_infos = GetMessageInfos(opts)
File "main.py", line 102, in GetMessageInfos
for name, address in message_info.GetRecipients():
File "D:\Marius\npinto-mail-trends\messageinfo.py", line 81, in GetRecipients
tos + ccs + resent_tos + resent_ccs)
File "d:\python27\lib\email\utils.py", line 106, in getaddresses
all = COMMASPACE.join(fieldvalues)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 152: ordinal not in range(128)

Thanks again,
Marius

[npinto]

Marius,

What is the output of locale on your machine ?

N

[mapopescu]

Nicolas,

(None, None) 

> > > locale.getdefaultlocale()
> > > ('fr_FR', 'cp1252')
> > > locale.localeconv()
> > > {'mon_decimal_point': '', 'int_frac_digits': 127, 'p_sep_by_space': 127, 'frac_d
> > > igits': 127, 'thousands_sep': '', 'n_sign_posn': 127, 'decimal_point': '.', 'int
> > > _curr_symbol': '', 'n_cs_precedes': 127, 'p_sign_posn': 127, 'mon_thousands_sep'
> > > : '', 'negative_sign': '', 'currency_symbol': '', 'n_sep_by_space': 127, 'mon_gr
> > > ouping': [], 'p_cs_precedes': 127, 'positive_sign': '', 'grouping': []}```

Is this what you need?

Marius

[npinto]

This looks like a locale problem. Please update to include Unicode (UTF-8), e.g. fr_FR.UTF-8

[mapopescu]

Hi,

I guess you mean calling setlocale.
It doesn't work with fr_FR.UTF-8, nor with
>>> locale.setlocale(locale.LC_CTYPE, 'fr_FR.ISO8859-1') locale.Error: unsupported locale setting

I tried, this is the one that works:

'French_France.1252'

> > > locale.getlocale()
> > > ('fr_FR', 'cp1252')```

Thanks for your help, I'll try again the whole script using this locale.

Marius

[mapopescu]

I just tried again, same error.
Probably I need to find out how to choose a Unicode locale in Windows.
I tried all aliases I found in my locale.py file, all Unicode french ones don't work, unsupported locale.

Another track I'm looking at is to add decoding of the headers before calling email.utils.getaddresses in message_info.GetRecipients():
all_recipients = email.utils.getaddresses( tos + ccs + resent_tos + resent_ccs)
maybe using pyzmail.

I'll take a look after my holiday, in about 2 weeks.

Marius

[npinto]

Ok let me know how it goes, it's hard for me to debug this since I don't use Windows.

[ngulden]

Hi,

I have the same error:
[2013-03-30 19:35:37,560] Logging out
[2013-03-30 19:35:37,854] Identifying "me" messages
Traceback (most recent call last):
File "main.py", line 251, in
message_infos = GetMessageInfos(opts)
File "main.py", line 102, in GetMessageInfos
for name, address in message_info.GetRecipients():
File "/home/nico/dev/src/mail-trends/messageinfo.py", line 81, in GetRecipients
tos + ccs + resent_tos + resent_ccs)
File "/usr/lib/python2.7/email/utils.py", line 106, in getaddresses
all = COMMASPACE.join(fieldvalues)
UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position 152: ordinal not in range(128)

My system: Debian Testing. Python 2.7.3.
echo $LANG → de_DE.UTF-8

import locale
locale.getdefaultlocale()
('de_DE', 'UTF-8')

[ngulden]

Update: I just saw, I checked out the original repository. Trying your checkout, the problem does not occur as reported. Everything seems fine for me. Thanks.