Skip to content

Encoding issues with SQLite #73

@gpoo

Description

@gpoo

As reported by @MishiR in issue #72, it seems to be encoding issues when storing the data on SQLite.

sqlalchemy.exc.ProgrammingError: (sqlite3.ProgrammingError)
You must not use 8-bit bytestrings unless you use a text_factory that can interpret 8-bit bytestrings (like text_factory = str).
It is highly recommended that you instead just switch your application to Unicode strings
[SQL: u'INSERT INTO messages (message_id, mailing_list_url, mailing_list, first_date,
                              first_date_tz, arrival_date, arrival_date_tz, subject,
                              message_body, is_response_of, mail_path)
 VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)']
[parameters: (
 u'<86aemzeylb.fsf@einstein.home-of-linux.org<mailto:86aemzeylb.fsf@einstein.home-of-linux.org>>',
 'https://mail.gnome.org/archives/gnome-devel-list',
 None,
'1999-12-25 18:09:52.000000',
 3600.0,
 '2000-05-11 23:18:34.000000',
 None,
 u'Re: Solaris_x86, libgtop and kstat...',
 u"Markus D\xf6hr <doehrm@aubi.de<mailto:doehrm@aubi.de>> writes:\n\n> I'm tryin' to compile gnome-utils-1.0.50 on a Intel SunOS 5.7 after\n> following the excellent document ... (1367 characters truncated) ... 't list -lkstat as a dependency -\nI'll fix this in LibGTop asap.\n\n-- \nMartin Baulig - martin@home-of-linux.org<mailto:martin@home-of-linux.org> - http://www.home-of-linux.org<http://www.home-of-linux.org/>\n\n", 'Markus D\xf6hr\'s message of "Thu, 23 Dec 1999 03:55:25 +0100"',
 None)]

The command line executed was:

$ sudo mlstats --db-driver=sqlite --db-name=gnome.db https://mail.gnome.org/archives/gnome-devel-list/

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions