3305d8cd4d
fixes deb#433732 Date: Sun, 30 Sep 2007 13:54:56 -0400 From: Daniel Jacobowitz <drow@false.org> To: offlineimap@complete.org Subject: Assorted patches Here's the result of a lazy Sunday hacking on offlineimap. Sorry for not breaking this into multiple patches. They're mostly logically independent so just ask if that would make a difference. First, a new -q (quick) option. The quick option means to only update folders that seem to have had significant changes. For Maildir, any change to any message UID or flags is significant, because checking the flags doesn't add a significant cost. For IMAP, only a change to the total number of messages or a change in the UID of the most recent message is significant. This should catch everything except for flags changes. The difference in bandwidth is astonishing: a quick sync takes 80K instead of 5.3MB, and 28 seconds instead of 90. There's a configuration variable that lets you say every tenth sync should update flags, but let all the intervening ones be lighter. Second, a fix to the UID validity problems many people have been reporting with Courier. As discussed in Debian bug #433732, I changed the UID validity check to use SELECT unless the server complains that the folder is read-only. This avoids the Courier bug (see the Debian log for more details). This won't fix existing validity errors, you need to remove the local status and validity files by hand and resync. Third, some speedups in Maildir checking. It's still pretty slow due to a combination of poor performance in os.listdir (never reads more than 4K of directory entries at a time) and some semaphore that leads to lots of futex wake operations, but at least this saves 20% or so of the CPU time running offlineimap on a single folder: Time with quick refresh and md5 in loop: 4.75s user 0.46s system 12% cpu 41.751 total Time with quick refresh and md5 out of loop: 4.38s user 0.50s system 14% cpu 34.799 total Time using string compare to check folder: 4.11s user 0.47s system 13% cpu 34.788 total And fourth, some display fixes for Curses.Blinkenlights. I made warnings more visible, made the new quick sync message cyan, and made all not explicitly colored messages grey. That last one was really bugging me. Any time OfflineIMAP printed a warning in this UI, it had even odds of coming out black on black! Anyway, I hope these are useful. I'm happy to revise them if you see a problem. -- Daniel Jacobowitz CodeSourcery
115 lines
4.8 KiB
Python
115 lines
4.8 KiB
Python
productname = 'OfflineIMAP'
|
|
versionstr = "5.99.2"
|
|
|
|
versionlist = versionstr.split(".")
|
|
major = versionlist[0]
|
|
minor = versionlist[1]
|
|
patch = versionlist[2]
|
|
copyright = "Copyright (C) 2002 - 2007 John Goerzen"
|
|
author = "John Goerzen"
|
|
author_email = "jgoerzen@complete.org"
|
|
description = "Disconnected Universal IMAP Mail Synchronization/Reader Support"
|
|
bigcopyright = """%(productname)s %(versionstr)s
|
|
%(copyright)s <%(author_email)s>""" % locals()
|
|
|
|
banner = bigcopyright + """
|
|
This software comes with ABSOLUTELY NO WARRANTY; see the file
|
|
COPYING for details. This is free software, and you are welcome
|
|
to distribute it under the conditions laid out in COPYING."""
|
|
|
|
homepage = "http://software.complete.org/offlineimap/"
|
|
license = """Copyright (C) 2002 - 2007 John Goerzen <jgoerzen@complete.org>
|
|
|
|
This program is free software; you can redistribute it and/or modify
|
|
it under the terms of the GNU General Public License as published by
|
|
the Free Software Foundation; either version 2 of the License, or
|
|
(at your option) any later version.
|
|
|
|
This program is distributed in the hope that it will be useful,
|
|
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
|
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
|
|
GNU General Public License for more details.
|
|
|
|
You should have received a copy of the GNU General Public License
|
|
along with this program; if not, write to the Free Software
|
|
Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA"""
|
|
|
|
def getcmdhelp():
|
|
from offlineimap.ui import detector
|
|
import os
|
|
uilist = ""
|
|
for ui in detector.DEFAULT_UI_LIST:
|
|
uilist += " " + ui + os.linesep
|
|
return """
|
|
offlineimap [ -1 ] [ -P profiledir ] [ -a accountlist ] [
|
|
-c configfile ] [ -d debugtype[,debugtype...] ] [ -o ] [
|
|
-u interface ] [ -q ]
|
|
|
|
offlineimap -h | --help
|
|
|
|
-1 Disable all multithreading operations and use
|
|
solely a single-thread sync. This effectively sets
|
|
the maxsyncaccounts and all maxconnections configu-
|
|
ration file variables to 1.
|
|
|
|
-P profiledir
|
|
Sets OfflineIMAP into profile mode. The program
|
|
will create profiledir (it must not already exist).
|
|
As it runs, Python profiling information about each
|
|
thread is logged into profiledir. Please note:
|
|
This option is present for debugging and optimiza-
|
|
tion only, and should NOT be used unless you have a
|
|
specific reason to do so. It will significantly
|
|
slow program performance, may reduce reliability,
|
|
and can generate huge amounts of data. You must
|
|
use the -1 option when you use -P.
|
|
|
|
|
|
-a accountlist
|
|
Overrides the accounts section in the config file.
|
|
Lets you specify a particular account or set of
|
|
accounts to sync without having to edit the config
|
|
file. You might use this to exclude certain
|
|
accounts, or to sync some accounts that you nor-
|
|
mally prefer not to.
|
|
|
|
-c configfile
|
|
Specifies a configuration file to use in lieu of
|
|
the default, ~/.offlineimaprc.
|
|
|
|
-d debugtype[,debugtype...]
|
|
Enables debugging for OfflineIMAP. This is useful
|
|
if you are trying to track down a malfunction or
|
|
figure out what is going on under the hood. I sug-
|
|
gest that you use this with -1 in order to make the
|
|
results more sensible.
|
|
|
|
-d now requires one or more debugtypes, separated
|
|
by commas. These define what exactly will be
|
|
debugged, and so far include two options: imap and
|
|
maildir. The imap option will enable IMAP protocol
|
|
stream and parsing debugging. Note that the output
|
|
may contain passwords, so take care to remove that
|
|
from the debugging output before sending it to any-
|
|
one else. The maildir option will enable debugging
|
|
for certain Maildir operations.
|
|
|
|
-o Run only once, ignoring any autorefresh setting in
|
|
the config file.
|
|
|
|
-q Run only quick synchronizations. Ignore any flag
|
|
updates on IMAP servers.
|
|
|
|
-h, --help
|
|
Show summary of options.
|
|
|
|
-u interface
|
|
Specifies an alternative user interface module to
|
|
use. This overrides the default specified in the
|
|
configuration file. The UI specified with -u will
|
|
be forced to be used, even if its isuable() method
|
|
states that it cannot be. Use this option with
|
|
care. The pre-defined options, described in the
|
|
USER INTERFACES section of the man page, are:
|
|
""" + uilist
|