MailRoadmap

Differences between revisions 6 and 27 (spanning 21 versions)
Revision 6 as of 2005-04-27 07:01:49
Size: 6126
Editor: intern146
Comment: Woohoo!!! Jeff saves! (Stomping changes made, please don't edit this page now)
Revision 27 as of 2008-08-06 16:19:13
Size: 7271
Editor: localhost
Comment: converted to 1.6 markup
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
## page was renamed from MailRoadmap
Line 8: Line 9:
  * Created: [[Date(2005-04-24T00:21:03Z)]] by MattZimmerman[[BR]]
  * Priority: LowPriority[[BR]]
  * People: LaMontJonesLead, JeffBaileySecond[[BR]]
  * Contributors: MattZimmerman[[BR]]
  * Interested: SebastienBacher[[BR]]
  * Status: BrainDump
, BreezyGoal, UduBof, DistroSpecification[[BR]]
  * Packages: [[BR]]
  * Depends: [[BR]]

  * UduSessions: 1(0)[[BR]]
  * Created: <<Date(2005-04-24T00:21:03Z)>> by MattZimmerman<<BR>>
  * Priority: LowPriority<<BR>>
  * People: LaMontJonesLead, JeffBaileySecond<<BR>>
  * Contributors: MattZimmerman<<BR>>
  * Interested: SebastienBacher<<BR>>
  * Status: LaMontJonesQueue
,BreezyGoal, DistroSpecification, EditedSpecification, MarkShuttleworthQueue<<BR>>
  * Packages: <<BR>>
  *
Depends: <<BR>>
  * UduSessions: 1(0)<<BR>>
Line 22: Line 23:
Spam bad, mmkay?

There are two common formats of storing mail on a Uni
x system: mbox and maildir. mbox is the older generation with several known issue, such as locking, corruption, and size. Maildir is a newer format defined by Daniel Bernstein that addresses these three limitations.
There are two common formats of storing mail on a Unix system: `mbox` and `Maildir`. `mbox` is the older generation with several known issue, such as locking, corruption, and size. `Maildir` is a newer format defined by Daniel Bernstein (djb) that addresses these three limitations.
Line 28: Line 27:
An enduser configuring their Evolution will never be aware that email is accumulating in their local account warning them of various system events.

Spam bad, mmkay?

Various implementation of MTA and spam processing applications have varying levels of support for mbox and maildir. For seamless integration of these, we need to chose a single default.
An end-user configuring their Evolution mail client will never be aware that email is accumulating in their local account warning them of various system events.

Various implementation of MTA and spam processing applications have varying levels of support for `mbox` and `Maildir`. For seamless integration of these, we should choose a single default.
Line 36: Line 33:

---- /!\ '''Edit conflict - other version:''' ----

---- /!\ '''Edit conflict - your version:''' ----
 * Grandma Sue has a harddrive that is failing. She needs to be notified that this is happening.

 * Spam bad, mmkay?

 * In a server environment, our preferred pop3, imap4 and mail reading solutions should all work automatically when installed.


---- /!\ '''End of edit conflict''' ----
 * Remove the MTA from the base system
 * Provide spam filtering out of the box
 * Maildir by default ([http://www.ubuntu.com/wiki/MailStorageStandardisation MailStorageStandardisation])
 * Delivery into homedir by default ([http://www.ubuntu.com/wiki/MailStorageStandardisation MailStorageStandardisation])
 * Grandma Sue has a hard drive that is failing. She needs to be notified that this is happening.

 * In a server environment, our preferred pop3, imap4 and mail reading solutions should all work together automatically when installed.
Line 55: Line 39:

---- /!\ '''Edit conflict - other version:''' ----

---- /!\ '''Edit conflict - your version:''' ----
 * Prepare list of packages which expect an MTA, for what purpose, and propose alternative implementations

 * Remove the MTA from the base system

 * Need to make sure all instances of Depends: exim | mail-transport-agent, gets changed to postfix | mail-transfer-agent or dropped completely.

 * Need to reduce stupid mails for things like dangling symlinks.

 * Integrate with update-notifier to deliver critical notices.

 * Move MTAs to ship seed

 * Reenable questions in Postfix.

 * Ensure that release notes clearly say how to install ''lsb'' package.


---- /!\ '''End of edit conflict''' ----
 * During May:

  * Prepare list of packages which expect an MTA, for what purpose, and determine how to eliminate the dependency.

  * Analyze packages that reference mbox, Maildir, /var/spool/mail and/or /var/mail to see the level of work needed to add maildir support according to [[http://www.ubuntu.com/wiki/MailStorageStandardisation|MailStorageStandardisation]]
   * Make a recommendation which packages to fix and which packages to move to universe.
   * Prioritize the list according to base/desktop/ship/supported seeds.

  * Re-enable questions in Postfix.

  * Move `exim` and `postfix` to ship seed.

  * Make sure all instances of `Depends: exim | mail-transport-agent`, gets changed to `Depends: postfix | mail-transfer-agent` or dropped completely.

  * Debconf question for mbox or Maildir, ask it once, place the answer in `/etc/mailbox-format`

 * After May:

  * Ensure that mails for insignificant things like dangling symlinks are quenched.

  * Integrate with `update-notifier` to deliver remaining critical notices.

  * Ensure that release notes clearly say how to install ''lsb'' package.

  * Delivery into homedir by default ([[http://www.ubuntu.com/wiki/MailStorageStandardisation|MailStorageStandardisation]])

  * Move any mail using application that cannot support both mbox and Maildir to universe.

  * Ensure that default maildir path is set to `~/.maildir/`
Line 79: Line 71:
The user may have mail already collecting in the mailbox on the system. We will never recover this data.
Line 81: Line 75:

---- /!\ '''Edit conflict - other version:''' ----

---- /!\ '''Edit conflict - your version:''' ----
 * All mail using


---- /!\ '''End of edit conflict''' ----
 * Packages referencing mail-transport-agent, exim, or exim4:
  * `anacron`
  * `backuppc`
  * `courier-imap`
  * `courier-pop`
  * `cron`
  * `cyrus21-common`
  * `fetchmail`
  * `lsb`
  * `mailman`
  * `mailx`
  * `moin`
  * `mutt`
  * `procmail`
  * `reportbug`
  * `subversion-tools`
  * `ubuntu-base`

 * Packages referencing mbox or maildir:

  * `abiword`
  * `bash`
  * `control-center`
  * `courier`
  * `cricket`
  * `cyrus21-imapd`
  * `dasher`
  * `desktop-file-utils`
  * `devhelp`
  * `devscripts`
  * `dia`
  * `dict-foldoc`
  * `dict-gcide`
  * `dict-moby-thesaurus`
  * `dictd`
  * `doc-linux`
  * `dovecot`
  * `doxygen`
  * `dpkg`
  * `eagle-usb`
  * `emacs-goodies-el`
  * `emacs21`
  * `epiphany-browser`
  * `evolution`
  * `evolution-data-server`
  * `exim4`
  * `expect`
  * `festival`
  * `fetchmail`
  * `file-roller`
  * `flac`
  * `fltk1.1`
  * `gawk`
  * `gdb`
  * `gdm`
  * `gedit`
  * `gettext`
  * `gimp`
  * `gnome-app-install`
  * `gnome-games`
  * `gnome-icon-theme`
  * `gnome-libs`
  * `gnome-mime-data`
  * `gnome-pilot`
  * `gnome-pilot-conduits`
  * `gnome-themes`
  * `gnome-utils`
  * `gnumeric`
  * `gnus-5.10.6`
  * `graphviz`
  * `gsl`
  * `gst-plugins0.8`
  * `gstreamer0.8`
  * `gtk+1.2`
  * `gtk+2.0`
  * `gtkhtml3.6`
  * `gtkmm2.4`
  * `gtranslator`
  * `heimdal`
  * `hevea`
  * `htmldoc`
  * `hwdata`
  * `ia32-libs`
  * `imagemagick`
  * `ipolish`
  * `irssi-text`
  * `iso-codes`
  * `ispell`
  * `ispell-gl`
  * `jade`
  * `jadetex`
  * `kde-i18n`
  * `kdeaddons`
  * `kdeartwork`
  * `kdebase`
  * `kdegraphics`
  * `kdelibs`
  * `kdemultimedia`
  * `kdenetwork`
  * `kdepim`
  * `kdewebdev`
  * `krb4`
  * `krb5`
  * `lam`
  * `lapack3`
  * `lesstif1-1`
  * `libgd2`
  * `libgnomeui`
  * `libgsf`
  * `libiodbc2`
  * `libjpeg6b`
  * `libmailtools-perl`
  * `libmysqlclient-lgpl`
  * `libwmf`
  * `mailman`
  * `mutt`
  * `openoffice.org`
  * `pam`
  * `postfix`
  * `procmail`
  * `python-defaults`
  * `python2.3`
  * `python2.4`
  * `screem`
  * `shadow`
  * `twisted`
  * `zsh`
Line 91: Line 205:
 * Debconf questions need to be re-added for Postfix.

 * Need to prompt for preferred mailbox type at priority high. (No good default, but grandma should never be asked)
Line 93: Line 211:
 * Ongoing review of Free/Open Source Spam and virus prevention technologies with the goal of providing long term spam and virus solutions that extend across the life of the release.

 * Because effective spam filtering requires information only available at delivery time, and because spam scanning is resource intensive, spam filtering should happen on the server not the client.
Line 96: Line 218:
  * cron
  * debconf
  * sudo
  * `cron`
  * `debconf`
  * `sudo`
Line 106: Line 228:
  * The beginnings of this can be found in the [http://lists.ubuntu.com/archives/ubuntu-devel/2005-February/004207.html discussion] on ubuntu-devel from February. This discusses the packages then in ubuntu-base and ubuntu-desktop. Other main packages that Depend: mail-transport-agent will be changed to prefer postfix instead of exim or exim4.   * The beginnings of this can be found in the [[http://lists.ubuntu.com/archives/ubuntu-devel/2005-February/004207.html|discussion]] on ubuntu-devel from February. This discusses the packages then in `ubuntu-base` and `ubuntu-desktop`. Other main packages that `Depend: mail-transport-agent` will be changed to prefer Postfix instead of exim or exim4.
Line 113: Line 235:
---- /!\ '''Edit conflict - other version:''' ----
 * Please include [http://gmail-notify.sourceforge.net/ GMail Notifier] or something similar

---- /!\ '''Edit conflict - your version:''' ----

---- /!\ '''End of edit conflict''' ----





---- /!\ '''Edit conflict - other version:''' ----

---- /!\ '''Edit conflict - your version:''' ----

---- /!\ '''End of edit conflict''' ----

---- /!\ '''Edit conflict - other version:''' ----

---- /!\ '''Edit conflict - your version:''' ----
Line 136: Line 238:
  * cron
  * debconf
  * sudo
  * `cron`
  * `debconf`
  * `sudo`
Line 143: Line 245:
=== UDU Pre-Work ===

 * Prepare list of packages which expect an MTA, for what purpose, and proposed alternative implementations
  * The beginnings of this can be found in the [http://lists.ubuntu.com/archives/ubuntu-devel/2005-February/004207.html discussion] on ubuntu-devel from February. This discusses the packages then in ubuntu-base and ubuntu-desktop. Other main packages that Depend: mail-transport-agent will be changed to prefer postfix instead of exim or exim4.

= Suggestions/Notes =

 * What about replacing the MTA with SSMTP and configure all clients to use that as the standard smtp "gateway"?
  * Unfortunately, since this would have ubuntu-base Depend: ssmtp, it causes some of the very problems we're attempting to eliminate.






---- /!\ '''End of edit conflict''' ----
Eliminating MTA from Desktop
============================



Maildir by default
==================

 o mbox or maildir, asked once, share the answer. (/etc/mailbox-format)

 o Anything that can't do maildir needs to be moved to universe (probably already done)

 o Maildir lives in ~/.maildir/ (non-standard!!)

Spam
====


 o Spam filtering of any sort can be provided, but needs constant updates.

 o Spam filtering should happen on the server, not the client.

 o clamav can be provided, but needs constant updates.
----
CategoryUdu
CategorySpec

Mail Roadmap

Status

Introduction

Unix systems traditionally assume that mail to various accounts on the local system is being read, sent from, etc. On an Ubuntu desktop system, this generally isn't the case.

There are two common formats of storing mail on a Unix system: mbox and Maildir. mbox is the older generation with several known issue, such as locking, corruption, and size. Maildir is a newer format defined by Daniel Bernstein (djb) that addresses these three limitations.

Rationale

An end-user configuring their Evolution mail client will never be aware that email is accumulating in their local account warning them of various system events.

Various implementation of MTA and spam processing applications have varying levels of support for mbox and Maildir. For seamless integration of these, we should choose a single default.

Scope and Use Cases

  • Grandma Sue has a hard drive that is failing. She needs to be notified that this is happening.
  • In a server environment, our preferred pop3, imap4 and mail reading solutions should all work together automatically when installed.

Implementation Plan

  • During May:
    • Prepare list of packages which expect an MTA, for what purpose, and determine how to eliminate the dependency.
    • Analyze packages that reference mbox, Maildir, /var/spool/mail and/or /var/mail to see the level of work needed to add maildir support according to MailStorageStandardisation

      • Make a recommendation which packages to fix and which packages to move to universe.
      • Prioritize the list according to base/desktop/ship/supported seeds.
    • Re-enable questions in Postfix.
    • Move exim and postfix to ship seed.

    • Make sure all instances of Depends: exim | mail-transport-agent, gets changed to Depends: postfix | mail-transfer-agent or dropped completely.

    • Debconf question for mbox or Maildir, ask it once, place the answer in /etc/mailbox-format

  • After May:
    • Ensure that mails for insignificant things like dangling symlinks are quenched.
    • Integrate with update-notifier to deliver remaining critical notices.

    • Ensure that release notes clearly say how to install lsb package.

    • Delivery into homedir by default (MailStorageStandardisation)

    • Move any mail using application that cannot support both mbox and Maildir to universe.
    • Ensure that default maildir path is set to ~/.maildir/

Data Preservation and Migration

The user may have mail already collecting in the mailbox on the system. We will never recover this data.

Packages Affected

  • Packages referencing mail-transport-agent, exim, or exim4:
    • anacron

    • backuppc

    • courier-imap

    • courier-pop

    • cron

    • cyrus21-common

    • fetchmail

    • lsb

    • mailman

    • mailx

    • moin

    • mutt

    • procmail

    • reportbug

    • subversion-tools

    • ubuntu-base

  • Packages referencing mbox or maildir:
    • abiword

    • bash

    • control-center

    • courier

    • cricket

    • cyrus21-imapd

    • dasher

    • desktop-file-utils

    • devhelp

    • devscripts

    • dia

    • dict-foldoc

    • dict-gcide

    • dict-moby-thesaurus

    • dictd

    • doc-linux

    • dovecot

    • doxygen

    • dpkg

    • eagle-usb

    • emacs-goodies-el

    • emacs21

    • epiphany-browser

    • evolution

    • evolution-data-server

    • exim4

    • expect

    • festival

    • fetchmail

    • file-roller

    • flac

    • fltk1.1

    • gawk

    • gdb

    • gdm

    • gedit

    • gettext

    • gimp

    • gnome-app-install

    • gnome-games

    • gnome-icon-theme

    • gnome-libs

    • gnome-mime-data

    • gnome-pilot

    • gnome-pilot-conduits

    • gnome-themes

    • gnome-utils

    • gnumeric

    • gnus-5.10.6

    • graphviz

    • gsl

    • gst-plugins0.8

    • gstreamer0.8

    • gtk+1.2

    • gtk+2.0

    • gtkhtml3.6

    • gtkmm2.4

    • gtranslator

    • heimdal

    • hevea

    • htmldoc

    • hwdata

    • ia32-libs

    • imagemagick

    • ipolish

    • irssi-text

    • iso-codes

    • ispell

    • ispell-gl

    • jade

    • jadetex

    • kde-i18n

    • kdeaddons

    • kdeartwork

    • kdebase

    • kdegraphics

    • kdelibs

    • kdemultimedia

    • kdenetwork

    • kdepim

    • kdewebdev

    • krb4

    • krb5

    • lam

    • lapack3

    • lesstif1-1

    • libgd2

    • libgnomeui

    • libgsf

    • libiodbc2

    • libjpeg6b

    • libmailtools-perl

    • libmysqlclient-lgpl

    • libwmf

    • mailman

    • mutt

    • openoffice.org

    • pam

    • postfix

    • procmail

    • python-defaults

    • python2.3

    • python2.4

    • screem

    • shadow

    • twisted

    • zsh

User Interface Requirements

  • Debconf questions need to be re-added for Postfix.
  • Need to prompt for preferred mailbox type at priority high. (No good default, but grandma should never be asked)

Outstanding Issues

  • Ongoing review of Free/Open Source Spam and virus prevention technologies with the goal of providing long term spam and virus solutions that extend across the life of the release.
  • Because effective spam filtering requires information only available at delivery time, and because spam scanning is resource intensive, spam filtering should happen on the server not the client.

UDU BOF Agenda

  • What to do about automated mail
    • cron

    • debconf

    • sudo

    • ...
  • Spam filtering
  • Mail storage

UDU Pre-Work

  • Prepare list of packages which expect an MTA, for what purpose, and proposed alternative implementations
    • The beginnings of this can be found in the discussion on ubuntu-devel from February. This discusses the packages then in ubuntu-base and ubuntu-desktop. Other main packages that Depend: mail-transport-agent will be changed to prefer Postfix instead of exim or exim4.

Suggestions/Notes

  • What about replacing the MTA with SSMTP and configure all clients to use that as the standard smtp "gateway"?
    • Unfortunately, since this would have ubuntu-base Depend: ssmtp, it causes some of the very problems we're attempting to eliminate.

UDU BOF Agenda

  • What to do about automated mail
    • cron

    • debconf

    • sudo

    • ...
  • Spam filtering
  • Mail storage


CategoryUdu CategorySpec

UbuntuDownUnder/BOFs/MailRoadmap (last edited 2008-08-06 16:19:13 by localhost)