[dev] Refactoring: Decrypted messages will be checked if they can be encrypted.  If they can not, reject them and send DSN.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11302 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Refactoring: Now envelope sender (return-path) of outgoing messages need not be stored into bulkmailer table.
- $message->{envelope_sender} will be modified by Sympa::Mail::sending() and included into serialized message content.
- As a result, returnpath_bulkmailer column is no longer used.

ToDo: Migration of {envelope_sender} attribute during upgrade.
ToDo: Switch bulk spool from DB table to filesystem.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11301 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Refactoring: Now original message ID of messages need not be stored into bulkmailer and bulkspool tables.
- $message->{message_id} is encoded into serialized message content.
- As a result, messageid_bulkmailer and messageid_bulkspool columns are no longer used.

ToDo: Migration of {message_id} attribute during upgrade.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11300 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[-bug] Message distribution fails when tracking feature is enabled with Postfix MTA.  Because Postfix clone of sendmail command doesn't allow "-V envid" but "-Venvid".

Note:
Postfix 2.3 or later is required to use tracking feature.
Recent versions of Sendmail and Courier also supports it.
Exim and qmail seem not to be supported.

Additionally, options given to sendmail command will be terminated by "--" (double hyphen) to handle recipient addresses begining with "-".  This feature is available on Sendmail V8 or later and clones of it (at least Courier, exim, Postfix and qmail).


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11299 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11298 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11297 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- $message->{shelved}{smime_sign} & $message->{shelved}{smime_encrypt} attributes are set to indicate signing/encryption are required.
- Messages are checked if encryption is possible on all recipients before they are stored into bulk spool.
- As a side effect, messages sent by robots will be signed if keys are available.

Known issue: This feature won't be applied to the messages stored into bulk spool before upgrading.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11296 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- $message->{shelved}{tracking} attribute is set to indicate tracking is required.  Possible values are "verp", "dsn", "mdn" and "dsn+mdn".
- As a result, verp_bulkmailer and tracking_bulkmailer columns are no longer used.

ToDo: Migration of {shelved}{tracking} attributes during upgrade.



git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11295 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11294 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

N.B. On "||" operator: MySQL treats it as logical OR.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11293 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11292 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11290 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- $message->{shelved}{merge} attribute is set to indicate personalization is required.
- As a result, merge_bulkmailer columns is no longer used.

ToDo: Migration of {shelved}{merge} attributes during upgrade.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11289 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Refactoring: Now DKIM parameters are retrieved by bulk.pl: they need not be stored into bulkspool table.
- $message->{shelved} attribute is set to indicate DKIM signing is required, instead of passing DKIM parameters.
- As a result, dkim_*_bulkspool columns are no longer used.

ToDo: Migration of {shelved}{dkim_sign} attributes during upgrade.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11288 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11287 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Refactoring: Sympa::Mail::mail_file() is deprecated; instead, use Sympa::Message->new_from_template() and Sympa::Mail::sending().

Known bug:
Command messages sent via wwsympa.fcgi by users don't have sufficient authentication level.  "md5" level is required.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11286 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

ToDo: verify should also be performed by this CPAN module.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11285 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11284 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11283 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11282 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11281 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- Optional modules are lazily loaded with "eval 'use MODULE'" in BEGIN phase, and be checked availability testing $MODULE::VERSION variable which all modern CPAN modules will have.
- tools::smime_parse_cert(): Now it takes arguments with plain hash instead of hashref.
- tools::smime_find_keys(): Now it takes context (Sympa::List or site) instead of directory.
- List::get_cert() returns scalar instead of array.
- Use Crypt::OpenSSL::X509 instead of openssl to parse certificates.
- Use list-style open() to open pipes.

Issues:
- Certificates and keys for sympa and/or listmaster should be able to be prepared per robots;
- and they should be placed in $robot->{etc}, instead of "$robot->{home}/sympa".
- Use any CPAN module instead of "openssl pkcs7" to extract certificates in signed messages.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11280 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

ToDo: Use Crypt::OpenSSL::PKCS12 instead of openssl, though recent version of this module is broken.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11279 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11278 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- chk_cert_expiration(): Use Crypt::OpenSSL::X509 instead of openssl to parse certificates.
- update_crl(): Use LWP::UserAgent instead of wget to get CRLs.

ToDo:
- openssl is still used to parse CRLs: Currently Crypt::OpenSSL::X509 cannot parse CRLs.
- Verify revokation of certificates according to CRLs.
- Tasks above have not been enabled.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11277 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11276 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11275 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11274 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

Exceptions:
- Several functions in List were moved to Robot.
- SympaTransport was renamed to Sympa::SOAP::Transport.

Following files won't be renamed at present:
  Log.pm, SDM.pm, tools.pm, tt2.pm, wwslib.pm


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11273 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11271 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Deprecated Sympa::Family::get_family_lists() and Sympa::Family::get_hash_family_lists().  Use List::get_lists($family) instead.

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11270 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- do_search_list carrys out case-insensitive substring match with name and/or subject of lists, being aware Unicode foldcase.
- do_get_inactive_lists ignores family_closed lists along with closed lists.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11269 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] List::check_list_authz() is obsoleted: It is identical to Scenario::request_action().  As a side work, Scenario::check_auth() takes List, robot or site as parameter.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11268 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- Obsoleted tools::pictures_filename(): Use the new $list->find_picture_filenames().
- Obsoleted tools::make_pictures_url(): Use the new $list->find_picture_url().
- New: $list->find_picture_paths(), $list->get_picture_path() and $list->get_picture_url().

As a side work, pictures_max_size parameters now may be configured per robots.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11267 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] (con'd r11129) Limit result of get_which() according to your_lists_size parameter so that memory and time will be reduced.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11255 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] New Message::dup() to clone Message instance.  Don't use Storable::dclone() because {list} attributes should be multiton instnace and must not be cloned.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11254 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

- Updating use list.
- Message: naming serialized data as $serialized.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11253 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11252 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] Digest: re-encode messages only for plaindigest.  As a result, messages included in mimedigest won't be altered.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11251 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11250 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce