Introduced Sympa::Tools::Text::slurp() to slurp text file applying Unicode sanitization and normalization. Note: Though Unicode::Normalize and Unicode::UTF8 are optional now, they would be mandatory in the future.

Sympa::Tools::Text::wrap_text() consumes large amount of memory for large size of texts.  Reduce it.

Fixed by preventing folding words matching email regexp.

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12973 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12913 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[bug] File names generated by some applications on Mac OS X (uploaded files, files in ZIP archive, ...) may not be shown correctly on other platforms: Accents are shown separately.  Fixed by applying Normalization Form C (NFC) to file names.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12902 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12899 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12896 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12842 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

Sympa::get_url() supports four modes: default, omit, remote and local.  See documentation.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12721 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12713 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12706 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

They use new functions encode_uri() and mailtourl() in Sympa::Tools::Text.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12699 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12688 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

Old name                            New name
----------------------------------- ----------------------------------------
Sympa::Auth::password_fingerprint   Sympa::User::password_fingerprint
Sympa::Tools::WWW::_load_mime_types Conf::_load_mime_types
Sympa::Tools::WWW::get_mime_type    Conf::get_mime_type
tools::add_in_blacklist             _add_in_blacklist in wwsympa.fcgi
tools::addrencode                   Sympa::Tools::Text::addrencode
tools::clean_msg_id                 Sympa::Tools::Text::canonic_message_id
tools::escape_chars                 Sympa::Tools::Text::escape_chars
tools::escape_docname               Sympa::SharedDocument::escape_docname
tools::escape_html                  Sympa::Tools::WWW::escape_html_minimum
tools::escape_quote                 Sympa::Template::_escape_quote
tools::escape_url                   Sympa::Tools::Text::escape_url
tools::escape_xml                   Sympa::Template::_escape_xml
tools::eval_in_time                 Sympa::Process::eval_in_time
tools::get_list_params              Sympa::Robot::list_params
tools::get_message_id               Sympa::unique_message_id
tools::lang2charset                 Conf::lang2charset
tools::load_edit_list_conf          Sympa::List::_load_edit_list_conf
tools::qdecode_filename             Sympa::Tools::Text::qdecode_filename
tools::qencode_filename             Sympa::Tools::Text::qencode_filename
tools::qencode_hierarchy            Sympa::Tools::File::qencode_hierarchy
tools::unescape_chars               Sympa::Tools::Text::unescape_chars
tools::unescape_html                Sympa::Tools::WWW::unescape_html_minimum
tools::valid_email                  Sympa::Tools::Text::valid_email 
----------------------------------- ----------------------------------------

As a result, tools.pm was deprecated.

A few dependency loop among modules are reduced.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12677 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12612 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] New functions decode_filesystem_safe() and encode_filesystem_safe() in Sympa::Tools::Text.  Since they give more consistent result and are safer, they may be used instead of escape_chars(), qencode_filename() and so on in the future.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12433 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

[dev] tools::get_canonical_email() and tools::clean_email() are deprecated.  Use Sympa::Tools::Text::canonic_email() instead.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12426 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12083 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@12082 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11797 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce

Exception: tools::save_to_bad() is kept.


git-svn-id: https://subversion.renater.fr/sympa/branches/sympa-6.2-branch@11337 05aa8bb8-cd2b-0410-b1d7-8918dfa770ce