Branch: Tag:

2018-11-03

2018-11-03 14:21:37 by Marcus Comstedt <marcus@mc.pp.se>

Merge remote-tracking branch 'origin/8.1' into gobject-introspection

2018-02-15

2018-02-15 15:54:26 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e' into patches/pike63

* commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e': (19587 commits)
...

2015-05-26

2015-05-26 10:33:42 by Martin Nilsson <nilsson@opera.com>

Removed trailing spaces.

2014-08-15

2014-08-15 14:14:51 by Martin Nilsson <nilsson@opera.com>

Better MD5

2014-08-15 13:49:53 by Martin Nilsson <nilsson@opera.com>

static -> protected

2014-01-05

2014-01-05 15:14:13 by Marcus Comstedt <marcus@mc.pp.se>

Merge branch '8.0' into gobject-introspection

2013-09-13

2013-09-13 15:34:41 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue.MySQL: Removed redundant inherit.

Web.Crawler.Queue is already inherited via Search.Queue.Base.

2013-09-12

2013-09-12 21:16:23 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Added some AutoDoc.

2013-06-21

2013-06-21 09:18:55 by Arne Goedeke <el@laramies.com>

Merge remote-tracking branch 'origin/7.9' into pdf

2013-03-14

2013-03-14 10:32:51 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue.MySQL: Protect against interleaving SQL queries.

The Mysql database connection object is not reentrant,
so if multiple threads attempt to use the same connection
object at the same time, it will likely cause the error
"Lost connection to MySQL server during query".

In this case the function num_with_stage() could be called
to present ststus information while the queue was in use.

This patch fixes the problem by using thread local connections.

It also survives the database connection having gone stale.

2013-03-14 10:32:17 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue.MySQL: Protect against interleaving SQL queries.

The Mysql database connection object is not reentrant,
so if multiple threads attempt to use the same connection
object at the same time, it will likely cause the error
"Lost connection to MySQL server during query".

In this case the function num_with_stage() could be called
to present ststus information while the queue was in use.

This patch fixes the problem by using thread local connections.

It also survives the database connection having gone stale.

2012-04-01

2012-04-01 16:15:04 by Arne Goedeke <el@laramies.com>

Merge remote branch 'origin/7.9' into breaking_into_pieces

2012-01-17

2012-01-17 15:55:05 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue.MySQL: Support MySQL 4.1 and earlier.

2012-01-17 15:54:22 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue.MySQL: Support MySQL 4.1 and earlier.

2011-11-05

2011-11-05 15:15:24 by Martin Nilsson <nilsson@opera.com>

Added #pike directives.

2011-10-18

2011-10-18 08:58:28 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Fixed compat with old Mysql.

2011-10-18 08:57:42 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Fixed compat with old Mysql.

2011-05-25

2011-05-25 15:03:26 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Fixed typo.

2011-05-25 15:02:43 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Fixed typo.

2011-05-25 13:30:15 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Added get_schemes() and reset_stage().

2011-05-25 13:29:33 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Add an index on the uri field.

2011-05-25 13:26:21 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Added get_schemes() and reset_stage().

2011-05-25 13:24:51 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Search.Queue: Add an index on the uri field.

2010-10-26

2010-10-26 14:12:22 by Martin Stjernholm <mast@lysator.liu.se>

Reverted the move of Search.pmod from the Roxen module to Pike.

It stays in the Roxen Search module for Roxen <= 4.5, for compatibility. The
C-level part remains in Pike.

2010-10-25

2010-10-25 17:53:39 by Martin Stjernholm <mast@lysator.liu.se>

Added a function to be able to clear out uri's in the error stage.

2010-10-25 17:51:14 by Martin Stjernholm <mast@lysator.liu.se>

Added a function to be able to clear out uri's in the error stage.

2010-10-06

2010-10-06 11:58:09 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge branch 'pike-modules/whitefish/4.5' into 7.4

2010-10-06 11:33:37 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit 'whitefish_split_4.5_5.0' into whitefish-fixup

This is in preparation to fixup Search.Process as well.

2010-10-06 10:14:50 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge remote branch 'pike-modules/whitefish/5.0' into 7.9

Updated Search.Utils and Search.Process to a non-roxen context.

Conflicts:
.gitattributes
.gitignore
lib/modules/.autodoc

2010-10-06 09:45:07 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge branch 'pike-modules/whitefish/5.0' into 7.8

Updated Search.Utils and Search.Process to a non-roxen context.

Conflicts:
.gitattributes
.gitignore
lib/modules/.autodoc

2010-01-21

2010-01-21 10:03:27 by Jonas Wallden <jonasw@roxen.com>

Make sure get_extra() always returns a mapping. Should prevent the
backtrace reported in [bug 5073].

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.24

2008-08-15

2008-08-15 14:54:40 by Martin Stjernholm <mast@lysator.liu.se>

Moving to pike 7.8 and dropping compatibility with earlier pikes.

Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.88
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.23

2008-03-07

2008-03-07 13:04:50 by Martin Jonsson <marty@roxen.com>

Added the "ignore" keyword to the insert query in add_uri() to avoid a backtrace when multiple threads call add_uri() simultaneously (there's a race condition but it doesn't really matter except that we don't want a backtrace).

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.22

2007-11-16

2007-11-16 10:12:03 by Marcus Wellhardh <wellhard@roxen.com>

Fix for [RT 10311] (partial). Added support for purge so documents will be removed from the index, i.e. add documents to the deleted_document table when a directory/file are purged. Also added a new button "Run Database Maintenance" in the "Database Profile/DB Settings" tab.

Rev: lib/modules/Search.pmod/Database.pmod/Base.pike:1.6
Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.86
Rev: lib/modules/Search.pmod/Queue.pmod/Base.pike:1.2
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.21

2005-05-27

2005-05-27 11:39:52 by Martin Stjernholm <mast@lysator.liu.se>

Some pike 7.6 compat fixes.

Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.83
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.20

2003-09-01

2003-09-01 14:01:54 by Anders Johansson <anders@roxen.com>

Added missing cast causing compile error.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.19

2003-08-14

2003-08-14 14:55:31 by Mattias Andersson <matan@lysator.liu.se>

Also change the 'recurse' flag when index a file once more.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.18

2003-08-14 14:41:08 by Mattias Andersson <matan@lysator.liu.se>

New actions to update database according to changes in RuleSet and documents in stage 'error'.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.17

2002-08-06

2002-08-06 10:19:25 by Mattias Andersson <matan@lysator.liu.se>

Fixed [Bug 3197] concerning remove trailing index filename.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.16

2002-08-06 10:15:54 by Mattias Andersson <matan@lysator.liu.se>

Fixed [Bug 3197] concerning remove trailing index filename.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.13

2002-02-20

2002-02-20 17:27:06 by Johan Schön <js@opera.com>

Typo fix

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.15

2002-02-18

2002-02-18 15:11:28 by Johan Schön <js@opera.com>

Added clear_cache().

Rev: lib/modules/Search.pmod/Queue.pmod/Base.pmod:1.4
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.14

2002-02-18 13:18:13 by Johan Schön <js@opera.com>

Bug fix: Remove the entry in the cache when deleting an item from the queue.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.13

2001-12-17

2001-12-17 10:50:14 by Johan Schön <js@opera.com>

Run combine_path on the path segments of the URL to be added to the queue to avoid duplicates containing ../ etc.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.12

2001-08-27

2001-08-27 01:22:43 by Johan Schön <js@opera.com>

Added a comment about why this particular race condition workaround was needed.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.11

2001-08-26

2001-08-26 23:04:17 by Johan Schön <js@opera.com>

Rewrote the indexer to work in a threaded model if started with a single_process argument. Cleaned up debug messages.

Rev: lib/modules/Search.pmod/Queue.pmod/Base.pmod:1.3
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.10
Rev: lib/modules/Search.pmod/Utils.pmod:1.30

2001-08-20

2001-08-20 20:05:48 by Johan Schön <js@opera.com>

Added remove_uri.

Rev: lib/modules/Search.pmod/Queue.pmod/Base.pmod:1.2
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.9

2001-08-20 19:56:22 by Johan Schön <js@opera.com>

Fixed bug in add_uri.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.8

2001-08-14

2001-08-14 18:45:51 by Johan Schön <js@opera.com>

Typos.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.7

2001-08-14 18:45:37 by Johan Schön <js@opera.com>

Typos.

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.6

2001-08-14 18:40:46 by Johan Schön <js@opera.com>

Bugfix to the previous bugfix: Set stage to 0 if the added uri already exists, and it's stage is not 5 or 6

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.5

2001-08-14 18:30:16 by Johan Schön <js@opera.com>

Fixed bug: add_uri could add duplicate entries to the queue. Now also empties the cache when running clear().

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.4

2001-08-08

2001-08-08 11:01:25 by Per Hedbor <ph@opera.com>

UTF8-encode the URLs

Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.3

2001-07-31

2001-07-31 15:29:47 by Johan Schön <js@opera.com>

Removed the unused anchor field

Rev: lib/modules/Search.pmod/Database.pmod/Base.pmod:1.10
Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.51
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.2
Rev: lib/modules/Search.pmod/RankingProfile.pike:1.16
Rev: lib/modules/Search.pmod/Utils.pmod:1.19
Rev: src/modules/_WhiteFish/blob.c:1.26
Rev: src/modules/_WhiteFish/blob.h:1.13
Rev: src/modules/_WhiteFish/blobs.c:1.6
Rev: src/modules/_WhiteFish/whitefish.c:1.32

2001-07-05

2001-07-05 13:54:14 by Johan Schön <js@opera.com>

Moved queue to a separate module

Rev: lib/modules/Search.pmod/Queue.pmod/Base.pmod:1.1
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.1