pike.git/ src/ modules/ _WhiteFish/ whitefish.c

Branch: Tag:

2019-03-19

2019-03-19 12:33:55 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '722771973bd' into patches/lyslyskom22891031

* commit '722771973bd': (6177 commits)
Verify that callablep responses are aligned with reality.
...

2019-03-14

2019-03-14 10:39:03 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '2470270f500c728d10b8895314d8d8b07016e37b' into grubba/typechecker-automap

* commit '2470270f500c728d10b8895314d8d8b07016e37b': (18681 commits)
Removed the old typechecker.
...

2018-11-04

2018-11-04 16:11:11 by Arne Goedeke <el@laramies.com>

Merge remote-tracking branch 'origin/master' into new_utf8

2018-11-04 10:13:21 by Marcus Comstedt <marcus@mc.pp.se>

Merge remote-tracking branch 'origin/master' into gobject-introspection

2018-11-03

2018-11-03 15:16:32 by Martin Nilsson <nilsson@fastmail.com>

Added program.h to module.h

2018-11-03 14:21:37 by Marcus Comstedt <marcus@mc.pp.se>

Merge remote-tracking branch 'origin/8.1' into gobject-introspection

2018-08-05

2018-08-05 12:44:17 by Martin Nilsson <nilsson@fastmail.com>

Avoid sending function name to get_all_args

2018-02-15

2018-02-15 15:54:26 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e' into patches/pike63

* commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e': (19587 commits)
...

2018-02-03

2018-02-03 09:48:55 by Peter Bortas <bortas@gmail.com>

Merge branch '8.1' into peter/travis

2018-01-19

2018-01-19 16:32:48 by Martin Nilsson <nilsson@fastmail.com>

Add object.h to module.h

2018-01-18

2018-01-18 13:59:58 by Martin Nilsson <nilsson@fastmail.com>

Let module.h include some common includes.

2016-01-29

2016-01-29 19:09:28 by Martin Nilsson <nilsson@fastmail.com>

add_function to ADD_FUNCTION rewrites.

2015-05-25

2015-05-25 15:33:02 by Martin Nilsson <nilsson@opera.com>

Removed trailing spaces.

2014-12-04

2014-12-04 19:26:00 by Martin Nilsson <nilsson@opera.com>

More calloc conversions.

2014-12-04 19:23:41 by Jonas Walldén <jonasw@roxen.com>

2014-12-04 19:23:09 by Jonas Walldén <jonasw@roxen.com>

2014-12-04 19:23:09 by Jonas Walldén <jonasw@roxen.com>

2014-12-04 19:23:07 by Jonas Walldén <jonasw@roxen.com>

2014-12-04 19:23:07 by Jonas Walldén <jonasw@roxen.com>

2014-12-04 19:23:07 by Jonas Walldén <jonasw@roxen.com>

2014-11-02

2014-11-02 23:42:18 by Martin Nilsson <nilsson@opera.com>

Changed some malloc to calloc.

2014-09-04

2014-09-04 15:57:43 by Arne Goedeke <el@laramies.com>

Merge remote-tracking branch 'origin/8.0' into string_alloc

Conflicts:
src/stralloc.c

2014-09-03

2014-09-03 17:53:37 by Martin Nilsson <nilsson@opera.com>

memset is C89 and 4.3BSD

2014-08-23

2014-08-23 22:26:28 by Martin Nilsson <nilsson@opera.com>

Remove some module_magic remnants.

2014-04-27

2014-04-27 19:22:46 by Martin Nilsson <nilsson@opera.com>

More calloc conversions.

2014-01-05

2014-01-05 15:14:13 by Marcus Comstedt <marcus@mc.pp.se>

Merge branch '8.0' into gobject-introspection

2013-06-21

2013-06-21 09:18:55 by Arne Goedeke <el@laramies.com>

Merge remote-tracking branch 'origin/7.9' into pdf

2013-06-14

2013-06-14 09:47:27 by Jonas Walldén <jonasw@roxen.com>

Small doc fixes to match reality.

2013-06-14 09:33:10 by Jonas Walldén <jonasw@roxen.com>

Small doc fixes to match reality.

2013-02-05

2013-02-05 12:51:23 by Jonas Walldén <jonasw@roxen.com>

Fix bug in hit candidate selection which caused failures in phrase matching.
Part of [bug 6679 (#6679)].

2013-02-05 12:51:23 by Jonas Walldén <jonasw@roxen.com>

Revert "Fix phrase search when blob hit data isn't fully compacted." since
the main problem was traced to incorrect blob generation that was corrected in
266979fe5 and 1a418e776. (Another logic bug remains that will be fixed in a
separate commit.)

This reverts commit 6665cb230 and 93f452bee3.

2013-02-05 12:50:58 by Jonas Walldén <jonasw@roxen.com>

Fix bug in hit candidate selection which caused failures in phrase matching.
Part of [bug 6679 (#6679)].

2013-02-05 12:48:47 by Jonas Walldén <jonasw@roxen.com>

Revert "Fix phrase search when blob hit data isn't fully compacted." since
the main problem was traced to incorrect blob generation that was corrected in
1d8d7d4 and cb010f1. (Another logic bug remains that will be fixed in a
separate commit.)

This reverts commit 231560ec and 0c159c1e9.

2013-01-29

2013-01-29 18:52:24 by Jonas Walldén <jonasw@roxen.com>

Fix last commit since 0 is a valid base_hit index.

2013-01-29 18:52:00 by Jonas Walldén <jonasw@roxen.com>

Fix last commit since 0 is a valid base_hit index.

2013-01-29 18:03:09 by Jonas Walldén <jonasw@roxen.com>

Fix phrase search when blob hit data isn't fully compacted.

The logic for phrase search was broken with regards to how blob state was
advanced after testing a phrase candidate. The symptom was typically that
some phrases failed to match as expected until running a database compactor
script. Fixes [bug 6679 (#6679)].

2013-01-29 18:02:49 by Jonas Walldén <jonasw@roxen.com>

Keep blob feeders separate when same word occurs multiple times in a query.

The blobfeeder hook now gets a opaque stream ID in order to distinguish separate
instances of the same word. This fixes search results for phrase searches
like "foo bar foo".

Conflicts:
src/modules/_WhiteFish/blob.c

2013-01-29 17:59:59 by Jonas Walldén <jonasw@roxen.com>

Fix phrase search when blob hit data isn't fully compacted.

The logic for phrase search was broken with regards to how blob state was
advanced after testing a phrase candidate. The symptom was typically that
some phrases failed to match as expected until running a database compactor
script. Fixes [bug 6679 (#6679)].

2013-01-29 17:42:59 by Jonas Walldén <jonasw@roxen.com>

Keep blob feeders separate when same word occurs multiple times in a query.

The blobfeeder hook now gets a opaque stream ID in order to distinguish separate
instances of the same word. This fixes search results for phrase searches
like "foo bar foo".

2011-04-25

2011-04-25 16:12:49 by Martin Stjernholm <mast@lysator.liu.se>

No more foreign_idents.

2011-04-25 16:11:00 by Martin Stjernholm <mast@lysator.liu.se>

No more foreign_idents.

2011-03-09

2011-03-09 13:43:59 by Martin Nilsson <nilsson@opera.com>

RCSID isn't very useful in git.

2010-10-06

2010-10-06 11:58:09 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge branch 'pike-modules/whitefish/4.5' into 7.4

2010-10-06 11:33:37 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit 'whitefish_split_4.5_5.0' into whitefish-fixup

This is in preparation to fixup Search.Process as well.

2010-10-06 10:14:50 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge remote branch 'pike-modules/whitefish/5.0' into 7.9

Updated Search.Utils and Search.Process to a non-roxen context.

Conflicts:
.gitattributes
.gitignore
lib/modules/.autodoc

2010-10-06 09:45:07 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge branch 'pike-modules/whitefish/5.0' into 7.8

Updated Search.Utils and Search.Process to a non-roxen context.

Conflicts:
.gitattributes
.gitignore
lib/modules/.autodoc

2004-08-07

2004-08-07 15:27:00 by Johan Schön <js@opera.com>

Merge from external js/per/nilsson fork

Rev: lib/modules/Search.pmod/Database.pmod/Base.pike:1.5
Rev: lib/modules/Search.pmod/Database.pmod/Base.pmod:1.20(DEAD)
Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.77
Rev: lib/modules/Search.pmod/Filter.pmod/Base.pike:1.16
Rev: lib/modules/Search.pmod/Filter.pmod/HTML.pmod:1.37
Rev: lib/modules/Search.pmod/Filter.pmod/Output.pike:1.1
Rev: lib/modules/Search.pmod/Filter.pmod/PDF.pmod:1.16
Rev: lib/modules/Search.pmod/Filter.pmod/PlainText.pmod:1.9
Rev: lib/modules/Search.pmod/Filter.pmod/Word.pmod:1.12
Rev: lib/modules/Search.pmod/Grammar.pmod/AbstractParser.pike:1.7
Rev: lib/modules/Search.pmod/Grammar.pmod/DefaultParser.pike:1.11
Rev: lib/modules/Search.pmod/Grammar.pmod/Lexer.pmod:1.7
Rev: lib/modules/Search.pmod/Grammar.pmod/module.pmod:1.12
Rev: lib/modules/Search.pmod/Indexer.pmod:1.17
Rev: lib/modules/Search.pmod/MergeFile.pike:1.1
Rev: lib/modules/Search.pmod/Process.pmod:1.12
Rev: lib/modules/Search.pmod/Query.pmod:1.26
Rev: src/modules/_WhiteFish/Makefile.in:1.7
Rev: src/modules/_WhiteFish/blob.c:1.34
Rev: src/modules/_WhiteFish/blobs.c:1.12
Rev: src/modules/_WhiteFish/buffer.c:1.13
Rev: src/modules/_WhiteFish/linkfarm.c:1.5
Rev: src/modules/_WhiteFish/resultset.c:1.24
Rev: src/modules/_WhiteFish/resultset.h:1.9
Rev: src/modules/_WhiteFish/whitefish.c:1.35

2003-02-18

2003-02-18 10:35:38 by Martin Stjernholm <mast@lysator.liu.se>

Compatibility fixes to compile with 7.2, 7.4 and 7.5.

Rev: src/modules/_WhiteFish/whitefish.c:1.34

2002-01-02

2002-01-02 12:48:46 by Johan Schön <js@opera.com>

Fixed memory leak (one blob struct leaked per blob that was used)

Rev: src/modules/_WhiteFish/blob.c:1.29
Rev: src/modules/_WhiteFish/blobs.c:1.8
Rev: src/modules/_WhiteFish/buffer.c:1.10
Rev: src/modules/_WhiteFish/whitefish.c:1.33

2001-07-31

2001-07-31 15:29:47 by Johan Schön <js@opera.com>

Removed the unused anchor field

Rev: lib/modules/Search.pmod/Database.pmod/Base.pmod:1.10
Rev: lib/modules/Search.pmod/Database.pmod/MySQL.pike:1.51
Rev: lib/modules/Search.pmod/Queue.pmod/MySQL.pike:1.2
Rev: lib/modules/Search.pmod/RankingProfile.pike:1.16
Rev: lib/modules/Search.pmod/Utils.pmod:1.19
Rev: src/modules/_WhiteFish/blob.c:1.26
Rev: src/modules/_WhiteFish/blob.h:1.13
Rev: src/modules/_WhiteFish/blobs.c:1.6
Rev: src/modules/_WhiteFish/whitefish.c:1.32

2001-07-04

2001-07-04 22:24:42 by Per Hedbor <ph@opera.com>

Words are now strings, not integers

Rev: src/modules/_WhiteFish/blob.c:1.25
Rev: src/modules/_WhiteFish/blob.h:1.12
Rev: src/modules/_WhiteFish/whitefish.c:1.31

2001-06-15

2001-06-15 02:12:32 by Per Hedbor <ph@opera.com>

Use wf_resultset_push instead of push_object. The former clears the set if it's empty (freeing the resultset pointer, thus making the |, &, add_ranking and - significantly faster for the case when one of the operands is the empty resultset.

Rev: src/modules/_WhiteFish/resultset.h:1.8
Rev: src/modules/_WhiteFish/whitefish.c:1.30

2001-05-31

2001-05-31 17:15:26 by David Norlin <norlin@roxen.com>

Fixed cut'n'paste typo.

Rev: src/modules/_WhiteFish/whitefish.c:1.29

2001-05-31 00:33:44 by Johan Schön <js@opera.com>

Also count very bad phrase matches as matches

Rev: src/modules/_WhiteFish/whitefish.c:1.28

2001-05-31 00:26:33 by Johan Schön <js@opera.com>

low_do_query_merge -> low_do_query_or

Rev: src/modules/_WhiteFish/whitefish.c:1.27

2001-05-31 00:19:26 by Johan Schön <js@opera.com>

Single word hits now give proximity 3 instead of 0

Rev: src/modules/_WhiteFish/whitefish.c:1.26

2001-05-30

2001-05-30 00:33:39 by Per Hedbor <ph@opera.com>

Removed debug

Rev: src/modules/_WhiteFish/whitefish.c:1.25

2001-05-29

2001-05-29 23:59:52 by Per Hedbor <ph@opera.com>

The phrase search now works if it gets correct input. However, this does not exactly always happen, since the blobs were broken (the sort function used signed char arithmetics and incorrect | << combinations. This is now fixed. Old databases were hopelessly borken, not that that was noticeable except for phrase searches (the hits inside the document blobs were rather creatively sorted)

Rev: src/modules/_WhiteFish/whitefish.c:1.24

2001-05-29 11:20:57 by Johan Schön <js@opera.com>

do_query_merge -> do_query_or

Rev: src/modules/_WhiteFish/whitefish.c:1.23

2001-05-28

2001-05-28 20:46:59 by Johan Schön <js@opera.com>

0x7ffffff -> 0x7fffffff (ha\!)

Rev: src/modules/_WhiteFish/whitefish.c:1.22

2001-05-28 18:17:07 by Per Hedbor <ph@opera.com>

Added cutoff and do_query_and

Rev: src/modules/_WhiteFish/whitefish.c:1.21

2001-05-28 12:33:40 by Per Hedbor <ph@opera.com>

(basically) a apping for links

Rev: src/modules/_WhiteFish/Makefile.in:1.6
Rev: src/modules/_WhiteFish/linkfarm.c:1.1
Rev: src/modules/_WhiteFish/linkfarm.h:1.1
Rev: src/modules/_WhiteFish/whitefish.c:1.20

2001-05-26

2001-05-26 12:16:56 by Per Hedbor <ph@opera.com>

Moving inner loops from pike to C.

Rev: src/modules/_WhiteFish/Makefile.in:1.5
Rev: src/modules/_WhiteFish/blob.c:1.18
Rev: src/modules/_WhiteFish/blob.h:1.9
Rev: src/modules/_WhiteFish/blobs.c:1.1
Rev: src/modules/_WhiteFish/blobs.h:1.1
Rev: src/modules/_WhiteFish/whitefish.c:1.19

2001-05-25

2001-05-25 18:39:32 by Per Hedbor <ph@opera.com>

Added phrase search and plugged a memleak

Rev: src/modules/_WhiteFish/buffer.c:1.4
Rev: src/modules/_WhiteFish/whitefish.c:1.18

2001-05-25 16:17:59 by Per Hedbor <ph@opera.com>

Fixed a bug.

Rev: src/modules/_WhiteFish/blob.c:1.14
Rev: src/modules/_WhiteFish/resultset.c:1.15
Rev: src/modules/_WhiteFish/whitefish.c:1.17

2001-05-25 15:55:20 by Per Hedbor <ph@opera.com>

Actually works

Rev: src/modules/_WhiteFish/blob.c:1.13
Rev: src/modules/_WhiteFish/blob.h:1.8
Rev: src/modules/_WhiteFish/resultset.c:1.14
Rev: src/modules/_WhiteFish/whitefish.c:1.16

2001-05-25 15:00:04 by Johan Schön <js@opera.com>

API changes, typo in get_all_args fixed

Rev: src/modules/_WhiteFish/whitefish.c:1.15

2001-05-25 14:29:14 by Per Hedbor <ph@opera.com>

Some changes

Rev: src/modules/_WhiteFish/blob.c:1.10
Rev: src/modules/_WhiteFish/blob.h:1.7
Rev: src/modules/_WhiteFish/whitefish.c:1.14

2001-05-25 12:48:04 by Per Hedbor <ph@opera.com>

Avoid infinite loops again

Rev: src/modules/_WhiteFish/whitefish.c:1.13

2001-05-25 12:13:07 by Per Hedbor <ph@opera.com>

Avoid infinite loop

Rev: src/modules/_WhiteFish/whitefish.c:1.12

2001-05-25 10:38:53 by Per Hedbor <ph@opera.com>

Sum the matrix

Rev: src/modules/_WhiteFish/whitefish.c:1.11

2001-05-25 10:25:38 by Per Hedbor <ph@opera.com>

For some reason all this code compiled on the first try. :-) It does most likely not work yet, though. Witness the birth of do_query_merge. :-)

Rev: src/modules/_WhiteFish/blob.c:1.9
Rev: src/modules/_WhiteFish/blob.h:1.6
Rev: src/modules/_WhiteFish/whitefish.c:1.10

2001-05-23

2001-05-23 16:00:27 by Johan Schön <js@opera.com>

Typo

Rev: src/modules/_WhiteFish/whitefish.c:1.9

2001-05-23 11:48:40 by Per Hedbor <ph@opera.com>

Compiling but untested writable _WhiteFish.Blob

Rev: src/modules/_WhiteFish/blob.c:1.5
Rev: src/modules/_WhiteFish/blob.h:1.5
Rev: src/modules/_WhiteFish/whitefish.c:1.8

2001-05-23 10:58:00 by Per Hedbor <ph@opera.com>

Abstraction, in preparation of writable _WhiteFish.Buffer objects

Rev: src/modules/_WhiteFish/Makefile.in:1.4
Rev: src/modules/_WhiteFish/blob.c:1.4
Rev: src/modules/_WhiteFish/blob.h:1.4
Rev: src/modules/_WhiteFish/buffer.c:1.1
Rev: src/modules/_WhiteFish/buffer.h:1.1
Rev: src/modules/_WhiteFish/configure.in:1.3
Rev: src/modules/_WhiteFish/whitefish.c:1.7

2001-05-22

2001-05-22 14:03:31 by Per Hedbor <ph@opera.com>

Removed 'field' argument from do_query_marge

Rev: src/modules/_WhiteFish/whitefish.c:1.6

2001-05-22 13:52:49 by Per Hedbor <ph@opera.com>

More Blob functions. The argument-getting and free-when-done part of do_query_merge done.

Rev: src/modules/_WhiteFish/whitefish.c:1.5

2001-05-22 13:52:27 by Per Hedbor <ph@opera.com>

More Blob functions. The argument-getting and free-when-done part of do_query_merge done.

Rev: src/modules/_WhiteFish/blob.c:1.2
Rev: src/modules/_WhiteFish/blob.h:1.2
Rev: src/modules/_WhiteFish/whitefish.c:1.4

2001-05-22 13:29:21 by Per Hedbor <ph@opera.com>

It's a start

Rev: src/modules/_WhiteFish/Makefile.in:1.3
Rev: src/modules/_WhiteFish/blob.c:1.1
Rev: src/modules/_WhiteFish/blob.h:1.1
Rev: src/modules/_WhiteFish/whitefish.c:1.3

2001-05-22 08:17:20 by Per Hedbor <ph@opera.com>

Working ResultSet class

Rev: src/modules/_WhiteFish/Makefile.in:1.2
Rev: src/modules/_WhiteFish/resultset.c:1.3
Rev: src/modules/_WhiteFish/resultset.h:1.2
Rev: src/modules/_WhiteFish/whitefish.c:1.2
Rev: src/modules/_WhiteFish/whitefish.h:1.2

2001-05-22 06:41:58 by Per Hedbor <ph@opera.com>

Skeleton

Rev: src/modules/_WhiteFish/.cvsignore:1.1
Rev: src/modules/_WhiteFish/Makefile.in:1.1
Rev: src/modules/_WhiteFish/acconfig.h:1.1
Rev: src/modules/_WhiteFish/configure.in:1.1
Rev: src/modules/_WhiteFish/resultset.c:1.1
Rev: src/modules/_WhiteFish/resultset.h:1.1
Rev: src/modules/_WhiteFish/testsuite.in:1.1
Rev: src/modules/_WhiteFish/whitefish.c:1.1
Rev: src/modules/_WhiteFish/whitefish.h:1.1