Branch: Tag:

2019-05-04

2019-05-04 09:12:19 by Arne Goedeke <el@laramies.com>

Merge remote-tracking branch 'origin/master' into new_utf8

2019-04-16

2019-04-16 09:20:09 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Web: Protect lfuns.

2019-03-19

2019-03-19 12:33:55 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '722771973bd' into patches/lyslyskom22891031

* commit '722771973bd': (6177 commits)
Verify that callablep responses are aligned with reality.
...

2019-03-14

2019-03-14 10:39:03 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '2470270f500c728d10b8895314d8d8b07016e37b' into grubba/typechecker-automap

* commit '2470270f500c728d10b8895314d8d8b07016e37b': (18681 commits)
Removed the old typechecker.
...

2018-11-03

2018-11-03 14:21:37 by Marcus Comstedt <marcus@mc.pp.se>

Merge remote-tracking branch 'origin/8.1' into gobject-introspection

2018-02-15

2018-02-15 15:54:26 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Merge commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e' into patches/pike63

* commit '75c9d1806f1a69ca21c27a2c2fe1b4a6ea38e77e': (19587 commits)
...

2015-05-26

2015-05-26 10:33:42 by Martin Nilsson <nilsson@opera.com>

Removed trailing spaces.

2011-11-05

2011-11-05 15:02:44 by Martin Nilsson <nilsson@opera.com>

Removed $Id$.

2011-07-20

2011-07-20 16:10:00 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Web.Crawler: Support for URLs containing Unicode characters. Fixes [bug 5958].

2011-07-20 16:08:41 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Web.Crawler: Support for URLs containing Unicode characters. Fixes [bug 5958].

2011-07-20 16:07:48 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Web.Crawler: Support for URLs containing Unicode characters. Fixes [bug 5958].

2011-07-20 16:06:08 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Web.Crawler: Support for URLs containing Unicode characters. Fixes [bug 5958].

2011-04-25

2011-04-25 16:12:49 by Martin Stjernholm <mast@lysator.liu.se>

No more foreign_idents.

2011-04-25 16:12:40 by Martin Stjernholm <mast@lysator.liu.se>

No more foreign_idents.

2011-04-25 16:11:00 by Martin Stjernholm <mast@lysator.liu.se>

No more foreign_idents.

2011-03-06

2011-03-06 16:02:01 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Deprecating pike.ida.liu.se for pike.lysator.liu.se.

2009-09-14

2009-09-14 08:06:39 by Martin Stjernholm <mast@lysator.liu.se>

Avoid that uri's get stuck in the queue if errors are thrown.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.28

2009-09-04

2009-09-04 13:55:30 by 0

Update ADT.Heap call to silence warning of deprecated method.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.27

2008-06-28

2008-06-28 16:37:03 by Martin Nilsson <mani@lysator.liu.se>

static -> protected

Rev: lib/modules/ADT.pmod/Heap.pike:1.12
Rev: lib/modules/ADT.pmod/Queue.pike:1.14
Rev: lib/modules/ADT.pmod/Relation.pmod/Binary.pike:1.15
Rev: lib/modules/ADT.pmod/Struct.pike:1.20
Rev: lib/modules/ADT.pmod/Table.pmod:1.29
Rev: lib/modules/ADT.pmod/Trie.pike:1.6
Rev: lib/modules/ADT.pmod/module.pmod:1.12
Rev: lib/modules/Arg.pmod:1.6
Rev: lib/modules/Array.pmod:1.110
Rev: lib/modules/Audio.pmod/Codec.pmod:1.11
Rev: lib/modules/Audio.pmod/Format.pmod/MP3.pike:1.4
Rev: lib/modules/Cache.pmod/Storage.pmod/Gdbm.pike:1.12
Rev: lib/modules/Cache.pmod/cache.pike:1.14
Rev: lib/modules/Calendar.pmod/Austrian.pmod:1.8
Rev: lib/modules/Calendar.pmod/Badi.pmod:1.8
Rev: lib/modules/Calendar.pmod/Coptic.pmod:1.8
Rev: lib/modules/Calendar.pmod/Discordian.pmod:1.12
Rev: lib/modules/Calendar.pmod/Event.pmod:1.24
Rev: lib/modules/Calendar.pmod/Gregorian.pmod:1.12
Rev: lib/modules/Calendar.pmod/ISO.pmod:1.11
Rev: lib/modules/Calendar.pmod/Islamic.pmod:1.11
Rev: lib/modules/Calendar.pmod/Julian.pmod:1.11
Rev: lib/modules/Calendar.pmod/Language.pmod:1.25
Rev: lib/modules/Calendar.pmod/Rule.pmod:1.3
Rev: lib/modules/Calendar.pmod/Stardate.pmod:1.17
Rev: lib/modules/Calendar.pmod/Swedish.pmod:1.9
Rev: lib/modules/Calendar.pmod/TZnames.pmod:1.16
Rev: lib/modules/Calendar.pmod/Time.pmod:1.42
Rev: lib/modules/Calendar.pmod/TimeRanges.pmod:1.35
Rev: lib/modules/Calendar.pmod/Timezone.pmod:1.44
Rev: lib/modules/Calendar.pmod/YMD.pike:1.33
Rev: lib/modules/Calendar.pmod/module.pmod:1.16
Rev: lib/modules/Calendar_I.pmod/ISO.pmod:1.12
Rev: lib/modules/Calendar_I.pmod/Stardate.pmod:1.5
Rev: lib/modules/Crypto.pmod/DSA.pike:1.8
Rev: lib/modules/Crypto.pmod/HMAC.pike:1.5
Rev: lib/modules/Crypto.pmod/Koremutake.pmod:1.4
Rev: lib/modules/Crypto.pmod/PGP.pmod:1.14
Rev: lib/modules/Crypto.pmod/Pipe.pike:1.9
Rev: lib/modules/Crypto.pmod/RSA.pike:1.11
Rev: lib/modules/Crypto.pmod/Random.pmod:1.19
Rev: lib/modules/Crypto.pmod/Substitution.pike:1.4
Rev: lib/modules/Debug.pmod/Subject.pike:1.9
Rev: lib/modules/Debug.pmod/Wrapper.pike:1.6
Rev: lib/modules/Filesystem.pmod/System.pike:1.20
Rev: lib/modules/Filesystem.pmod/Tar.pmod:1.30
Rev: lib/modules/Filesystem.pmod/module.pmod:1.26
Rev: lib/modules/GLU.pmod:1.16
Rev: lib/modules/GLUE.pmod/Driver.pmod/GTK.pike:1.6
Rev: lib/modules/GLUE.pmod/Driver.pmod/Interface.pike:1.3
Rev: lib/modules/GLUE.pmod/Driver.pmod/SDL.pike:1.6
Rev: lib/modules/GLUE.pmod/Events.pmod:1.4
Rev: lib/modules/GLUE.pmod/module.pmod:1.15
Rev: lib/modules/GTKSupport.pmod/pCtree.pike:1.8
Rev: lib/modules/GTKSupport.pmod/pDrawingArea.pike:1.9
Rev: lib/modules/Geography.pmod/Countries.pmod:1.20
Rev: lib/modules/Geography.pmod/Position.pike:1.18
Rev: lib/modules/Getopt.pmod:1.33
Rev: lib/modules/Graphics.pmod/Graph.pmod/create_graph.pike:1.20
Rev: lib/modules/Graphics.pmod/Graph.pmod/module.pmod:1.9
Rev: lib/modules/Graphics.pmod/Graph.pmod/polyline.pike:1.7
Rev: lib/modules/Int.pmod:1.10
Rev: lib/modules/Local.pmod:1.11
Rev: lib/modules/Locale.pmod/Charset.pmod/Tables.pmod/iso88591.pmod:1.3
Rev: lib/modules/Locale.pmod/Charset.pmod/module.pmod:1.57
Rev: lib/modules/Locale.pmod/Language.pmod/nld.pmod:1.2
Rev: lib/modules/Locale.pmod/module.pmod:1.25
Rev: lib/modules/MIME.pmod/ext_to_media_type.pmod:1.7
Rev: lib/modules/MIME.pmod/module.pmod:1.20
Rev: lib/modules/Mapping.pmod:1.10
Rev: lib/modules/Parser.pmod/C.pmod:1.50
Rev: lib/modules/Parser.pmod/LR.pmod/GrammarParser.pmod:1.6
Rev: lib/modules/Parser.pmod/LR.pmod/module.pmod:1.17
Rev: lib/modules/Parser.pmod/Pike.pmod:1.41
Rev: lib/modules/Parser.pmod/RCS.pike:1.39
Rev: lib/modules/Parser.pmod/SGML.pike:1.3
Rev: lib/modules/Parser.pmod/XML.pmod/DOM.pmod:1.14
Rev: lib/modules/Parser.pmod/XML.pmod/NSTree.pmod:1.20
Rev: lib/modules/Parser.pmod/XML.pmod/Tree.pmod:1.72
Rev: lib/modules/Parser.pmod/XML.pmod/Validating.pike:1.14
Rev: lib/modules/Parser.pmod/module.pmod:1.25
Rev: lib/modules/Pike.pmod/module.pmod:1.19
Rev: lib/modules/Process.pmod:1.54
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Bencoding.pmod:1.5
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Peer.pike:1.21
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/PeerID.pmod:1.8
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Port.pike:1.7
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Torrent.pike:1.36
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/module.pmod:1.4
Rev: lib/modules/Protocols.pmod/DNS.pmod:1.96
Rev: lib/modules/Protocols.pmod/DNS_SD.pmod:1.2
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Query.pike:1.93
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/Port.pike:1.9
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/Request.pike:1.50
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/SSLPort.pike:1.14
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Session.pike:1.22
Rev: lib/modules/Protocols.pmod/HTTP.pmod/module.pmod:1.56
Rev: lib/modules/Protocols.pmod/Ident.pmod:1.12
Rev: lib/modules/Protocols.pmod/LDAP.pmod/client.pike:1.113
Rev: lib/modules/Protocols.pmod/LDAP.pmod/ldap_privates.pmod:1.15
Rev: lib/modules/Protocols.pmod/LDAP.pmod/module.pmod:1.32
Rev: lib/modules/Protocols.pmod/LDAP.pmod/protocol.pike:1.21
Rev: lib/modules/Protocols.pmod/LMTP.pmod:1.12
Rev: lib/modules/Protocols.pmod/Line.pmod:1.23
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Raw.pike:1.19
Rev: lib/modules/Protocols.pmod/OBEX.pmod:1.8
Rev: lib/modules/Protocols.pmod/SMTP.pmod/module.pmod:1.46
Rev: lib/modules/Protocols.pmod/SNMP.pmod/protocol.pike:1.19
Rev: lib/modules/Protocols.pmod/TELNET.pmod:1.28
Rev: lib/modules/Protocols.pmod/X.pmod/Extensions.pmod:1.16
Rev: lib/modules/Protocols.pmod/XMLRPC.pmod/module.pmod:1.30
Rev: lib/modules/Remote.pmod/module.pmod:1.8
Rev: lib/modules/SSL.pmod/Cipher.pmod:1.16
Rev: lib/modules/SSL.pmod/connection.pike:1.42
Rev: lib/modules/SSL.pmod/context.pike:1.37
Rev: lib/modules/SSL.pmod/session.pike:1.37
Rev: lib/modules/SSL.pmod/sslfile.pike:1.110
Rev: lib/modules/Sql.pmod/Sql.pike:1.92
Rev: lib/modules/Sql.pmod/mysql.pike:1.41
Rev: lib/modules/Sql.pmod/postgres.pike:1.28
Rev: lib/modules/Sql.pmod/rsql.pike:1.13
Rev: lib/modules/Sql.pmod/sql_result.pike:1.18
Rev: lib/modules/Sql.pmod/sql_util.pmod:1.21
Rev: lib/modules/Sql.pmod/tds.pike:1.24
Rev: lib/modules/Standards.pmod/ASN1.pmod/Decode.pmod:1.24
Rev: lib/modules/Standards.pmod/ASN1.pmod/Types.pmod:1.45
Rev: lib/modules/Standards.pmod/EXIF.pmod:1.29
Rev: lib/modules/Standards.pmod/FIPS10_4.pmod:1.4
Rev: lib/modules/Standards.pmod/ID3.pmod:1.24
Rev: lib/modules/Standards.pmod/IDNA.pmod:1.9
Rev: lib/modules/Standards.pmod/IIM.pmod:1.8
Rev: lib/modules/Standards.pmod/ISO639_2.pmod:1.19
Rev: lib/modules/Standards.pmod/URI.pike:1.28
Rev: lib/modules/Standards.pmod/UUID.pmod:1.17
Rev: lib/modules/Standards.pmod/XML.pmod/Wix.pmod:1.27
Rev: lib/modules/Stdio.pmod/FakeFile.pike:1.16
Rev: lib/modules/Stdio.pmod/Readline.pike:1.60
Rev: lib/modules/Stdio.pmod/Terminfo.pmod:1.27
Rev: lib/modules/Stdio.pmod/module.pmod:1.238
Rev: lib/modules/String.pmod/HTML.pmod:1.7
Rev: lib/modules/String.pmod/module.pmod:1.29
Rev: lib/modules/Thread.pmod:1.45
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/CExtractor.pmod:1.28
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/DocParser.pmod:1.62
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/PikeExtractor.pmod:1.40
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/PikeObjects.pmod:1.37
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/PikeParser.pike:1.52
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/ProcessXML.pmod:1.71
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/module.pmod:1.10
Rev: lib/modules/Tools.pmod/Hilfe.pmod:1.156
Rev: lib/modules/Tools.pmod/Install.pmod:1.35
Rev: lib/modules/Tools.pmod/Legal.pmod/Copyright.pmod:1.12
Rev: lib/modules/Tools.pmod/Legal.pmod/License.pmod/GPL.pmod:1.3
Rev: lib/modules/Tools.pmod/Legal.pmod/License.pmod/LGPL.pmod:1.3
Rev: lib/modules/Tools.pmod/Legal.pmod/License.pmod/MPL.pmod:1.3
Rev: lib/modules/Tools.pmod/Monger.pmod/MongerDeveloper.pike:1.8
Rev: lib/modules/Tools.pmod/Monger.pmod/MongerUser.pike:1.8
Rev: lib/modules/Tools.pmod/Monger.pmod/module.pmod:1.3
Rev: lib/modules/Tools.pmod/PEM.pmod:1.14
Rev: lib/modules/Tools.pmod/PV.pike:1.10
Rev: lib/modules/Tools.pmod/Shoot.pmod/module.pmod:1.20
Rev: lib/modules/Tools.pmod/Standalone.pmod/assemble_autodoc.pike:1.35
Rev: lib/modules/Tools.pmod/Standalone.pmod/dump.pike:1.10
Rev: lib/modules/Tools.pmod/Standalone.pmod/join_autodoc.pike:1.19
Rev: lib/modules/Tools.pmod/Standalone.pmod/pmar_install.pike:1.8
Rev: lib/modules/Tools.pmod/Standalone.pmod/precompile.pike:1.2
Rev: lib/modules/Tools.pmod/Standalone.pmod/rsqld.pike:1.12
Rev: lib/modules/Tools.pmod/Standalone.pmod/test_pike.pike:1.136
Rev: lib/modules/Tools.pmod/Testsuite.pmod:1.9
Rev: lib/modules/Tools.pmod/sed.pmod:1.6
Rev: lib/modules/Web.pmod/CGI.pmod/Request.pike:1.4
Rev: lib/modules/Web.pmod/Crawler.pmod:1.26
Rev: lib/modules/Web.pmod/OWL.pike:1.7
Rev: lib/modules/Web.pmod/RDF.pike:1.47
Rev: lib/modules/Web.pmod/RSS.pmod:1.7
Rev: lib/modules/Yabu.pmod/module.pmod:1.30
Rev: lib/modules/_Image.pmod/Dims.pmod:1.10
Rev: lib/modules/_Image.pmod/Fonts.pmod:1.13
Rev: lib/modules/_Image.pmod/module.pmod:1.47
Rev: lib/modules/_Image_DWG.pmod:1.5
Rev: lib/modules/_Image_PS.pmod:1.15
Rev: lib/modules/_Image_XCF.pmod:1.25

2008-01-13

2008-01-13 17:05:00 by Martin Nilsson <mani@lysator.liu.se>

Removed unused variables.

Rev: lib/7.0/modules/Calendar.pmod/module.pmod:1.8
Rev: lib/7.2/modules/LR.pmod/parser.pike:1.4
Rev: lib/modules/ADT.pmod/Heap.pike:1.11
Rev: lib/modules/Cache.pmod/Storage.pmod/MySQL.pike:1.7
Rev: lib/modules/Calendar_I.pmod/module.pmod:1.16
Rev: lib/modules/GTKSupport.pmod/MenuFactory.pmod:1.12
Rev: lib/modules/Graphics.pmod/Graph.pmod/create_graph.pike:1.17
Rev: lib/modules/Graphics.pmod/Graph.pmod/create_pie.pike:1.15
Rev: lib/modules/Parser.pmod/RCS.pike:1.38
Rev: lib/modules/Protocols.pmod/LDAP.pmod/client.pike:1.110
Rev: lib/modules/Protocols.pmod/LDAP.pmod/protocol.pike:1.20
Rev: lib/modules/Protocols.pmod/LPD.pmod:1.10
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Session.pike:1.35
Rev: lib/modules/Protocols.pmod/SNMP.pmod/agent.pike:1.6
Rev: lib/modules/Protocols.pmod/SNMP.pmod/getcmd.pike:1.7
Rev: lib/modules/Protocols.pmod/TELNET.pmod:1.27
Rev: lib/modules/Protocols.pmod/X.pmod/Requests.pmod:1.33
Rev: lib/modules/Protocols.pmod/X.pmod/Xlib.pmod:1.50
Rev: lib/modules/Standards.pmod/EXIF.pmod:1.28
Rev: lib/modules/Standards.pmod/ID3.pmod:1.23
Rev: lib/modules/Tools.pmod/Monger.pmod/MongerDeveloper.pike:1.4
Rev: lib/modules/Tools.pmod/Monger.pmod/MongerUser.pike:1.4
Rev: lib/modules/Tools.pmod/Standalone.pmod/cgrep.pike:1.13
Rev: lib/modules/Tools.pmod/Standalone.pmod/pmar_install.pike:1.5
Rev: lib/modules/Web.pmod/Crawler.pmod:1.25
Rev: lib/modules/_Image_XCF.pmod:1.23
Rev: lib/modules/_Image_XPM.pmod:1.16

2006-05-19

2006-05-19 19:15:30 by Adam Montague <amontague@siriushosting.com>

handle lines terminated with \r \n or \r\n in robots.txt

Rev: lib/modules/Web.pmod/Crawler.pmod:1.24

2006-05-16

2006-05-16 21:44:36 by Adam Montague <amontague@siriushosting.com>

Send the user-agent header when fetching robots.txt, and make it the same user-agent as everywhere else

Rev: lib/modules/Web.pmod/Crawler.pmod:1.23

2005-08-31

2005-08-31 08:43:15 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Some support for --without-Nettle.

Rev: lib/7.4/modules/Crypto.pmod/pipe.pike:1.4
Rev: lib/7.4/modules/Crypto.pmod/testsuite.in:1.13
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Port.pike:1.6
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/module.pmod:1.3
Rev: lib/modules/Web.pmod/Crawler.pmod:1.22

2005-07-12

2005-07-12 15:35:26 by Martin Stjernholm <mast@lysator.liu.se>

Backported from 7.7 a fix to cope better with non-absolute redirects. Fixes
[bug 3950].

Rev: lib/modules/Web.pmod/Crawler.pmod:1.18

2005-07-12 15:35:26 by Martin Stjernholm <mast@lysator.liu.se>

Backported from 7.7 a fix to cope better with non-absolute redirects. Fixes
[bug 3950].

Rev: lib/modules/Web.pmod/Crawler.pmod:1.21

2004-05-18

2004-05-18 10:14:34 by Petter Larsson <petterl@lysator.liu.se>

Applied patch from Petter Larsson.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.21

2004-02-02

2004-02-02 23:37:58 by Martin Nilsson <mani@lysator.liu.se>

Use Nettle

Rev: lib/modules/Parser.pmod/XML.pmod/NSTree.pmod:1.13
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Generator.pike:1.6
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Torrent.pike:1.25
Rev: lib/modules/Web.pmod/Crawler.pmod:1.20

2004-01-11

2004-01-11 00:52:01 by Martin Nilsson <mani@lysator.liu.se>

this_object() -> this

Rev: lib/modules/ADT.pmod/Priority_queue.pike:1.6
Rev: lib/modules/ADT.pmod/Queue.pike:1.9
Rev: lib/modules/ADT.pmod/Relation.pmod/Binary.pike:1.10
Rev: lib/modules/ADT.pmod/Table.pmod:1.27
Rev: lib/modules/Audio.pmod/Codec.pmod:1.10
Rev: lib/modules/Audio.pmod/Format.pmod/module.pmod:1.7
Rev: lib/modules/Calendar.pmod/Event.pmod:1.22
Rev: lib/modules/Calendar.pmod/Stardate.pmod:1.15
Rev: lib/modules/Calendar.pmod/Time.pmod:1.30
Rev: lib/modules/Calendar.pmod/TimeRanges.pmod:1.27
Rev: lib/modules/Calendar.pmod/Timezone.pmod:1.32
Rev: lib/modules/Calendar.pmod/YMD.pike:1.9
Rev: lib/modules/Calendar.pmod/mkrules.pike:1.10
Rev: lib/modules/Calendar_I.pmod/Gregorian.pmod:1.31
Rev: lib/modules/Calendar_I.pmod/ISO.pmod:1.11
Rev: lib/modules/Calendar_I.pmod/module.pmod:1.15
Rev: lib/modules/Filesystem.pmod/System.pike:1.17
Rev: lib/modules/Filesystem.pmod/Tar.pmod:1.26
Rev: lib/modules/Filesystem.pmod/module.pmod:1.14
Rev: lib/modules/GTKSupport.pmod/Alert.pike:1.6
Rev: lib/modules/GTKSupport.pmod/Util.pmod:1.9
Rev: lib/modules/GTKSupport.pmod/pCtree.pike:1.7
Rev: lib/modules/GTKSupport.pmod/pDrawingArea.pike:1.6
Rev: lib/modules/Languages.pmod/PLIS.pmod:1.19
Rev: lib/modules/Locale.pmod/module.pmod:1.18
Rev: lib/modules/MIME.pmod/module.pmod:1.10
Rev: lib/modules/Parser.pmod/RCS.pike:1.31
Rev: lib/modules/Parser.pmod/XML.pmod/DOM.pmod:1.11
Rev: lib/modules/Parser.pmod/XML.pmod/NSTree.pmod:1.12
Rev: lib/modules/Parser.pmod/XML.pmod/Tree.pmod:1.38
Rev: lib/modules/Protocols.pmod/Bittorrent.pmod/Torrent.pike:1.21
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Query.pike:1.64
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/Port.pike:1.7
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/Request.pike:1.17
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/SSLPort.pike:1.4
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Session.pike:1.14
Rev: lib/modules/Protocols.pmod/IMAP.pmod/types.pmod:1.30
Rev: lib/modules/Protocols.pmod/IRC.pmod/Client.pike:1.11
Rev: lib/modules/Protocols.pmod/LDAP.pmod/client.pike:1.51
Rev: lib/modules/Protocols.pmod/LDAP.pmod/ldap_privates.pmod:1.7
Rev: lib/modules/Protocols.pmod/LDAP.pmod/protocol.pike:1.11
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Connection.pike:1.11
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Session.pike:1.33
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Threads.pike:1.8
Rev: lib/modules/Protocols.pmod/SNMP.pmod/protocol.pike:1.13
Rev: lib/modules/Protocols.pmod/TELNET.pmod:1.23
Rev: lib/modules/Protocols.pmod/X.pmod/Atom.pmod:1.13
Rev: lib/modules/Protocols.pmod/X.pmod/Auth.pmod:1.13
Rev: lib/modules/Protocols.pmod/X.pmod/Extensions.pmod:1.15
Rev: lib/modules/Protocols.pmod/X.pmod/Types.pmod:1.39
Rev: lib/modules/Protocols.pmod/X.pmod/XImage.pmod:1.21
Rev: lib/modules/Protocols.pmod/X.pmod/XTools.pmod:1.9
Rev: lib/modules/Protocols.pmod/X.pmod/Xlib.pmod:1.49
Rev: lib/modules/Remote.pmod/module.pmod:1.3
Rev: lib/modules/SSL.pmod/Cipher.pmod:1.7
Rev: lib/modules/SSL.pmod/connection.pike:1.31
Rev: lib/modules/SSL.pmod/handshake.pike:1.36
Rev: lib/modules/SSL.pmod/session.pike:1.28
Rev: lib/modules/SSL.pmod/sslport.pike:1.12
Rev: lib/modules/Standards.pmod/ASN1.pmod/Types.pmod:1.28
Rev: lib/modules/Standards.pmod/PKCS.pmod/PFX.pmod:1.9
Rev: lib/modules/Standards.pmod/URI.pike:1.17
Rev: lib/modules/Stdio.pmod/FakeFile.pike:1.8
Rev: lib/modules/Tools.pmod/Hilfe.pmod:1.108
Rev: lib/modules/Tools.pmod/Standalone.pmod/rsqld.pike:1.10
Rev: lib/modules/Tools.pmod/X509.pmod:1.21
Rev: lib/modules/Web.pmod/Crawler.pmod:1.19
Rev: lib/modules/Web.pmod/RDF.pike:1.29
Rev: lib/modules/Yabu.pmod/module.pmod:1.28
Rev: lib/modules/_Image_XCF.pmod:1.22

2003-12-03

2003-12-03 13:44:29 by Anders Johansson <anders@roxen.com>

Don't try to fetch /robots.txt when the URI contains a protocol we don't handle.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.14

2003-12-03 13:43:52 by Anders Johansson <anders@roxen.com>

Don't try to fetch /robots.txt when the URI contains a protocol we don't handle.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.17

2003-12-03 13:43:52 by Anders Johansson <anders@roxen.com>

Don't try to fetch /robots.txt when the URI contains a protocol we don't handle.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.18

2003-11-07

2003-11-07 18:55:25 by Martin Nilsson <mani@lysator.liu.se>

Fixed references.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.17
Rev: lib/modules/Web.pmod/RDF.pike:1.21

2003-11-07 17:50:55 by Martin Nilsson <mani@lysator.liu.se>

More documentation

Rev: lib/modules/Web.pmod/Crawler.pmod:1.16

2003-09-11

2003-09-11 18:44:35 by Martin Nilsson <mani@lysator.liu.se>

Fake a create for the sake of Autodoc.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.16

2003-09-11 16:53:18 by Xavier Beaudouin <kiwi@oav.net>

Autodocs Fixes

Rev: lib/modules/Protocols.pmod/DNS.pmod:1.71
Rev: lib/modules/Web.pmod/Crawler.pmod:1.15

2003-08-30

2003-08-30 23:15:35 by H. William Welliver III <bill@welliver.org>

some documentation and a minor bug fixed

Rev: lib/modules/Web.pmod/Crawler.pmod:1.15

2003-08-30 21:58:55 by H. William Welliver III <bill@welliver.org>

autodocs and some minor bug fixes

Rev: lib/modules/Web.pmod/Crawler.pmod:1.14

2003-01-20

2003-01-20 18:01:50 by Martin Nilsson <mani@lysator.liu.se>

strlen -> sizeof

Rev: bin/fake_dynamic_load.pike:1.6
Rev: bin/httpd.pike:1.5
Rev: bin/install.pike:1.109
Rev: bin/mkpeep.pike:1.30
Rev: bin/tarfilter.pike:1.4
Rev: bin/test_pike.pike:1.80
Rev: bin/unbug:1.10
Rev: lib/modules/ADT.pmod/struct.pike:1.11
Rev: lib/modules/Audio.pmod/Format.pmod/module.pmod:1.6
Rev: lib/modules/Calendar.pmod/Events.pmod:1.13
Rev: lib/modules/Calendar.pmod/Time.pmod:1.22
Rev: lib/modules/Calendar.pmod/Timezone.pmod:1.27
Rev: lib/modules/Calendar.pmod/YMD.pmod:1.48
Rev: lib/modules/Calendar.pmod/mkrules.pike:1.7
Rev: lib/modules/Colors.pmod:1.13
Rev: lib/modules/Crypto/_rsa.pike:1.7
Rev: lib/modules/Crypto/des3.pike:1.8
Rev: lib/modules/Crypto/dsa.pike:1.12
Rev: lib/modules/Crypto/hmac.pike:1.9
Rev: lib/modules/Crypto/randomness.pmod:1.24
Rev: lib/modules/Crypto/rsa.pike:1.32
Rev: lib/modules/Filesystem.pmod/System.pike:1.14
Rev: lib/modules/Filesystem.pmod/Tar.pmod:1.19
Rev: lib/modules/GTKSupport.pmod/MenuFactory.pmod:1.8
Rev: lib/modules/Getopt.pmod:1.26
Rev: lib/modules/Languages.pmod/PLIS.pmod:1.15
Rev: lib/modules/Locale.pmod/module.pmod:1.16
Rev: lib/modules/MIME.pmod/module.pmod:1.6
Rev: lib/modules/Parser.pmod/C.pmod:1.38
Rev: lib/modules/Parser.pmod/XML.pmod/DOM.pmod:1.10
Rev: lib/modules/Parser.pmod/XML.pmod/NSTree.pmod:1.7
Rev: lib/modules/Parser.pmod/XML.pmod/Tree.pmod:1.25
Rev: lib/modules/Process.pmod:1.38
Rev: lib/modules/Protocols.pmod/DNS.pmod:1.71
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Query.pike:1.48
Rev: lib/modules/Protocols.pmod/HTTP.pmod/Server.pmod/Request.pike:1.15
Rev: lib/modules/Protocols.pmod/IMAP.pmod/parse_line.pike:1.26
Rev: lib/modules/Protocols.pmod/IMAP.pmod/server.pike:1.15
Rev: lib/modules/Protocols.pmod/IMAP.pmod/types.pmod:1.28
Rev: lib/modules/Protocols.pmod/IRC.pmod/Error.pmod:1.4
Rev: lib/modules/Protocols.pmod/IRC.pmod/Raw.pike:1.7
Rev: lib/modules/Protocols.pmod/Ident.pmod:1.10
Rev: lib/modules/Protocols.pmod/LDAP.pmod/protocol.pike:1.9
Rev: lib/modules/Protocols.pmod/Line.pmod:1.21
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Helper.pmod:1.7
Rev: lib/modules/Protocols.pmod/LysKOM.pmod/Raw.pike:1.14
Rev: lib/modules/Protocols.pmod/NNTP.pmod:1.11
Rev: lib/modules/Protocols.pmod/TELNET.pmod:1.19
Rev: lib/modules/Protocols.pmod/X.pmod/KeySyms.pmod:1.3
Rev: lib/modules/Protocols.pmod/X.pmod/Requests.pmod:1.32
Rev: lib/modules/Protocols.pmod/X.pmod/Xlib.pmod:1.48
Rev: lib/modules/Protocols.pmod/X.pmod/_Xlib.pmod:1.18
Rev: lib/modules/Remote.pmod/connection.pike:1.25
Rev: lib/modules/SSL.pmod/cipher.pike:1.21
Rev: lib/modules/SSL.pmod/connection.pike:1.24
Rev: lib/modules/SSL.pmod/handshake.pike:1.30
Rev: lib/modules/SSL.pmod/https.pike:1.13
Rev: lib/modules/SSL.pmod/packet.pike:1.12
Rev: lib/modules/SSL.pmod/session.pike:1.21
Rev: lib/modules/SSL.pmod/sslfile.pike:1.51
Rev: lib/modules/SSL.pmod/state.pike:1.15
Rev: lib/modules/Sql.pmod/postgres.pike:1.19
Rev: lib/modules/Standards.pmod/ASN1.pmod/Encode.pmod:1.9
Rev: lib/modules/Standards.pmod/ASN1.pmod/Types.pmod:1.21
Rev: lib/modules/Standards.pmod/EXIF.pmod:1.16
Rev: lib/modules/Standards.pmod/ID3.pmod:1.8
Rev: lib/modules/Standards.pmod/PKCS.pmod/PFX.pmod:1.7
Rev: lib/modules/Standards.pmod/PKCS.pmod/Signature.pmod:1.7
Rev: lib/modules/Stdio.pmod/Readline.pike:1.44
Rev: lib/modules/Stdio.pmod/Terminfo.pmod:1.14
Rev: lib/modules/Stdio.pmod/module.pmod:1.163
Rev: lib/modules/String.pmod/Elite.pmod:1.3
Rev: lib/modules/String.pmod/module.pmod:1.10
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/CExtractor.pmod:1.25
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/DocParser.pmod:1.54
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/MirarDocParser.pike:1.19
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/PikeExtractor.pmod:1.30
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/PikeParser.pike:1.32
Rev: lib/modules/Tools.pmod/AutoDoc.pmod/ProcessXML.pmod:1.51
Rev: lib/modules/Tools.pmod/PEM.pmod:1.9
Rev: lib/modules/Tools.pmod/Shoot.pmod/module.pmod:1.6
Rev: lib/modules/Tools.pmod/Standalone.pmod/assemble_autodoc.pike:1.25
Rev: lib/modules/Tools.pmod/X509.pmod:1.17
Rev: lib/modules/Tools.pmod/_PEM.pmod:1.5
Rev: lib/modules/Tools.pmod/sed.pmod:1.5
Rev: lib/modules/Web.pmod/Crawler.pmod:1.14
Rev: lib/modules/_Image.pmod/Fonts.pmod:1.10
Rev: lib/modules/_Image.pmod/module.pmod:1.32
Rev: lib/modules/_Image_XCF.pmod:1.20
Rev: lib/modules/_Image_XPM.pmod:1.13
Rev: src/modules/Gz/flushtest.pike:1.3
Rev: src/modules/HTTPLoop/test.pike:1.3
Rev: src/modules/HTTPLoop/wwwserver.pike:1.5
Rev: src/modules/_Charset/module.pmod.in:1.28
Rev: src/modules/files/socktest.pike:1.21
Rev: src/post_modules/GTK/new_build_pgtk.pike:1.22
Rev: src/post_modules/GTK/output/doc-pikeref.pike:1.13
Rev: src/post_modules/GTK/output/few.pike:1.2
Rev: src/post_modules/GTK/output/split.pike:1.11
Rev: src/post_modules/Unicode/make_canonicals.pike:1.2
Rev: src/post_modules/Unicode/make_decompose.pike:1.4
Rev: src/post_modules/Unicode/make_wordbits.pike:1.2
Rev: src/post_modules/Unicode/test.pike:1.6

2002-12-11

2002-12-11 22:18:02 by Anders Johansson <anders@roxen.com>

Synced with Pike 7.2.

Rev: lib/modules/Standards.pmod/URI.pike:1.14
Rev: lib/modules/Web.pmod/Crawler.pmod:1.13

2002-12-11 22:18:02 by Anders Johansson <anders@roxen.com>

Synced with Pike 7.2.

Rev: lib/modules/Standards.pmod/URI.pike:1.14
Rev: lib/modules/Web.pmod/Crawler.pmod:1.13

2002-03-07

2002-03-07 16:15:51 by Johan Schön <js@opera.com>

Be more liberal when recognizing user agents

Rev: lib/modules/Web.pmod/Crawler.pmod:1.13

2002-03-06

2002-03-06 10:21:27 by Johan Schön <js@opera.com>

Now follows the robots.txt specification more correctly.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.12

2002-01-15

2002-01-15 22:35:21 by Martin Nilsson <mani@lysator.liu.se>

Removed copyright

Rev: lib/modules/Cache.pmod/Data.pike:1.4
Rev: lib/modules/Cache.pmod/Policy.pmod/Base.pike:1.4
Rev: lib/modules/Cache.pmod/Policy.pmod/Multiple.pike:1.4
Rev: lib/modules/Cache.pmod/Policy.pmod/Null.pike:1.4
Rev: lib/modules/Cache.pmod/Policy.pmod/Sized.pike:1.4
Rev: lib/modules/Cache.pmod/Policy.pmod/Timed.pike:1.5
Rev: lib/modules/Cache.pmod/Storage.pmod/Base.pike:1.6
Rev: lib/modules/Cache.pmod/Storage.pmod/Gdbm.pike:1.8
Rev: lib/modules/Cache.pmod/Storage.pmod/Memory.pike:1.6
Rev: lib/modules/Cache.pmod/Storage.pmod/MySQL.pike:1.5
Rev: lib/modules/Cache.pmod/Storage.pmod/Yabu.pike:1.8
Rev: lib/modules/Cache.pmod/cache.pike:1.6
Rev: lib/modules/Protocols.pmod/XMLRPC.pmod/module.pmod:1.17
Rev: lib/modules/Sql.pmod/msql.pike:1.10
Rev: lib/modules/Sql.pmod/postgres.pike:1.16
Rev: lib/modules/Sql.pmod/sybase.pike:1.6
Rev: lib/modules/Standards.pmod/EXIF.pmod:1.6
Rev: lib/modules/Standards.pmod/ISO639_2.pmod:1.8
Rev: lib/modules/Web.pmod/Crawler.pmod:1.12

2001-09-22

2001-09-22 02:43:03 by Johan Schön <js@opera.com>

Use queue->set_stage instead of queue->done

Rev: lib/modules/Web.pmod/Crawler.pmod:1.11

2001-08-30

2001-08-30 15:29:25 by Johan Schön <js@opera.com>

Bugfix: Use headers from prepare callback for the first request after a robots.txt check too.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.10

2001-08-28

2001-08-28 20:07:40 by Johan Schön <js@opera.com>

On request fail, run error callback.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.9

2001-08-18

2001-08-18 19:10:57 by Johan Schön <js@opera.com>

Set the https variable in case the uri's scheme is https

Rev: lib/modules/Web.pmod/Crawler.pmod:1.8

2001-08-13

2001-08-13 11:47:13 by Anders Johansson <anders@roxen.com>

Respect robots.txt although parsing if it is not yet 100% correct.
Read User-Agent header and use it when parsing robots.txt
Some more error handling.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.7

2001-07-16

2001-07-16 15:52:10 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Markup fix.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.11
Rev: lib/modules/_Image.pmod/module.pmod:1.22

2001-07-16 15:47:16 by Henrik Grubbström (Grubba) <grubba@grubba.org>

Markup fix.

Rev: lib/modules/Geography.pmod/Countries.pmod:1.16
Rev: lib/modules/Geography.pmod/Position.pike:1.8
Rev: lib/modules/Parser.pmod/module.pmod:1.9
Rev: lib/modules/Protocols.pmod/HTTP.pmod/module.pmod:1.25
Rev: lib/modules/Stdio.pmod/module.pmod:1.120
Rev: lib/modules/Web.pmod/Crawler.pmod:1.10

2001-07-12

2001-07-12 16:40:17 by Johan Schön <js@opera.com>

Added an error callback, for status codes >= 300.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.6

2001-07-11

2001-07-11 21:13:56 by Johan Schön <js@opera.com>

Added support for 'virtual' URLs.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.5

2001-07-06

2001-07-06 03:13:49 by Johan Schön <js@opera.com>

Use strings as well as URIs in the rulesets.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.4

2001-06-26

2001-06-26 03:14:14 by Johan Schön <js@opera.com>

Logical change in check_link. I think this makes sense, correct me if I'm wrong again ;)

Rev: lib/modules/Web.pmod/Crawler.pmod:1.3

2001-06-10

2001-06-10 11:39:41 by Per Hedbor <ph@opera.com>

Slightly changed API: New callback (_prepare_cb), called with URI and headers.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.9

2001-06-10 11:39:11 by Per Hedbor <ph@opera.com>

Slightly changed API: New callback (_prepare_cb), called with URI and headers.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.2

2001-06-07

2001-06-07 14:45:23 by Per Hedbor <ph@opera.com>

Only select 20 entries from the queue at a time

Rev: lib/modules/Web.pmod/Crawler.pmod:1.8

2001-05-30

2001-05-30 23:47:32 by Johan Schön <js@opera.com>

Backported from 7.3.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.1

2001-05-28

2001-05-28 22:01:00 by Per Hedbor <ph@opera.com>

optimized

Rev: lib/modules/Web.pmod/Crawler.pmod:1.7

2001-05-28 17:01:07 by Per Hedbor <ph@opera.com>

Slower delay

Rev: lib/modules/Web.pmod/Crawler.pmod:1.6

2001-05-27

2001-05-27 17:49:25 by Johan Schön <js@opera.com>

Moved the allow/deny rulesets to the Queue's from the Crawler. Only the Mysql queue is uptdated so far.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.5

2001-05-27 01:14:27 by Per Hedbor <ph@opera.com>

MySQL queue

Rev: lib/modules/Web.pmod/Crawler.pmod:1.4

2001-05-25

2001-05-25 20:58:02 by Johan Schön <js@opera.com>

Added MemoryQueue. SimpleQueue changed name to ComplexQueue :-)

Rev: lib/modules/Web.pmod/Crawler.pmod:1.3

2001-05-25 17:40:26 by Johan Schön <js@opera.com>

Added RegexpRule, and some misc bug fixes

Rev: lib/modules/Web.pmod/Crawler.pmod:1.2

2001-05-15

2001-05-15 23:21:42 by Johan Schön <js@opera.com>

Created the Web top level module, and added a generic web crawler framework to it.

Rev: lib/modules/Web.pmod/Crawler.pmod:1.1