git.indexdata.com Git - tclrobot.git/search

2002-03-25	Adam Dickmeiss	Remove code that skips ?'s in URL	commit \| commitdiff \| tree
2002-03-25	Adam Dickmeiss	* empty log message *	commit \| commitdiff \| tree
2002-02-28	Adam Dickmeiss	Fix unvisited status	commit \| commitdiff \| tree
2002-02-17	Adam Dickmeiss	Robot honour robots meta tag	commit \| commitdiff \| tree
2001-11-14	Adam Dickmeiss	File status written with counts of areas: unvisited...	commit \| commitdiff \| tree
2001-11-13	Adam Dickmeiss	MIME check when reading HTTP header (not when reading...	commit \| commitdiff \| tree
2001-11-09	Adam Dickmeiss	Robot follows <frame src=...>.	commit \| commitdiff \| tree
2001-11-08	Adam Dickmeiss	Added tests script.	commit \| commitdiff \| tree
2001-11-08	Adam Dickmeiss	Fixed bug regarding relative URLs.	commit \| commitdiff \| tree
2001-11-08	Adam Dickmeiss	Fixed bug in skipSpace (didn't check for null-byte).	commit \| commitdiff \| tree
2001-11-07	Adam Dickmeiss	Use simpler regular expression to avoid Tcl regsub...	commit \| commitdiff \| tree
2001-11-07	Adam Dickmeiss	Glob-expressions may be expressed as a list in rules...	commit \| commitdiff \| tree
2001-10-31	Adam Dickmeiss	Robot saves metadata with unique names in directory...	commit \| commitdiff \| tree
2001-10-30	Adam Dickmeiss	Pattern may be negated in rules (! as first character...	commit \| commitdiff \| tree
2001-10-26	Adam Dickmeiss	Implemented Allow/deny rules. Better Tcl autoconfig.	commit \| commitdiff \| tree
2001-06-29	Adam Dickmeiss	Yet another fix regarding relative links.	commit \| commitdiff \| tree
2001-06-29	Adam Dickmeiss	Added option to specify Accept-Language.	commit \| commitdiff \| tree
2001-06-07	Adam Dickmeiss	Fixes for robots.txt handling (bug introduced by previous...	commit \| commitdiff \| tree
2001-06-07	Adam Dickmeiss	Bug fix for relative links.	commit \| commitdiff \| tree
2001-06-06	Adam Dickmeiss	Added some character entities for mapping.	commit \| commitdiff \| tree
2001-06-06	Adam Dickmeiss	Added README. Ignore case in keywords in robots.txt.	commit \| commitdiff \| tree
2001-06-05	Adam Dickmeiss	maxDistance set to 50 default.	commit \| commitdiff \| tree
2001-06-05	Adam Dickmeiss	Remove characters after semicolon in header contents.	commit \| commitdiff \| tree
2001-02-27	Adam Dickmeiss	Minor changes.	commit \| commitdiff \| tree
2001-02-26	Adam Dickmeiss	Added config for zebra/zmbol.	commit \| commitdiff \| tree
2001-01-23	Adam Dickmeiss	Minor fix for anchor references.	commit \| commitdiff \| tree
2001-01-23	Adam Dickmeiss	Removed YAZ dependency.	commit \| commitdiff \| tree
2001-01-23	Adam Dickmeiss	Added options for the robot.	commit \| commitdiff \| tree
2001-01-23	Adam Dickmeiss	Multiple http connections. Bug fixes.	commit \| commitdiff \| tree
2000-12-11	Adam Dickmeiss	Fixed problem with links having .. for root directory...	commit \| commitdiff \| tree
2000-12-10	Adam Dickmeiss	Implemented robots.txt rules.	commit \| commitdiff \| tree
2000-12-08	Adam Dickmeiss	File robots.txt now read the each domain.	commit \| commitdiff \| tree
2000-12-08	Adam Dickmeiss	DCdot doesn't rely on htmlSwitch no more.	commit \| commitdiff \| tree
2000-12-07	Adam Dickmeiss	Added -nonest for htmlSwitch statement. Robot puts...	commit \| commitdiff \| tree
1999-12-27	Adam Dickmeiss	Major speed improvement.	commit \| commitdiff \| tree
1999-02-04	Adam Dickmeiss	Updated configure script.	commit \| commitdiff \| tree
1998-10-15	Adam Dickmeiss	Minor changes.	commit \| commitdiff \| tree
1998-10-15	Adam Dickmeiss	Added configure script.	commit \| commitdiff \| tree
1998-10-15	Adam Dickmeiss	Buf fixes. Robot saves body of text without tags and...	commit \| commitdiff \| tree
1996-08-06	Adam Dickmeiss	Initial revision	commit \| commitdiff \| tree

Simple Web harvester

RSS Atom