idzebra-moved-to-github.git
16 years agoUpdate with things.
Adam Dickmeiss [Thu, 20 Dec 2007 19:07:10 +0000 (19:07 +0000)]
Update with things.

16 years agoLet zebra_map_tokenize_start returns -1 in case of error.
Adam Dickmeiss [Thu, 20 Dec 2007 19:05:12 +0000 (19:05 +0000)]
Let zebra_map_tokenize_start returns -1 in case of error.

16 years agoHandle encoding errors strings passed to ICU
Adam Dickmeiss [Thu, 20 Dec 2007 19:02:12 +0000 (19:02 +0000)]
Handle encoding errors strings passed to ICU

16 years agoReference intro
Adam Dickmeiss [Thu, 20 Dec 2007 13:16:09 +0000 (13:16 +0000)]
Reference intro

16 years agoNow supporting melm too.
Anders S. Mortensen [Thu, 20 Dec 2007 11:44:18 +0000 (11:44 +0000)]
Now supporting melm too.

16 years agoChanged log message for adelete action
Adam Dickmeiss [Thu, 20 Dec 2007 11:21:29 +0000 (11:21 +0000)]
Changed log message for adelete action

16 years agoImplemented update action : adelete.
Adam Dickmeiss [Thu, 20 Dec 2007 11:15:41 +0000 (11:15 +0000)]
Implemented update action : adelete.

New action action_delete added. zebra_extract_file honors it and
deletes a record as usual but does not return error code if
a record does not exist already. Function zebra_extract_file takes
action parameter rather then deleteFlag. The file/path update
is changed accordingly. zebraidx honors command 'adelete'.

16 years agoBump version to 2.0.21.
Adam Dickmeiss [Thu, 20 Dec 2007 11:03:53 +0000 (11:03 +0000)]
Bump version to 2.0.21.

16 years agoFuncion zebra_recid_to_sysno only attemps mapping if segment ZEBRA.2.0.20
Adam Dickmeiss [Wed, 19 Dec 2007 14:11:36 +0000 (14:11 +0000)]
Funcion zebra_recid_to_sysno only attemps mapping if segment
indexing is enabled.

16 years agoRequire YAZ 3.0.17.
Adam Dickmeiss [Wed, 19 Dec 2007 13:46:04 +0000 (13:46 +0000)]
Require YAZ 3.0.17.

16 years agoTowards 2.0.20.
Adam Dickmeiss [Wed, 19 Dec 2007 13:38:21 +0000 (13:38 +0000)]
Towards 2.0.20.

16 years agoOn facets and versions.
Adam Dickmeiss [Wed, 19 Dec 2007 13:35:39 +0000 (13:35 +0000)]
On facets and versions.

16 years agoAdded some material about ICU chains.
Adam Dickmeiss [Wed, 19 Dec 2007 09:30:29 +0000 (09:30 +0000)]
Added some material about ICU chains.

16 years agoWS updates (no code changes).
Adam Dickmeiss [Tue, 18 Dec 2007 13:55:28 +0000 (13:55 +0000)]
WS updates (no code changes).

16 years agoPrevent zebra_clean from deleting files for uncommited trans.
Adam Dickmeiss [Tue, 18 Dec 2007 13:41:27 +0000 (13:41 +0000)]
Prevent zebra_clean from deleting files for uncommited trans.

16 years agoSimplify definition
Adam Dickmeiss [Tue, 18 Dec 2007 13:39:39 +0000 (13:39 +0000)]
Simplify definition

16 years agoAllow 'index' setting value 'none' for no index types.
Adam Dickmeiss [Tue, 18 Dec 2007 10:04:15 +0000 (10:04 +0000)]
Allow 'index' setting value 'none' for no index types.

Using index:none in zebra.cfg is treated specially and is now allowed
to be used to specify 'no index types specified'.

16 years agoAdded a note on unlimited disk space
Heikki Levanto [Mon, 17 Dec 2007 14:22:05 +0000 (14:22 +0000)]
Added a note on unlimited disk space

16 years agoImproved error reporting in case of no more space. Now it lists each directory
Heikki Levanto [Mon, 17 Dec 2007 14:12:09 +0000 (14:12 +0000)]
Improved error reporting in case of no more space. Now it lists each directory
with info on how much used and available.

16 years agoAdded a little documentation.
Anders S. Mortensen [Mon, 17 Dec 2007 12:38:57 +0000 (12:38 +0000)]
Added a little documentation.

16 years agoFinished.
Anders S. Mortensen [Mon, 17 Dec 2007 12:28:50 +0000 (12:28 +0000)]
Finished.

16 years agoEscape backslash for ICU terms in searches
Adam Dickmeiss [Mon, 17 Dec 2007 12:24:50 +0000 (12:24 +0000)]
Escape backslash for ICU terms in searches

16 years agoScan test. Using ICU config in 'tab'.
Adam Dickmeiss [Mon, 17 Dec 2007 12:23:03 +0000 (12:23 +0000)]
Scan test. Using ICU config in 'tab'.

16 years agoAdded word ICU config for da (Danish).
Adam Dickmeiss [Mon, 17 Dec 2007 12:22:05 +0000 (12:22 +0000)]
Added word ICU config for da (Danish).

16 years agoAdded.
Anders S. Mortensen [Mon, 17 Dec 2007 11:48:14 +0000 (11:48 +0000)]
Added.

16 years agoSort indexes using ICU normalization.
Adam Dickmeiss [Mon, 17 Dec 2007 08:44:07 +0000 (08:44 +0000)]
Sort indexes using ICU normalization.

16 years agoAdded clean-local sections to fix make distcheck
Adam Dickmeiss [Thu, 13 Dec 2007 20:19:40 +0000 (20:19 +0000)]
Added clean-local sections to fix make distcheck

16 years agoRemoved log msg
Adam Dickmeiss [Thu, 13 Dec 2007 19:59:21 +0000 (19:59 +0000)]
Removed log msg

16 years agoConsider srcdir in tests (for make distcheck)
Adam Dickmeiss [Thu, 13 Dec 2007 19:50:26 +0000 (19:50 +0000)]
Consider srcdir in tests (for make distcheck)

16 years agoAdd modulePath (fix distcheck)
Adam Dickmeiss [Thu, 13 Dec 2007 19:50:13 +0000 (19:50 +0000)]
Add modulePath (fix distcheck)

16 years agoMARCXML example uses ICU.
Adam Dickmeiss [Thu, 13 Dec 2007 18:10:49 +0000 (18:10 +0000)]
MARCXML example uses ICU.

16 years agoICU charmap files.
Adam Dickmeiss [Thu, 13 Dec 2007 18:10:35 +0000 (18:10 +0000)]
ICU charmap files.

16 years agoFix icuchain file load to use profilePath
Adam Dickmeiss [Thu, 13 Dec 2007 18:08:26 +0000 (18:08 +0000)]
Fix icuchain file load to use profilePath

16 years agoMARCXML example is using filter 'dom' instead of 'alvis'.
Adam Dickmeiss [Thu, 13 Dec 2007 17:42:28 +0000 (17:42 +0000)]
MARCXML example is using filter 'dom' instead of 'alvis'.

16 years agoProper identity XSL
Adam Dickmeiss [Thu, 13 Dec 2007 17:41:50 +0000 (17:41 +0000)]
Proper identity XSL

16 years agoICU test is UTF-8 based.
Adam Dickmeiss [Thu, 13 Dec 2007 15:43:52 +0000 (15:43 +0000)]
ICU test is UTF-8 based.

16 years agoICU functional for scan and snippets.
Adam Dickmeiss [Thu, 13 Dec 2007 11:09:20 +0000 (11:09 +0000)]
ICU functional for scan and snippets.

16 years agoHandle display buf for searches (ICU).
Adam Dickmeiss [Mon, 10 Dec 2007 17:06:07 +0000 (17:06 +0000)]
Handle display buf for searches (ICU).

Extend zebra_map_tokenize_next to return display terms. For
RPN-query evaluation (rpnsearch.c) store display term in WRBUF
rather than buffer.

16 years agoAdded test for complete-subfield search (:p).
Adam Dickmeiss [Fri, 7 Dec 2007 14:17:37 +0000 (14:17 +0000)]
Added test for complete-subfield search (:p).

16 years agoICU term lists are handled for search.
Adam Dickmeiss [Fri, 7 Dec 2007 14:09:09 +0000 (14:09 +0000)]
ICU term lists are handled for search.

16 years agoAllow facet size to be specified.
Adam Dickmeiss [Wed, 5 Dec 2007 09:55:10 +0000 (09:55 +0000)]
Allow facet size to be specified.

A facet size may be specified by appending colon and number
after index type, e.g. zebra::facet::title:w:10 .

16 years agoSort facets by set frequency.
Adam Dickmeiss [Wed, 5 Dec 2007 09:29:52 +0000 (09:29 +0000)]
Sort facets by set frequency.

16 years agoSUTRS-like result for Facet.
Adam Dickmeiss [Tue, 4 Dec 2007 12:52:33 +0000 (12:52 +0000)]
SUTRS-like result for Facet.

16 years agoRemove log message from zebra_recid_to_sysno
Adam Dickmeiss [Tue, 4 Dec 2007 11:13:17 +0000 (11:13 +0000)]
Remove log message from zebra_recid_to_sysno

16 years agoAdded strmap object
Adam Dickmeiss [Mon, 3 Dec 2007 17:16:48 +0000 (17:16 +0000)]
Added strmap object

16 years agoReduce number of CHECKs so that speed can be tested
Adam Dickmeiss [Mon, 3 Dec 2007 17:09:01 +0000 (17:09 +0000)]
Reduce number of CHECKs so that speed can be tested

16 years agoRemoved unused source symtab.c.
Adam Dickmeiss [Mon, 3 Dec 2007 16:54:49 +0000 (16:54 +0000)]
Removed unused source symtab.c.

16 years agoAdded more tests WRT position attribute
Adam Dickmeiss [Mon, 3 Dec 2007 14:33:35 +0000 (14:33 +0000)]
Added more tests WRT position attribute

16 years agoMemory leak fix - in case of error in use of position attribute.
Adam Dickmeiss [Mon, 3 Dec 2007 14:33:22 +0000 (14:33 +0000)]
Memory leak fix - in case of error in use of position attribute.

16 years agoOmit first-in-field index terms for facets
Adam Dickmeiss [Mon, 3 Dec 2007 13:34:17 +0000 (13:34 +0000)]
Omit first-in-field index terms for facets

16 years agoAdded function zebra_create_rset_isam .
Adam Dickmeiss [Mon, 3 Dec 2007 13:04:04 +0000 (13:04 +0000)]
Added function zebra_create_rset_isam .

16 years agoAdded position attribute test
Adam Dickmeiss [Mon, 3 Dec 2007 12:57:55 +0000 (12:57 +0000)]
Added position attribute test

16 years agoFirst functional facet result (zebra::facet::..).
Adam Dickmeiss [Mon, 3 Dec 2007 11:49:11 +0000 (11:49 +0000)]
First functional facet result (zebra::facet::..).

16 years agoLog records when they differ in tl_fetch_compare
Adam Dickmeiss [Mon, 3 Dec 2007 11:47:53 +0000 (11:47 +0000)]
Log records when they differ in tl_fetch_compare

16 years agoFixed memory leak for safari filter
Adam Dickmeiss [Mon, 3 Dec 2007 11:46:39 +0000 (11:46 +0000)]
Fixed memory leak for safari filter

16 years agoAdded zebra_strmap_it(erator).
Adam Dickmeiss [Mon, 3 Dec 2007 09:12:38 +0000 (09:12 +0000)]
Added zebra_strmap_it(erator).

16 years agoAdded simple string map (hash) utility.
Adam Dickmeiss [Sun, 2 Dec 2007 11:30:28 +0000 (11:30 +0000)]
Added simple string map (hash) utility.

16 years agoFixed bug in zebra_recid_to_sysno (handle non isamb case)
Adam Dickmeiss [Sat, 1 Dec 2007 21:34:10 +0000 (21:34 +0000)]
Fixed bug in zebra_recid_to_sysno (handle non isamb case)

16 years agoAllow record retrieval for record types using custom record IDs.
Adam Dickmeiss [Fri, 30 Nov 2007 12:19:08 +0000 (12:19 +0000)]
Allow record retrieval for record types using custom record IDs.

A filter may specify its own record_id by assigning a non-zero
to record_id member in RecWord. However, until this commit, the
original record was not retrievable . Updating only occured with
a custom match ID. With this patch the record can be retrieved .
The allrecords index (_ALLRECORDS) is used as a map between custom
record IDs and Zebras internal record store which is identified by the
system-number (storeData and storeKeys).

16 years agoAdded testlib functions for fetch of records
Adam Dickmeiss [Fri, 30 Nov 2007 10:08:01 +0000 (10:08 +0000)]
Added testlib functions for fetch of records

16 years agoMoved local declaration (for debugging)
Adam Dickmeiss [Fri, 30 Nov 2007 09:51:31 +0000 (09:51 +0000)]
Moved local declaration (for debugging)

16 years agoExtend recindex system may use ISAMB for records map.
Adam Dickmeiss [Wed, 28 Nov 2007 11:16:32 +0000 (11:16 +0000)]
Extend recindex system may use ISAMB for records map.

The recindex system may use ISAMB for map between record ID
and record data. The recindex_open has an extra parameter to
enable this feature (disabled for now).

16 years agoWS updates (no code changes).
Adam Dickmeiss [Wed, 28 Nov 2007 10:38:10 +0000 (10:38 +0000)]
WS updates (no code changes).

16 years agoExtend isamb_merge read handler with new insert mode.
Adam Dickmeiss [Wed, 28 Nov 2007 09:56:42 +0000 (09:56 +0000)]
Extend isamb_merge read handler with new insert mode.

Extend isamb_merge read handler, read_item, with new insert mode of
value 2. Like 1 this means "insertion", but, unlike 1, forces an existing
key to be replaced even though the comparison is 0. Until now ISAMB
has assumed "same" key for value of 0.

16 years agoNew records.obj; removed recstat.obj
Adam Dickmeiss [Fri, 23 Nov 2007 14:00:16 +0000 (14:00 +0000)]
New records.obj; removed recstat.obj

16 years agoGot rid of redundant files WRT records mgt.
Adam Dickmeiss [Fri, 23 Nov 2007 13:59:14 +0000 (13:59 +0000)]
Got rid of redundant files WRT records mgt.

16 years agoFactor records system mgt into recindex.c, records.c.
Adam Dickmeiss [Fri, 23 Nov 2007 13:52:52 +0000 (13:52 +0000)]
Factor records system mgt into recindex.c, records.c.

16 years agoRefactor recindex out of Records struct
Adam Dickmeiss [Fri, 23 Nov 2007 13:11:08 +0000 (13:11 +0000)]
Refactor recindex out of Records struct

16 years agoVersion 2.0.19. Use YAZ' wrbuf_write_escaped.
Adam Dickmeiss [Thu, 15 Nov 2007 08:53:24 +0000 (08:53 +0000)]
Version 2.0.19. Use YAZ' wrbuf_write_escaped.

16 years agoMore ICU tests
Adam Dickmeiss [Thu, 15 Nov 2007 08:53:04 +0000 (08:53 +0000)]
More ICU tests

16 years agoIgnore logfiles
Adam Dickmeiss [Wed, 14 Nov 2007 21:10:46 +0000 (21:10 +0000)]
Ignore logfiles

16 years agoIngnore test programs and log files.
Adam Dickmeiss [Wed, 14 Nov 2007 21:10:26 +0000 (21:10 +0000)]
Ingnore test programs and log files.

16 years agoAdded small test
Adam Dickmeiss [Wed, 14 Nov 2007 13:12:41 +0000 (13:12 +0000)]
Added small test

16 years agoMake a test somewhat more readable
Adam Dickmeiss [Wed, 14 Nov 2007 09:51:00 +0000 (09:51 +0000)]
Make a test somewhat more readable

16 years agoUse test facility of YAZ
Adam Dickmeiss [Wed, 14 Nov 2007 09:44:16 +0000 (09:44 +0000)]
Use test facility of YAZ

16 years agoUse zebra_map_get_or_add instead of zebra_map_get for searches.
Adam Dickmeiss [Tue, 13 Nov 2007 13:41:51 +0000 (13:41 +0000)]
Use zebra_map_get_or_add instead of zebra_map_get for searches.

Use zebra_map_get_or_add instead of zebra_map_get for searches.
For systems that do not define default.idx the system must generate
a zebra map for it (and warn if default.idx was used).

16 years agoRequire YAZ 3.0.16 or later
Adam Dickmeiss [Mon, 12 Nov 2007 13:41:19 +0000 (13:41 +0000)]
Require YAZ 3.0.16 or later

16 years agoUpdate for ICU transform (was normalize)
Adam Dickmeiss [Mon, 12 Nov 2007 13:40:50 +0000 (13:40 +0000)]
Update for ICU transform (was normalize)

16 years agoFirst successful test with ICU sortkeys in dictionary.
Adam Dickmeiss [Thu, 8 Nov 2007 21:21:58 +0000 (21:21 +0000)]
First successful test with ICU sortkeys in dictionary.

16 years agoAdded test of regexp patterns (DFA)
Adam Dickmeiss [Thu, 8 Nov 2007 21:21:16 +0000 (21:21 +0000)]
Added test of regexp patterns (DFA)

16 years agoUpdate for locale API changes.
Adam Dickmeiss [Thu, 8 Nov 2007 13:35:36 +0000 (13:35 +0000)]
Update for locale API changes.

16 years agoUse header icu.h instead of icu_I18N.h
Adam Dickmeiss [Thu, 8 Nov 2007 09:30:05 +0000 (09:30 +0000)]
Use header icu.h instead of icu_I18N.h

16 years agoCheck for YAZ_HAVE_ICU instead of HAVE_ICU
Adam Dickmeiss [Thu, 8 Nov 2007 08:18:37 +0000 (08:18 +0000)]
Check for YAZ_HAVE_ICU instead of HAVE_ICU

16 years agoDo not perform t17 if ICU is disabled
Adam Dickmeiss [Thu, 8 Nov 2007 07:54:17 +0000 (07:54 +0000)]
Do not perform t17 if ICU is disabled

16 years agoFix non-ICU compilation (due to previous commit)
Adam Dickmeiss [Wed, 7 Nov 2007 11:22:58 +0000 (11:22 +0000)]
Fix non-ICU compilation (due to previous commit)

16 years agoAdded first test ICU indexing test
Adam Dickmeiss [Wed, 7 Nov 2007 10:24:28 +0000 (10:24 +0000)]
Added first test ICU indexing test

16 years agoThe zebramaps implements index_types functionality.
Adam Dickmeiss [Tue, 6 Nov 2007 10:29:58 +0000 (10:29 +0000)]
The zebramaps implements index_types functionality.

16 years agoMerge icu_chain into zebramaps.
Adam Dickmeiss [Mon, 5 Nov 2007 13:58:01 +0000 (13:58 +0000)]
Merge icu_chain into zebramaps.

16 years agoChanged error handling for unknown zebra maps.
Adam Dickmeiss [Mon, 5 Nov 2007 11:36:23 +0000 (11:36 +0000)]
Changed error handling for unknown zebra maps.

The zebramaps system a warning the first time an inknown index type
is used. This warning, should only be issued if maps were read from
a configfile (zebra_maps_read_file).

16 years agoRefactor zebramaps parsing
Adam Dickmeiss [Mon, 5 Nov 2007 11:27:24 +0000 (11:27 +0000)]
Refactor zebramaps parsing

16 years agoChanged limit set parameter for rpn_scan
Adam Dickmeiss [Mon, 5 Nov 2007 11:20:39 +0000 (11:20 +0000)]
Changed limit set parameter for rpn_scan

16 years agoBeginnings of facets
Adam Dickmeiss [Thu, 1 Nov 2007 16:01:33 +0000 (16:01 +0000)]
Beginnings of facets

16 years agoWS changes for function calls.
Adam Dickmeiss [Thu, 1 Nov 2007 15:59:47 +0000 (15:59 +0000)]
WS changes for function calls.

16 years agoAdded rpn_facet which does little at this stage.
Adam Dickmeiss [Thu, 1 Nov 2007 14:56:07 +0000 (14:56 +0000)]
Added rpn_facet which does little at this stage.

16 years agoDocument scan approximative limit
Adam Dickmeiss [Thu, 1 Nov 2007 14:12:44 +0000 (14:12 +0000)]
Document scan approximative limit

16 years agoHonor approximative limits for scan (type 12).
Adam Dickmeiss [Thu, 1 Nov 2007 14:10:03 +0000 (14:10 +0000)]
Honor approximative limits for scan (type 12).

The documentation mentions attribute 9/11. However, that's not
found anywhere in the code. Attribute 12 is chosen (same as a
search global approximative limit).

16 years agoChanged the index type to a string everywhere.
Adam Dickmeiss [Wed, 31 Oct 2007 16:56:13 +0000 (16:56 +0000)]
Changed the index type to a string everywhere.

The functions zebra_map_get and zebra_map_get_or_add changed their
3rd argument 'int reg_id' to 'const char *id'. The recExtractCtrl struct
defined in idzebra/recctrl.h changed: the seqno array was removed. It
is used by no filters and assumes that index type(AKA register type)
is a char (int).

16 years agoIntroduced zebra_map_t in zebra_maps API.
Adam Dickmeiss [Tue, 30 Oct 2007 19:17:15 +0000 (19:17 +0000)]
Introduced zebra_map_t in zebra_maps API.

16 years agoWS changes for function calls.
Adam Dickmeiss [Mon, 29 Oct 2007 22:22:06 +0000 (22:22 +0000)]
WS changes for function calls.

16 years agoRefactor database lookup to single function.
Adam Dickmeiss [Mon, 29 Oct 2007 20:07:04 +0000 (20:07 +0000)]
Refactor database lookup to single function.

Search for each database is handled by rpn_search_APT_database.
Resultes for each database is collected by rpn_search_APT. This
is simpler and shorter than previous version of search which had
database merge in multiple places.