2 For text filter, return only header if elementSetName=H . elementSetName=R
3 returns contents only. Other elementSetName returns both header+content.
5 Added test for charmap and rusmarc.
7 Added feature charmaps (.chr) so that characters may be specified in
10 Fixed problem with encoding directive for charmap(.chr) files.
14 Fix bug. X-Path attribute expressions with spaces in them now works.
16 Fix base address for MARC output.
20 Fix bug with shadow and result set handling.
22 Implement MARCXML to ISO2709 conversion.
26 Add missing examples for Windows install.
28 Fix bug in regx filter to make it "greedy" again. This bug appeared
35 Fix XML error handling. Stop XML parse immediately if XML parse error
36 occur (i.e. produce one error only).
38 Zebra ignores "unsupported use attribute" for individual databases
39 when search multiple databases (unless all databases fail).
41 New filter grs.marcxml which works like grs.marc but produces MARCXML.
43 Added support for database deletion. It is possible to create/drop
44 a database from zebraidx utility. Note: only for isam:b.
46 Write zebrasrv.pid to lockdir.
48 Bug fix: result sets were not recovered correctly. Had to
49 add ODR handle for zebra_search_RPN in order to make it work.
51 Fixed a bug in regx filters that didn't do anchors (^) correctly.
53 Fixed a bug in searches with X-Path searches sometimes giving "extra"
56 Zebra server checks for zebrasrv.pid and refuses to start if it is already
57 locked by another (running) zebrasrv.
59 Fixed a bug with text being chunked in pieces for the grs.xml filter.
63 xelm code updates. xelm works regardless state of 'xpath enable/disable'
64 Avoid -L/usr/lib since that is already default library path.
66 Allow multiple updates within one transaction.
68 Fixed a bug with >2GB files (overflow in integer expression).
72 Fix linker error for Perl module.
74 Fix bug in and operation which in some cases could result in "extra"
75 hits. Bug was introduced in 1.3.5.
77 Fix bug in handling of schema conversion when producing numeric tags.
83 Add missing files doc/zvrank.txt and doc/marc_indexing.xml.
87 Zvrank: an experimental ranking algorithm. See doc/zvrank.txt and
88 source in index/zvrank.c. Enable this by using rank: zvrank in zebra.cfg.
89 Contributed by Johannes Leveling <Johannes.Leveling at fernuni-hagen.de>
91 livrank: another experimental ranking algorithm. Source in livcode.c.
92 Enable this by using rank: livrank in zebra.cfg and use -DLIV_CODE=1
94 Contributed by Pete Mallinson, University of Liverpool.
96 Advanced MARC indexing. See doc/marc_indexing.xml
97 Oleg Kolobov <oleg at lib.tpu.ru>
99 Perl API updates and fixes.
100 Peter Popovics <pop at technomat.hu>
102 Fixed 'zebraidx delete'.
104 Implemented 'zebraidx clean'.
106 64-bit offsets for register files on WIN32 (no 2 GB limit).
108 Fixed a few memory leaks WRT sorting.
112 Fixed error handling : error code was not properly returned.
114 Support Truncation 104 (CCL).
118 Added missing source files for perl extension.
122 Implemented xelm directive.
124 Updated for newer version of YAZ (introduction of string schema).
126 Directory examples/zthes now part of distribution (was missing
127 in previous release).
129 New .abs directive, systag, that control where to put retrieval
130 information. The directive takes two arguments: system tag, element name.
131 System tag is one of : rank, sysno, size.
135 Perl Filter and Perl API. By Peter Popovics.
137 For zebra.cfg, if no profilePath is specified, directory
138 (prefix)/share/idzebra/tab
141 Zebra Examples in examples . Zebra tests in test.
143 Bug fix: sort index was not properly modified on
144 record updates/deletes.
146 Fix handling of character entities for sgml filter.
148 Move data1 to Zebra (used to be part of YAZ).
152 Fix character encoding of scan response terms.
154 Fix character decoding of scan request terms.
156 Fix ESpec handling (requires YAZ 1.9.1)
158 Fix searches for complete fields.
162 When name zebra is used in a filename or directory 'idzebra' is used
163 instead to avoid confusion with GNU zebra (routing software).
165 Zebra server stops with a fatal error if config file cannot be read.
167 New config setting, followLinks, that controls whether update of files
168 should follow symbolic. Set it to 1 (for enable) or 0 (to disable).
169 By default symbolic links are followed.
171 Fix MARC transfer . MARC fields had wrong data for multiple fields.
173 XML record reader moved from YAZ to Zebra, to make YAZ less
174 dependant on external libraries.
176 Zebra uses yaz_iconv which is mini iconv library supporting UTF-8,
177 UCS4, ISO-8859-1. This means that Zebra does UNICODE even
178 on systems that doesn't offer iconv.
180 XML record reader supports external system entities.
184 New .abs-directive "xpath" that takes one argument: "enable"
185 or "disable" to enable and disable XPath -indexing. If no "xpath"
186 direcive is found in .abs-file , XPath-indexing is disabled to ensure
187 backwards compatibility. For missing .abs-files XPath-indexing is
188 enabled so that such records are searchable.
190 Zebra warns about missing .abs-file only once (for each type).
192 Fixed a bug in file update where already-inserted files could
197 Zebra license changed to GNU GPL.
199 XPath-like queries used when RPN string attributes are used, eg.
200 @attr 1=/portal/title sometitle
201 @attr 1=/portal/title[@xml:lang=da] danishtitle
202 @attr 1=/portal/title/@xml:lang da
203 @attr 1=//title sometitle
205 Zebra uses UTF-8 internally:
206 1) New setting "encoding" for zebra.cfg that specifies encoding for
207 OCTET terms in queries and record encoding for most transfer syntaxes
208 (except those that use International Strings, such as GRS-1).
209 2) The encoding of International strings is UTF-8 by default. It
210 may be changed by character set negotiation. If character set
211 negotiation is in effect and if records are selected for conversion
212 these'll be converted to the selected character set - thus overriding
213 the encoding setting in zebra.cfg.
214 3) New directive "encoding" in .abs-files. This specifies the external
215 character encoding for files indexed by zebra. However, if records
216 themselves have an XML header that specifies and encoding that'll be used
219 XML filter (-t grs.xml).
221 Multiple registers. New setting in resource 'root' that holds base
222 directory for register(s). A group a databases may be put in separate
223 register in directory root/reg by using db name 'reg/db1' ... 'reg/dbN'.
227 Fixes for Digital Unix
229 Implemented hits per term using USR:SearchResult-1.
231 New Zebra API. Locking system re-implemented.
233 --- 1.1.stable 2002/02/20
235 Rank weight can be controlled with attribute type 9. Default
236 value is 34. Recommended values between 1-36.
240 Updated for YAZ version 1.8.
242 Added support for termsets - a result set of terms matching
243 a given query. For @attr 8=<set> creates termset named <set>.
245 Added support for raw retrieval. Element Set Name R forces the
246 text filter which returns the record in its original form.
248 Added numerical sort - triggered by structure=numeric (4=109).
250 Remote record import using Z39.50 Extended Services and Segments.
252 Fixed bug where updating a database with user-defined attributes
253 could corrupt the register (bad storeKeys).
255 Multi-threaded version.
257 Fixed bug regarding proximity.
259 Documentation updates.
261 Fixed bug in record retrieval module that occured on 64-bit OSF
266 Fixed bug in makefile for WIN32.
268 Fixed bug in configure script - used bash-specific features.
272 Added support for multiple records in one file for filter grs.sgml.
274 Changed record index structure. New layout is incompatible with
275 previous releases. Added setting "recordcompression" to control
276 compression of records. Possible values are "none" (no
277 compression) and bzip2 (compression using libbz2).
279 Added XML transfer syntax support for retrieval of structured records.
280 Schema in CompSpec is recognised in retrieval of structured records.
282 Changed Tcl record filter so that it attemps to read <filt>.tflt. If
283 that fails, the filter reads the file <filt>.flt (regx style filter).
285 Implemented new Tcl record filter - use grs.tcl.<filter> to enable it.
286 Zebra's configure script automatically attempts to locate Tcl. For
287 manual Tcl configuration use option --with-tclconfig=<path> to specify
288 where Tcl's library files are located.
290 Implemented "compression" of Dictionary and ISAM system. Dictionary
293 Added "tagsysno" directive to zebra.cfg to control under which tag the
294 system ID is placed. Use tagsysno: 0 to disable Zebra's system number
297 Added "tagrank" as above.
299 Changed file naming scheme for register files from <name>.mf.<no> to
302 Implemented "position"-flag for register type (as defined in
303 default.idx). When set to zero no position (or seqence number) is
304 saved in register for each word occurrence, thus saving some register
307 Implemented database mapping. Using mapdb one can specify a database
308 to be mapped to one or more physical databases. Usage:
309 mapdb <fromdb> <todb> ..
311 Added SOIF-filter. Thanks to Peter Valkenburg.
313 For the regx-filter "end element -record" may trigger a mark-of-record
314 if outer level is reached.
316 Tag sets may be typed in the reference to it. From the .abs-file the
317 "tagset" directive takes a third optional integer type for the tag set
318 referenced. From a .tag-file the "include" directive takes a third
319 optional type as well. The old "type" directive in the tag set itself
320 is still recognized but acts as the default type for the tag set.
322 Zebra supports the specification of arbitrary attributes sets, schemas
323 and tag sets, because of the change in YAZ' OID management system.
325 Fixed bug in Sort that caused it NOT to use character mapping as it
328 Zebra now uses GNU configure to generate Makefile(s).
330 Added un-optimised support for left and left/right truncation attributes.
332 Added support for relational operators on text when using RPN queries.
334 Added support for sort specifications in RPN queries. Type 7 specifies
335 'sort' where value 1=ascending, value 2=descending. The use attribute
336 specifies the field criteria as usual. The term specifies priority
337 where 0=first, 1=second, ...
339 Changed the way use attributes are specified in the recordId
342 Maximum number of databases in one Zebra register increased.
344 New setting, databasePath, which specifies that first directory during
345 update traversal is the database name (instead of a fixed one).
347 New setting, explainDatabase, which specifies that databases are
350 Modified Zebra so that it works with ASN.1 compiled code for YAZ.
352 Implemented EXPLAIN database maintenance. Zebra automatically
353 generate - and update CategoryList, TargetInfo, DatabaseInfo,
354 AttributeSetInfo and AttributeDetails records at this stage. The
355 records may be transferred as GRS-1, SUTRS or Explain.
357 Fixed register spec so that colon isn't treated as size separator
358 unless followed by [0-9+-] in order to allow DOS drive specifications.
360 Fixed two bugs in ISAMC system.
362 Changed the way Zebra keeps its maintenance information about attribute
363 sets, available attributes, etc.. Records in "SGML" notation using an
364 EXPLAIN schema is now used when appropriate.
366 Bug fix: Index didn't handle update/insert/delete of the same record
367 (i.e. same recordId) in one run (one invocation of zebraidx). Only the
368 first occurence of a record is considered.
370 Most searches now return correct number of hits.
372 New modular ranking system. Interested programmers are encouraged to
373 inspect rank1.c and improve the algorithm.
375 Bug fix: Lock files weren't removed as they should on NT.
377 Implemented Z39.50 Sort. Zebra's sort handler uses use attributes to
378 specify a "sort register". Refer to the gils sample records which refer
379 to index type "s" which is specified as "sort" in the default.idx file.
380 Each sort criteria can either be Ascending or Descending and at most
381 three sort elements can be specified.
383 Bug fix: Character mapping didn't work for text files.
387 Simple ranked searches now return correct number of hits.
389 The test option (-s) only makes a read-lock on the index as well
390 as using read-only operations anywhere.
392 Moved towards generic character mapping. Configuration file default.idx
393 specifies character map files for register types w, p, u, etc.
395 Implemented "begin variant" for the sgml.regx - filter.
397 Fixed a few memory leaks.
399 Added support for C++, headers uses extern "C" for public definitions.
401 Bug fix: The show records facility (-s) only displayed information for
402 the first record in a file (and not for every record in the file).
404 Added option "-f <n>" to limit the logging of record operations. After
405 <n> records has been processed no logging is performed (unless errors
408 Bug fix: the compressed ISAM system didn't handle update operations
411 Added setting, "maxResultSetSize", to hold the number of records to
412 save in a result set.
414 Bug fix: Complete phrase did't work for search operations.
416 Bug fix: temporary result sets weren't deleted.
418 Reduced disk space for saved keys (storeKeys = 1).
420 Added optional, physical ANY (key replication)
422 Implemented proximity operator in search.
424 Bug fix: the path name buffers used by file match traversal routines
425 have been extended to support long file names.
427 New C(ompressed) ISAM system. To enable it, specify "isam: c" in the
428 configuration file. The resulting register without "storeKeys" is about
429 half the size, and the memory used by zebraidx during phase 2 (merge) is
430 reduced to a minimum.
432 Reworked the way Regexp-2 queries with error tolerance are handled and
433 specified. The documentation has been updated accordingly.
435 Bug fix: Zebrasrv didn't search correctly when queries contained masking
436 characters. This bug was introduced in 1.0a8.
438 Zebrasrv now tag records with the proper database name.
440 New settings, memMax and keyTmpDir.
442 Changed name of setting lockDir (previously called lockPath) and
443 setTmpDir (previously called tempSetPath).
445 Generalized and changed record type specifications. In short, there are:
447 grs.sgml structured, "SGML-like" syntax
448 grs.regx.<filter> structured, Regular expression filter
449 grs.marc.<abs> Reads *MARC records in the ISO2709 format. <abs>
450 is the name of an abstract syntax file.
451 Bug fix: Result sets weren't sorted in operations involving boolean
452 operations with "ranked" operands.
456 Added national character-handling subsystem.
460 Small modifications to input filters and profiles.
462 Added support for SOIF syntax (with private OID).
466 Fixed buffer-size problem in indexing.
468 Added compression to temporary files for updating.
470 Added phrase registers.
472 Added dynamic mapping of search attribute to multiple termlists (ANY).
474 Scan support in multiple databases/registers.
476 Configuration settings are case-insensitive and single dash (-)
477 characters are ignored in comparisons.
479 The index processing ignores empty files - warning given.
481 New option to zebraidx (-V) displays version information.
485 Fixed problem in file-update system.
487 Fixed problem in shadow system; register was sometimes corrupted after
492 Fixed problems in the ISAM subsystem. Caused difficulties when updating
495 Fixed small problem in SUTRS-filter. A newline was sometimes inserted before
496 the rank and record number.
498 Fixed bug in the isam subsystem - caused a malfunction when accessing
499 words which occurred more than 10000 times.
501 Distribution should now include YAZ (Z39.50 protocol stack) to simplify
504 Server can now run under inetd. Use option -i, and -w <directory> to
505 set working directory to desired location.
507 New zebraidx command: clean - removes temporary shadow files.
509 Fixed bug in ISAM system. Occurred rarely during register updates.
511 Logging during index merge phase is improved. The remaining running
514 Temporary files generated by zebraidx are removed after each run.
516 Bug fix: Dictionary didn't handle 8-bit characters correctly; was obvious
517 when doing scan operations in dictionaries with European characters.
521 A whole slew of updates, to make the first publicized release. Get the doc
526 Memory-problems in ISAM fixed. More blocktypes added to the default setup
527 to increase performance on larger databases.
529 Various minor changes in data management system.
533 A couple of portability-problems resolved.
535 Changed some malloc() to xmalloc().