<chapter id="record-model">
- <!-- $Id: recordmodel.xml,v 1.11 2002-10-20 14:02:03 mike Exp $ -->
+ <!-- $Id: recordmodel.xml,v 1.18 2004-08-04 08:26:43 adam Exp $ -->
<title>The Record Model</title>
<para>
<itemizedlist>
<listitem>
-
+
<para>
When records are accessed by the system, they are represented
in their local, or native format. This might be SGML or HTML files,
input filter by preparing conversion rules based on regular
expressions and possibly augmented by a flexible scripting language
(Tcl).
- The input filter produces as output an internal representation:
+ The input filter produces as output an internal representation,
+ a tree structure.
</para>
</listitem>
subsequent sections.
Zebra can read structured records in many different formats.
How this is done is governed by additional parameters after the
- "grs" keyboard, separated by "." characters.
+ "grs" keyword, separated by "." characters.
</para>
<para>
Each element is terminated by a closing tag - beginning
with <literal><</literal>/, and containing the same symbolic
tag-name as the corresponding opening tag.
- The general closing tag - <literal><</literal>/> -
+ The general closing tag - <literal></></literal> -
terminates the element started by the last opening tag. The
structuring of elements is significant.
The element <emphasis>Telephone</emphasis>,
<variablelist>
<varlistentry>
- <term>begin <emphasis>type [parameter ... ]</emphasis></term>
+ <term>begin <replaceable>type [parameter ... ]</replaceable></term>
<listitem>
<para>
Begin a new
- data element. The type is one of the following:
+ data element. The <replaceable>type</replaceable> is one of
+ the following:
<variablelist>
-
+
<varlistentry>
<term>record</term>
<listitem>
name of the schema that describes the structure of the record, eg.
<literal>gils</literal> or <literal>wais</literal> (see below).
The <literal>begin record</literal> call should precede
- any other use of the <emphasis>begin</emphasis> statement.
+ any other use of the <replaceable>begin</replaceable> statement.
</para>
</listitem>
</varlistentry>
<listitem>
<para>
Begin a new node in a variant tree. The parameters are
- <emphasis>class type value</emphasis>.
+ <replaceable>class type value</replaceable>.
</para>
</listitem>
</varlistentry>
</listitem>
</varlistentry>
<varlistentry>
- <term>data</term>
+ <term>data <replaceable>parameter</replaceable></term>
<listitem>
<para>
Create a data element. The concatenated arguments make
the layout (whitespace) of the data should be retained for
transmission.
The option <literal>-element</literal>
- <emphasis>tag</emphasis> wraps the data up in
- the <emphasis>tag</emphasis>.
+ <replaceable>tag</replaceable> wraps the data up in
+ the <replaceable>tag</replaceable>.
The use of the <literal>-element</literal> option is equivalent to
- preceding the command with a <emphasis>begin
- element</emphasis> command, and following
- it with the <emphasis>end</emphasis> command.
+ preceding the command with a <replaceable>begin
+ element</replaceable> command, and following
+ it with the <replaceable>end</replaceable> command.
</para>
</listitem>
</varlistentry>
<varlistentry>
- <term>end <emphasis>[type]</emphasis></term>
+ <term>end <replaceable>[type]</replaceable></term>
<listitem>
<para>
Close a tagged element. If no parameter is given,
the last element on the stack is terminated.
The first parameter, if any, is a type name, similar
- to the <emphasis>begin</emphasis> statement.
- For the <emphasis>element</emphasis> type, a tag
+ to the <replaceable>begin</replaceable> statement.
+ For the <replaceable>element</replaceable> type, a tag
name can be provided to terminate a specific tag.
</para>
</listitem>
</varlistentry>
+
+ <varlistentry>
+ <term>unread <replaceable>no</replaceable></term>
+ <listitem>
+ <para>
+ Move the input pointer to the offset of first character that
+ match rule given by <replaceable>no</replaceable>.
+ The first rule from left-to-right is numbered zero,
+ the second rule is named 1 and so on.
+ </para>
+ </listitem>
+ </varlistentry>
+
</variablelist>
</para>
/^Subject:/ BODY /$/ { data -element title $1 }
/^Date:/ BODY /$/ { data -element lastModified $1 }
/\n\n/ BODY END {
- begin element bodyOfDisplay
- begin variant body iana "text/plain"
- data -text $1
- end record
+ begin element bodyOfDisplay
+ begin variant body iana "text/plain"
+ data -text $1
+ end record
}
</screen>
</para>
<para>
- If Zebra is compiled with support for Tcl (Tool Command Language)
- enabled, the statements described above are supplemented with a complete
+ If Zebra is compiled with support for Tcl enabled, the statements
+ described above are supplemented with a complete
scripting environment, including control structures (conditional
expressions and loop constructs), and powerful string manipulation
- mechanisms for modifying the elements of a record. Tcl is a popular
- scripting environment, with several tutorials available both online
- and in hardcopy.
+ mechanisms for modifying the elements of a record.
</para>
</sect2>
Which of the two elements are transmitted to the client by the server
depends on the specifications provided by the client, if any.
</para>
-
+
<para>
In practice, each variant node is associated with a triple of class,
type, value, corresponding to the variant mechanism of Z39.50.
</para>
-
+
</sect2>
-
+
<sect2>
<title>Data Elements</title>
-
+
<para>
Data nodes have no children (they are always leaf nodes in the record
tree).
</para>
-
+
<!--
- FIXME! Documentation needs extension here about types of nodes - numerical,
- textual, etc., plus the various types of inclusion notes.
- </para>
+ FIXME! Documentation needs extension here about types of nodes - numerical,
+ textual, etc., plus the various types of inclusion notes.
+ </para>
-->
</sect2>
-
+
</sect1>
-
+
<sect1 id="data-model">
<title>Configuring Your Data Model</title>
-
+
<para>
The following sections describe the configuration files that govern
the internal management of data records. The system searches for the files
<listitem>
<para>
- The Tag set (again, this can consist of several different sets).
+ The tag set (again, this can consist of several different sets).
This is used when reading the records from a file, to recognize the
different tags, and when transmitting the record to the client -
mapping the tags to their numerical representation, if they are
known.
</para>
</listitem>
-
+
<listitem>
<para>
The variant set which is used in the profile. This provides a
<para>
The file may contain the following directives:
</para>
-
+
<para>
<variablelist>
-
+
<varlistentry>
- <term>name <emphasis>symbolic-name</emphasis></term>
+ <term>name <replaceable>symbolic-name</replaceable></term>
<listitem>
<para>
(m) This provides a shorthand name or
</listitem>
</varlistentry>
<varlistentry>
- <term>reference <emphasis>OID-name</emphasis></term>
+ <term>reference <replaceable>OID-name</replaceable></term>
<listitem>
<para>
(m) The reference name of the OID for the profile.
The reference names can be found in the <emphasis>util</emphasis>
- module of <emphasis>YAZ</emphasis>.
+ module of YAZ.
</para>
</listitem>
</varlistentry>
<varlistentry>
- <term>attset <emphasis>filename</emphasis></term>
+ <term>attset <replaceable>filename</replaceable></term>
<listitem>
<para>
(m) The attribute set that is used for
</listitem>
</varlistentry>
<varlistentry>
- <term>tagset <emphasis>filename</emphasis></term>
+ <term>tagset <replaceable>filename</replaceable></term>
<listitem>
<para>
(o) The tag set (if any) that describe
</listitem>
</varlistentry>
<varlistentry>
- <term>varset <emphasis>filename</emphasis></term>
+ <term>varset <replaceable>filename</replaceable></term>
<listitem>
<para>
(o) The variant set used in the profile.
</listitem>
</varlistentry>
<varlistentry>
- <term>maptab <emphasis>filename</emphasis></term>
+ <term>maptab <replaceable>filename</replaceable></term>
<listitem>
<para>
(o,r) This points to a
conversion table that might be used if the client asks for the record
in a different schema from the native one.
</para>
- </listitem></varlistentry>
+ </listitem>
+ </varlistentry>
<varlistentry>
- <term>marc <emphasis>filename</emphasis></term>
+ <term>marc <replaceable>filename</replaceable></term>
<listitem>
<para>
(o) Points to a file containing parameters
- for representing the record contents in the ISO2709 syntax. Read the
- description of the MARC representation facility below.
+ for representing the record contents in the ISO2709 syntax.
+ Read the description of the MARC representation facility below.
</para>
- </listitem></varlistentry>
+ </listitem>
+ </varlistentry>
<varlistentry>
- <term>esetname <emphasis>name filename</emphasis></term>
+ <term>esetname <replaceable>name filename</replaceable></term>
<listitem>
<para>
(o,r) Associates the
given in place of the filename, this corresponds to a null mapping for
the given element set name.
</para>
- </listitem></varlistentry>
+ </listitem>
+ </varlistentry>
<varlistentry>
- <term>any <emphasis>tags</emphasis></term>
+ <term>any <replaceable>tags</replaceable></term>
<listitem>
<para>
(o) This directive specifies a list of attributes
provides an efficient way of supporting free-text searching across all
elements. However, it does increase the size of the index
significantly. The attributes can be qualified with a structure, as in
- the <emphasis>elm</emphasis> directive below.
+ the <replaceable>elm</replaceable> directive below.
</para>
- </listitem></varlistentry>
+ </listitem>
+ </varlistentry>
<varlistentry>
- <term>elm <emphasis>path name attributes</emphasis></term>
+ <term>elm <replaceable>path name attributes</replaceable></term>
<listitem>
<para>
(o,r) Adds an element to the abstract record syntax of the schema.
- The <emphasis>path</emphasis> follows the
+ The <replaceable>path</replaceable> follows the
syntax which is suggested by the Z39.50 document - that is, a sequence
- of tags separated by slashes (/). Each tag is given as a
+ of tags separated by slashes (/). Each tag is given as a
comma-separated pair of tag type and -value surrounded by parenthesis.
- The <emphasis>name</emphasis> is the name of the element, and
- the <emphasis>attributes</emphasis>
+ The <replaceable>name</replaceable> is the name of the element, and
+ the <replaceable>attributes</replaceable>
specifies which attributes to use when indexing the element in a
comma-separated list.
A ! in place of the attribute name is equivalent to
specifying an attribute name identical to the element name.
A - in place of the attribute name
specifies that no indexing is to take place for the given element.
- The attributes can be qualified with <emphasis>field
- types</emphasis> to specify which
+ The attributes can be qualified with <replaceable>field
+ types</replaceable> to specify which
character set should govern the indexing procedure for that field.
The same data element may be indexed into several different
fields, using different character set definitions.
See the <xref linkend="field-structure-and-character-sets"/>.
- The default field type is "w" for <emphasis>word</emphasis>.
+ The default field type is <literal>w</literal> for
+ <emphasis>word</emphasis>.
</para>
- </listitem></varlistentry>
+ </listitem>
+ </varlistentry>
+
+ <varlistentry>
+ <term>xelm <replaceable>xpath attributes</replaceable></term>
+ <listitem>
+ <para>
+ Specifies indexing for record nodes given by
+ <replaceable>xpath</replaceable>. Unlike directive
+ elm, this directive allows you to index attribute
+ contents. The <replaceable>xpath</replaceable> uses
+ a syntax similar to XPath. The <replaceable>attributes</replaceable>
+ have same syntax and meaning as directive elm, except that operator
+ ! refers to the nodes selected by <replaceable>xpath</replaceable>.
+ <!--
+ xelm / !:w default index
+ xelm // !:w additional index
+ xelm /gils/title/@att myatt:w index attribute @att in myatt
+ xelm title/@att myatt:w same meaning.
+ -->
+ </para>
+ </listitem>
+ </varlistentry>
+
<varlistentry>
- <term>encoding <emphasis>encodingname</emphasis></term>
+ <term>encoding <replaceable>encodingname</replaceable></term>
<listitem>
<para>
This directive specifies character encoding for external records.
For records such as XML that specifies encoding within the
file via a header this directive is ignored.
If neither this directive is given, nor an encoding is set
- within external records, ISO-8859-1 encoding is assmed.
+ within external records, ISO-8859-1 encoding is assumed.
</para>
</listitem>
</varlistentry>
<varlistentry>
- <term>xpath <emphasis>enable/disable</emphasis></term>
+ <term>xpath <literal>enable</literal>/<literal>disable</literal></term>
<listitem>
<para>
If this directive is followed by <literal>enable</literal>,
</para>
</listitem>
</varlistentry>
+
+ <!-- Adam's version
+ <varlistentry>
+ <term>systag <replaceable>systemtag</replaceable> <replaceable>element</replaceable></term>
+ <listitem>
+ <para>
+ This directive maps system information to an element during
+ retrieval. This information is dynamically created. The
+ following system tags are defined
+ <variablelist>
+ <varlistentry>
+ <term>size</term>
+ <listitem>
+ <para>
+ Size of record in bytes. By default this
+ is mapped to element <literal>size</literal>.
+ </para>
+ </listitem>
+ </varlistentry>
+
+ <varlistentry>
+ <term>rank</term>
+ <listitem>
+ <para>
+ Score/rank of record. By default this
+ is mapped to element <literal>rank</literal>.
+ If no score was calculated for the record (non-ranked
+ searched) search this directive is ignored.
+ </para>
+ </listitem>
+ </varlistentry>
+
+ <varlistentry>
+ <term>sysno</term>
+ <listitem>
+ <para>
+ Zebra's system number (record ID) for the
+ record. By default this is mapped to element
+ <literal>localControlNumber</literal>.
+ </para>
+ </listitem>
+ </varlistentry>
+ </variablelist>
+ If you do not want a particular system tag to be applied,
+ then set the resulting element to something undefined in the
+ abs file (such as <literal>none</literal>).
+ </para>
+ </listitem>
+ </varlistentry>
+ -->
+
+ <!-- Mike's version -->
+ <varlistentry>
+ <term>
+ systag
+ <replaceable>systemTag</replaceable>
+ <replaceable>actualTag</replaceable>
+ </term>
+ <listitem>
+ <para>
+ Specifies what information, if any, Zebra should
+ automatically include in retrieval records for the
+ ``system fields'' that it supports.
+ <replaceable>systemTag</replaceable> may
+ be any of the following:
+ <variablelist>
+ <varlistentry>
+ <term><literal>rank</literal></term>
+ <listitem><para>
+ An integer indicating the relevance-ranking score
+ assigned to the record.
+ </para></listitem>
+ </varlistentry>
+ <varlistentry>
+ <term><literal>sysno</literal></term>
+ <listitem><para>
+ An automatically generated identifier for the record,
+ unique within this database. It is represented by the
+ <literal><localControlNumber></literal> element in
+ XML and the <literal>(1,14)</literal> tag in GRS-1.
+ </para></listitem>
+ </varlistentry>
+ <varlistentry>
+ <term><literal>size</literal></term>
+ <listitem><para>
+ The size, in bytes, of the retrieved record.
+ </para></listitem>
+ </varlistentry>
+ </variablelist>
+ </para>
+ <para>
+ The <replaceable>actualTag</replaceable> parameter may be
+ <literal>none</literal> to indicate that the named element
+ should be omitted from retrieval records.
+ </para>
+ </listitem>
+ </varlistentry>
</variablelist>
</para>
esetname G gils-g.est
esetname F @
- elm (1,10) rank -
- elm (1,12) url -
- elm (1,14) localControlNumber Local-number
- elm (1,16) dateOfLastModification Date/time-last-modified
- elm (2,1) title w:!,p:!
- elm (4,1) controlIdentifier Identifier-standard
- elm (2,6) abstract Abstract
- elm (4,51) purpose !
- elm (4,52) originator -
- elm (4,53) accessConstraints !
- elm (4,54) useConstraints !
- elm (4,70) availability -
- elm (4,70)/(4,90) distributor -
- elm (4,70)/(4,90)/(2,7) distributorName !
- elm (4,70)/(4,90)/(2,10 distributorOrganization !
- elm (4,70)/(4,90)/(4,2) distributorStreetAddress !
- elm (4,70)/(4,90)/(4,3) distributorCity !
+ elm (1,10) rank -
+ elm (1,12) url -
+ elm (1,14) localControlNumber Local-number
+ elm (1,16) dateOfLastModification Date/time-last-modified
+ elm (2,1) title w:!,p:!
+ elm (4,1) controlIdentifier Identifier-standard
+ elm (2,6) abstract Abstract
+ elm (4,51) purpose !
+ elm (4,52) originator -
+ elm (4,53) accessConstraints !
+ elm (4,54) useConstraints !
+ elm (4,70) availability -
+ elm (4,70)/(4,90) distributor -
+ elm (4,70)/(4,90)/(2,7) distributorName !
+ elm (4,70)/(4,90)/(2,10) distributorOrganization !
+ elm (4,70)/(4,90)/(4,2) distributorStreetAddress !
+ elm (4,70)/(4,90)/(4,3) distributorCity !
</screen>
</para>
<title>The Attribute Set (.att) Files</title>
<para>
- This file type describes the <emphasis>Use</emphasis> elements of
+ This file type describes the <replaceable>Use</replaceable> elements of
an attribute set.
It contains the following directives.
</para>
<para>
<variablelist>
<varlistentry>
- <term>name <emphasis>symbolic-name</emphasis></term>
+ <term>name <replaceable>symbolic-name</replaceable></term>
<listitem>
<para>
(m) This provides a shorthand name or
</para>
</listitem></varlistentry>
<varlistentry>
- <term>reference <emphasis>OID-name</emphasis></term>
+ <term>reference <replaceable>OID-name</replaceable></term>
<listitem>
<para>
(m) The reference name of the OID for
the attribute set.
- The reference names can be found in the <emphasis>util</emphasis>
- module of <emphasis>YAZ</emphasis>.
+ The reference names can be found in the <replaceable>util</replaceable>
+ module of <replaceable>YAZ</replaceable>.
</para>
</listitem></varlistentry>
<varlistentry>
- <term>include <emphasis>filename</emphasis></term>
+ <term>include <replaceable>filename</replaceable></term>
<listitem>
<para>
(o,r) This directive is used to
include another attribute set as a part of the current one. This is
used when a new attribute set is defined as an extension to another
set. For instance, many new attribute sets are defined as extensions
- to the <emphasis>bib-1</emphasis> set.
+ to the <replaceable>bib-1</replaceable> set.
This is an important feature of the retrieval
system of Z39.50, as it ensures the highest possible level of
interoperability, as those access points of your database which are
</listitem></varlistentry>
<varlistentry>
<term>att
- <emphasis>att-value att-name [local-value]</emphasis></term>
+ <replaceable>att-value att-name [local-value]</replaceable></term>
<listitem>
<para>
(o,r) This
repeatable directive introduces a new attribute to the set. The
attribute value is stored in the index (unless a
- <emphasis>local-value</emphasis> is
+ <replaceable>local-value</replaceable> is
given, in which case this is stored). The name is used to refer to the
- attribute from the <emphasis>abstract syntax</emphasis>.
+ attribute from the <replaceable>abstract syntax</replaceable>.
</para>
</listitem></varlistentry>
</variablelist>
projects / idzebra-moved-to-github.git / blobdiff