pazpar2-moved-to-github.git
17 years agopz2.js part of dist
Adam Dickmeiss [Mon, 18 Jun 2007 18:16:57 +0000 (18:16 +0000)]
pz2.js part of dist

17 years agoNotes on changes in Debian package
Adam Dickmeiss [Mon, 18 Jun 2007 13:44:51 +0000 (13:44 +0000)]
Notes on changes in Debian package

17 years agoMake init script LSB compliant. http://wiki.debian.org/LSBInitScripts .
Adam Dickmeiss [Mon, 18 Jun 2007 13:43:23 +0000 (13:43 +0000)]
Make init script LSB compliant. wiki.debian.org/LSBInitScripts .

17 years agoMake NEWS part of Debian package
Adam Dickmeiss [Mon, 18 Jun 2007 13:15:52 +0000 (13:15 +0000)]
Make NEWS part of Debian package

17 years agoDefault pazpar2 installation listens on port 8004. It is not in use
Adam Dickmeiss [Mon, 18 Jun 2007 13:04:50 +0000 (13:04 +0000)]
Default pazpar2 installation listens on port 8004. It is not in use
by an existing service, AFAIK.

17 years agoAdded man page for the pazpar2 daemon. Volume is now 8 rather than 1
Adam Dickmeiss [Mon, 18 Jun 2007 12:55:43 +0000 (12:55 +0000)]
Added man page for the pazpar2 daemon. Volume is now 8 rather than 1
because it's a daemon.

17 years agoUse /usr/sbin/pazpar2 rather than /usr/bin/pazpar2
Adam Dickmeiss [Mon, 18 Jun 2007 12:38:30 +0000 (12:38 +0000)]
Use /usr/sbin/pazpar2 rather than /usr/bin/pazpar2

17 years agoInstall pazpar2 in /usr/sbin rather than /usr/bin
Adam Dickmeiss [Mon, 18 Jun 2007 12:37:54 +0000 (12:37 +0000)]
Install pazpar2 in /usr/sbin rather than /usr/bin

17 years agoSort options
Adam Dickmeiss [Mon, 18 Jun 2007 12:37:39 +0000 (12:37 +0000)]
Sort options

17 years agoInclude usr/sbin in pazpar2.dirs
Adam Dickmeiss [Mon, 18 Jun 2007 12:37:16 +0000 (12:37 +0000)]
Include usr/sbin in pazpar2.dirs

17 years agoFirst version with start/stop script. The configuration lives in
Adam Dickmeiss [Mon, 18 Jun 2007 11:46:14 +0000 (11:46 +0000)]
First version with start/stop script. The configuration lives in
/etc/pazpar2 . The default configuration writes PID file in
/var/run/pazpar2.pid. The log file is written to /var/log/pazpar2.log.
The pazpar2 process is running as nobody.

17 years agoPidfile was written with wrong PID. Bug introduced in previous commit.
Adam Dickmeiss [Mon, 18 Jun 2007 11:44:43 +0000 (11:44 +0000)]
Pidfile was written with wrong PID. Bug introduced in previous commit.

17 years agoAdded option -D which puts pazpar2 in background. This improves the
Adam Dickmeiss [Mon, 18 Jun 2007 11:10:20 +0000 (11:10 +0000)]
Added option -D which puts pazpar2 in background. This improves the
startup process when pazpar2 is used in start scripts such as Debian's
start-stop-daemon. Without -D, pazpar2 would have to be started using
-b for start-stop-daemon. Refer to man page start-stop-daemon(8).
This change also makes pazpar2 change uid before the daemon is running.
We just ensure that HTTP binding and YAZ log files, PID files are dealt with
before any setuid takes place.. Pazpar2 makes log entry with version
info. The daemon mode refuses to start if -l is not given. This is to ensure
that logfile output is not dumped to /dev/null by accident.

17 years agoDisable linking of pz2.js. It breaks make dist
Adam Dickmeiss [Sun, 17 Jun 2007 19:17:50 +0000 (19:17 +0000)]
Disable linking of pz2.js. It breaks make dist

17 years agoJavascript util js/pz2.js part of dist. This is installed in
Adam Dickmeiss [Sun, 17 Jun 2007 18:24:02 +0000 (18:24 +0000)]
Javascript util js/pz2.js part of dist. This is installed in
PREFIX/usr/share/papazpar2/js and is also part of the Debian package.

17 years agoOnly one include of stdio.h and with _GNU_SOURCE defined.
Adam Dickmeiss [Sun, 17 Jun 2007 18:22:49 +0000 (18:22 +0000)]
Only one include of stdio.h and with _GNU_SOURCE defined.
Added include of "cconfig.h". _all_ Pazpar2 source must include it.

17 years agoPazpar2 require YAZ 3
Adam Dickmeiss [Sun, 17 Jun 2007 07:53:18 +0000 (07:53 +0000)]
Pazpar2 require YAZ 3

17 years agoAvoid non-zero exit in make dist of Debian part
Adam Dickmeiss [Sun, 17 Jun 2007 07:52:20 +0000 (07:52 +0000)]
Avoid non-zero exit in make dist of Debian part

17 years agoAdded Original Debian dh_make output files. These files should not
Adam Dickmeiss [Sun, 17 Jun 2007 07:50:50 +0000 (07:50 +0000)]
Added Original Debian dh_make output files. These files should not
be part of the distribution. They just serve as examples .. includes
init-scripts etc.

17 years agoFirst Debian package. Only tested on Debian testing (lenny).
Adam Dickmeiss [Sun, 17 Jun 2007 07:47:57 +0000 (07:47 +0000)]
First Debian package. Only tested on Debian testing (lenny).

17 years agoRemoved definition of docdir. It is set by automake already
Adam Dickmeiss [Sun, 17 Jun 2007 07:05:21 +0000 (07:05 +0000)]
Removed definition of docdir. It is set by automake already

17 years agoicu_chain_test is a noinst program at this stage
Adam Dickmeiss [Sun, 17 Jun 2007 07:04:37 +0000 (07:04 +0000)]
icu_chain_test is a noinst program at this stage

17 years agoUse block=1 in test of show command
Adam Dickmeiss [Sat, 16 Jun 2007 07:23:00 +0000 (07:23 +0000)]
Use block=1 in test of show command

17 years agoWork on bug #1192: block=1, session_watch problems. The http_channel
Adam Dickmeiss [Fri, 15 Jun 2007 19:35:17 +0000 (19:35 +0000)]
Work on bug #1192: block=1, session_watch problems. The http_channel
now includes an observer interface so that objects using it
can be notified when it's destroyed. This is combined with the
watch mechanism. Tests shows that this change fixes first problem
as described in bug #1192. Second problem is also fixed. If a watch
is already registered on show records, subsequent requests will not
block. The third and fourth problems are not solved by this. While
the show raw (pass through) does not uses session watch, it is still
fixed to use the http_channel observer. This commit also fixes two
leaks.

17 years agoOoops. Not using same result set ID for search & present. Pazpar2
Adam Dickmeiss [Fri, 15 Jun 2007 06:55:16 +0000 (06:55 +0000)]
Ooops. Not using same result set ID for search & present. Pazpar2
now no longer sets resultSetId for search/present. zget_.. does it
just right. The ID is 'default' (Not 'Default').

17 years agoExtended command 'record' so that XML representation of original record
Adam Dickmeiss [Fri, 15 Jun 2007 06:45:39 +0000 (06:45 +0000)]
Extended command 'record' so that XML representation of original record
can be returned. Bug #1172. If parameter 'offset' is given for command
'record' the original record is returned and offset is the record offset
within cluster (merged) record, where 0=first, 1=second, etc.. If no record
at offset is given diagnostic RECORD_FAIL is returned.  When offset
is given, the value of parameter 'syntax' and 'esn' specifies the
record syntax and element set respectively. If any of these are omitted
the present request also omits them. The code to convert from 'raw' to
XML is combined into one function record_to_xml. Note that OPAC records
are not converted to XML yet.

17 years agoUpdate test_record test for new arg to record_create
Adam Dickmeiss [Wed, 13 Jun 2007 21:30:08 +0000 (21:30 +0000)]
Update test_record test for new arg to record_create

17 years agoWork on bug #1172. Save result set postition for each record in a
Adam Dickmeiss [Wed, 13 Jun 2007 21:29:04 +0000 (21:29 +0000)]
Work on bug #1172. Save result set postition for each record in a
cluster.

17 years agoclear simple query was missing
Jakub Skoczen [Wed, 13 Jun 2007 17:25:02 +0000 (17:25 +0000)]
clear simple query was missing

17 years agostop function implemented.
Jakub Skoczen [Wed, 13 Jun 2007 17:20:17 +0000 (17:20 +0000)]
stop function implemented.

17 years agoPost request possible with pzHttpRequest class.
Jakub Skoczen [Wed, 13 Jun 2007 16:07:43 +0000 (16:07 +0000)]
Post request possible with pzHttpRequest class.

17 years agoFixed bug #1187: command=show crashes if used before a search is
Adam Dickmeiss [Wed, 13 Jun 2007 13:04:34 +0000 (13:04 +0000)]
Fixed bug #1187: command=show crashes if used before a search is
performed. Also changed log of session destroy to actually log what
session gets destroyed.

17 years agoFor errors, pazpar2 returns diagnostic 'code', 'msg' (text representation
Adam Dickmeiss [Wed, 13 Jun 2007 08:04:03 +0000 (08:04 +0000)]
For errors, pazpar2 returns diagnostic 'code', 'msg' (text representation
of code) + additional info for error. This allows clients to handle errors
in more proper manner.

17 years agoOption -p specifies pidfile. Option -u specifies uid for child process.
Adam Dickmeiss [Tue, 12 Jun 2007 13:02:38 +0000 (13:02 +0000)]
Option -p specifies pidfile. Option -u specifies uid for child process.
Non-zero exit code makes pazpar2 stop completely.

17 years agoRemoved dead code
Adam Dickmeiss [Tue, 12 Jun 2007 09:26:40 +0000 (09:26 +0000)]
Removed dead code

17 years agoFix problem with show not showing all records. Fixed encoding of
Adam Dickmeiss [Mon, 11 Jun 2007 13:33:04 +0000 (13:33 +0000)]
Fix problem with show not showing all records. Fixed encoding of
query term in refine_query.

17 years agoIgnore this.
Adam Dickmeiss [Mon, 11 Jun 2007 12:20:00 +0000 (12:20 +0000)]
Ignore this.

17 years agoUpdate test due to slightly different relevance rank output that
Adam Dickmeiss [Mon, 11 Jun 2007 12:18:36 +0000 (12:18 +0000)]
Update test due to slightly different relevance rank output that
occurred with fix of bug #1185.

17 years agoSet termlist highscore to 25. It took an hour to figure out why
Adam Dickmeiss [Mon, 11 Jun 2007 12:08:23 +0000 (12:08 +0000)]
Set termlist highscore to 25. It took an hour to figure out why
command=termlist&num=20 did NOT work!

17 years agoFixed bug #1185: metadata includes entities. This minor change makes
Adam Dickmeiss [Mon, 11 Jun 2007 12:02:48 +0000 (12:02 +0000)]
Fixed bug #1185: metadata includes entities. This minor change makes
the internal data raw and without entities. It missing xmlputs for
records explained why this worked before. However, the termlist output
was bad, because xmlputs were used and so it was _double_ &amp escaped.
This could explain why entities were seen by some on the facet output.

17 years agoRemoved unused code
Adam Dickmeiss [Fri, 8 Jun 2007 13:58:46 +0000 (13:58 +0000)]
Removed unused code

17 years agoProcess management/respawn. Bug #1173. PID file pazpar2.pid generated
Adam Dickmeiss [Fri, 8 Jun 2007 13:57:19 +0000 (13:57 +0000)]
Process management/respawn. Bug #1173. PID file pazpar2.pid generated
by default.

17 years agoGet rid of record_assign_client
Adam Dickmeiss [Thu, 7 Jun 2007 12:27:03 +0000 (12:27 +0000)]
Get rid of record_assign_client

17 years agoupdated documentation of Z39.50 proxying in settings config section
Marc Cromme [Wed, 6 Jun 2007 12:02:48 +0000 (12:02 +0000)]
updated documentation of Z39.50 proxying in settings config section

17 years agoremoved dead, commened out code left from removing global Z39.50 proxying
Marc Cromme [Wed, 6 Jun 2007 11:56:35 +0000 (11:56 +0000)]
removed dead, commened out code left from removing global Z39.50 proxying

17 years agoremoved Z39.50 Proxy functionality from parameters global overrides and moved into...
Marc Cromme [Wed, 6 Jun 2007 11:49:48 +0000 (11:49 +0000)]
removed Z39.50 Proxy functionality from parameters global overrides and moved into the session settings. Added new setting 'pz:zproxy' for the same.

17 years agoUpdate documentation about ProxyPass.
Adam Dickmeiss [Wed, 6 Jun 2007 11:33:18 +0000 (11:33 +0000)]
Update documentation about ProxyPass.

17 years agoforgot a closing XML element '>' .. now targets state info is wellformed XML
Marc Cromme [Wed, 6 Jun 2007 09:00:56 +0000 (09:00 +0000)]
forgot a closing XML element '>' .. now targets state info is wellformed XML

17 years agoNew function: stop
Jakub Skoczen [Tue, 5 Jun 2007 15:19:25 +0000 (15:19 +0000)]
New function: stop
              clearSimpleQuery

17 years agoprevent sending empty XML elements in term lists.
Marc Cromme [Tue, 5 Jun 2007 14:09:10 +0000 (14:09 +0000)]
prevent sending empty XML elements in term lists.
In target term lists, empty names are replaced by 'NO TARGET NAME' to be visible, in ordinary dynamic term lists terms without ndisplay names are jumped over.
Fixed bug #1161

17 years agoChanged all wrbuf_printf statements involving strings, like
Marc Cromme [Tue, 5 Jun 2007 13:36:40 +0000 (13:36 +0000)]
Changed all wrbuf_printf statements involving strings, like
wrbuf_printf(wrbuf, "<id>%s</id>\n", ht[i].id);
to the save XML entity-encoded form using wrbuf_xmlputs(..).

Left all  wrbuf_printf statements involving integers as they are, for example
wrbuf_printf(c->wrbuf, "<hits>%d</hits>\n", stat.num_hits);
as these can not go wrong with the 5 XML entities.

Tested, and working, Bug #1163 closed.

17 years agoRemoved payload log msg for well-formed payload
Adam Dickmeiss [Mon, 4 Jun 2007 14:44:22 +0000 (14:44 +0000)]
Removed payload log msg for well-formed payload

17 years agoWork on bug #1162.. PP2 right now always dump the payload text/xml
Adam Dickmeiss [Mon, 4 Jun 2007 14:27:48 +0000 (14:27 +0000)]
Work on bug #1162.. PP2 right now always dump the payload text/xml
response for our convenience. It warns if it's non-wellformed .

17 years agoCont.
Jakub Skoczen [Mon, 4 Jun 2007 12:49:21 +0000 (12:49 +0000)]
Cont.

17 years agocontinued.
Jakub Skoczen [Mon, 4 Jun 2007 12:31:07 +0000 (12:31 +0000)]
continued.

17 years agoHandling empty nodes in the termlists.
Jakub Skoczen [Mon, 4 Jun 2007 12:24:59 +0000 (12:24 +0000)]
Handling empty nodes in the termlists.

17 years agoAdded section about using Apache 2's Proxy.
Adam Dickmeiss [Mon, 4 Jun 2007 11:00:54 +0000 (11:00 +0000)]
Added section about using Apache 2's Proxy.

17 years agoWhen using xslt stylesheet record data will a recid member.
Jakub Skoczen [Mon, 4 Jun 2007 10:56:28 +0000 (10:56 +0000)]
When using xslt stylesheet record data will a recid member.

17 years agoUse idcommon instead of common for entities.
Adam Dickmeiss [Mon, 4 Jun 2007 10:34:06 +0000 (10:34 +0000)]
Use idcommon instead of common for entities.

17 years agoFixed Bug #1044 -- connections should no lomnger be re-used if authent tokens
Sebastian Hammer [Sat, 2 Jun 2007 04:32:28 +0000 (04:32 +0000)]
Fixed Bug #1044 -- connections should no lomnger be re-used if authent tokens
don't match.

17 years agoAdded diagnostic cocde for NSD response records
Sebastian Hammer [Sat, 2 Jun 2007 03:37:55 +0000 (03:37 +0000)]
Added diagnostic cocde for NSD response records

17 years agoParse XML records from targets if they are received.
Adam Dickmeiss [Fri, 1 Jun 2007 10:38:08 +0000 (10:38 +0000)]
Parse XML records from targets if they are received.

17 years agoEncoding the URI properly .
Jakub Skoczen [Fri, 1 Jun 2007 09:19:58 +0000 (09:19 +0000)]
Encoding the URI properly .

17 years agochange
Jakub Skoczen [Fri, 1 Jun 2007 08:25:53 +0000 (08:25 +0000)]
change

17 years agochange
Jakub Skoczen [Fri, 1 Jun 2007 08:22:32 +0000 (08:22 +0000)]
change

17 years agochange
Jakub Skoczen [Fri, 1 Jun 2007 08:20:39 +0000 (08:20 +0000)]
change

17 years agoForm url encoded.
Jakub Skoczen [Fri, 1 Jun 2007 08:16:12 +0000 (08:16 +0000)]
Form url encoded.

17 years agoChanging the request header.
Jakub Skoczen [Fri, 1 Jun 2007 08:06:17 +0000 (08:06 +0000)]
Changing the request header.

17 years agoSimple query was unesesary escaped with quotes.
Jakub Skoczen [Thu, 31 May 2007 08:46:32 +0000 (08:46 +0000)]
Simple query was unesesary escaped with quotes.

17 years agoRemoved settings
Sebastian Hammer [Thu, 31 May 2007 05:15:42 +0000 (05:15 +0000)]
Removed settings

17 years agomoved declarations and definitions before actual instructions to keep old compilers...
Marc Cromme [Tue, 29 May 2007 07:16:50 +0000 (07:16 +0000)]
moved declarations and definitions before actual instructions to keep old compilers happy

17 years agorenamed instruction 'norm' to 'index' and 'sort' to sortkey'. otherwise no changes
Marc Cromme [Fri, 25 May 2007 13:27:21 +0000 (13:27 +0000)]
renamed instruction 'norm' to 'index' and 'sort' to sortkey'. otherwise no changes

17 years agoadded ICU urls and a section on ICU tokenization and normalization
Marc Cromme [Fri, 25 May 2007 12:30:27 +0000 (12:30 +0000)]
added ICU urls and a section on ICU tokenization and normalization

17 years agoremoved debug print statements
Marc Cromme [Fri, 25 May 2007 10:32:55 +0000 (10:32 +0000)]
removed debug print statements

17 years agoFixed non-icu compilation
Adam Dickmeiss [Fri, 25 May 2007 06:51:35 +0000 (06:51 +0000)]
Fixed non-icu compilation

17 years agotook sizeof of the wrong variable.. darnit
Sebastian Hammer [Fri, 25 May 2007 03:58:04 +0000 (03:58 +0000)]
took sizeof of the wrong variable.. darnit

17 years agoSimilar to pazpar2.cfg.dist but with ICU stuff in it. Seems to
Adam Dickmeiss [Thu, 24 May 2007 11:10:26 +0000 (11:10 +0000)]
Similar to pazpar2.cfg.dist but with ICU stuff in it. Seems to
work quite well at this time.

17 years agoMinor rearrangements. Prints normalized terms to console in
Adam Dickmeiss [Thu, 24 May 2007 11:09:27 +0000 (11:09 +0000)]
Minor rearrangements. Prints normalized terms to console in
ICU mode (must be removed or controlled later).

17 years agoCosmetic
Adam Dickmeiss [Thu, 24 May 2007 10:57:38 +0000 (10:57 +0000)]
Cosmetic

17 years agoRemoved unneeded initialization of more_tokens and need_new_token.
Adam Dickmeiss [Thu, 24 May 2007 10:56:38 +0000 (10:56 +0000)]
Removed unneeded initialization of more_tokens and need_new_token.
Simplified initialization of buf16 chain member.

17 years agoTest for bug 1140 now passes
Adam Dickmeiss [Thu, 24 May 2007 10:52:36 +0000 (10:52 +0000)]
Test for bug 1140 now passes

17 years agoFixed bug #1140: Unexpected EOF for icu_chain_next_token. The
Adam Dickmeiss [Thu, 24 May 2007 10:51:36 +0000 (10:51 +0000)]
Fixed bug #1140: Unexpected EOF for icu_chain_next_token. The
need_new_token was left in an unitialized state (from last round).

17 years agoAdded test case for bug #1140 in routine test_bug_1140. Is not currently
Adam Dickmeiss [Thu, 24 May 2007 10:35:21 +0000 (10:35 +0000)]
Added test case for bug #1140 in routine test_bug_1140. Is not currently
called from main (#if 0 block).

17 years agoNew pazpar2 option -X which puts pazpar2 in debug (insecure) mode.
Adam Dickmeiss [Wed, 23 May 2007 21:58:28 +0000 (21:58 +0000)]
New pazpar2 option -X which puts pazpar2 in debug (insecure) mode.
At this point (-X) only affects the session ID creation.

17 years agoFirst ICU chain integration in relevance ranking of pazpar2.
Marc Cromme [Wed, 23 May 2007 14:44:18 +0000 (14:44 +0000)]
First ICU chain integration in relevance ranking of pazpar2.
Tokenization not working correctly, need more debugging.

17 years agoICU chain loaded imder configuration of server. This happens only if ICU support...
Marc Cromme [Wed, 23 May 2007 11:19:31 +0000 (11:19 +0000)]
ICU chain loaded imder configuration of server. This happens only if ICU support is compiled in, and additionally, an ICU chain config section is present in the main pazpar2.cfg XML file.

17 years agoIgnore executable
Adam Dickmeiss [Wed, 23 May 2007 10:04:55 +0000 (10:04 +0000)]
Ignore executable

17 years agoHTTP error handler yaz_logs and uses yaz_snprintf to prevent buffer
Adam Dickmeiss [Wed, 23 May 2007 09:57:54 +0000 (09:57 +0000)]
HTTP error handler yaz_logs and uses yaz_snprintf to prevent buffer
overflows. Queries are checked for UTF-8 correctness. This works best
with YAZ 3.0.5 or later.

17 years agoRemoved bug with improper utf-8 query encoding.
Jakub Skoczen [Wed, 23 May 2007 09:18:10 +0000 (09:18 +0000)]
Removed bug with improper utf-8 query encoding.

17 years agouse <form accept-charset='UTF-8'
Marc Cromme [Wed, 23 May 2007 09:08:10 +0000 (09:08 +0000)]
use  <form accept-charset='UTF-8'

17 years agoprotect from missing ICU development environment by #ifdef HAVE_ICU , such that build...
Marc Cromme [Wed, 23 May 2007 06:42:25 +0000 (06:42 +0000)]
protect from missing ICU development environment by #ifdef HAVE_ICU , such that build process can continue on platforms missing ICU

17 years agofinished test ICU stand-allone program for benchmarking of ICU tokenization and norma...
Marc Cromme [Tue, 22 May 2007 21:20:10 +0000 (21:20 +0000)]
finished test ICU stand-allone program for benchmarking of ICU tokenization and normalization. Works quite well, benchmarking on the James English Bible from Project Gutenberg (4,5 MB plain text consisting of 870.000 individual tokens) took 3.5 seconds on a laptop. More testing/benchmarking is needed.

17 years agostarted stand-allone ICU test
Marc Cromme [Tue, 22 May 2007 08:26:59 +0000 (08:26 +0000)]
started stand-allone ICU test

17 years agoAdded a few frees here and there
Adam Dickmeiss [Tue, 22 May 2007 07:51:45 +0000 (07:51 +0000)]
Added a few frees here and there

17 years agoICU chain XML configuration up and running, used in unit test as well.
Marc Cromme [Mon, 21 May 2007 10:14:08 +0000 (10:14 +0000)]
ICU chain XML configuration up and running, used in unit test as well.

17 years agoCounters and timers cd.
Jakub Skoczen [Mon, 21 May 2007 10:10:41 +0000 (10:10 +0000)]
Counters and timers cd.

17 years agoNo longer relevant.
Jakub Skoczen [Mon, 21 May 2007 09:23:14 +0000 (09:23 +0000)]
No longer relevant.

17 years agoCorrected timers and counters.
Jakub Skoczen [Mon, 21 May 2007 09:07:43 +0000 (09:07 +0000)]
Corrected timers and counters.

17 years agoCreating symlinks for the pz2.js during the configure process
Jakub Skoczen [Mon, 21 May 2007 08:21:33 +0000 (08:21 +0000)]
Creating symlinks for the pz2.js during the configure process

17 years agoICU chain working correctly with tokenizer, normalizer and casemap operations, and...
Marc Cromme [Sun, 20 May 2007 19:00:17 +0000 (19:00 +0000)]
ICU chain working correctly with tokenizer, normalizer and casemap operations, and data extraction in normalform, sortkey form and display form all possible. New unit test added