metaproxy-moved-to-github.git
12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 13:21:56 +0000 (15:21 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.32 v1.3.32
Adam Dickmeiss [Tue, 24 Apr 2012 13:05:50 +0000 (15:05 +0200)]
Version 1.3.32

12 years agosru_z3950: pass through incoming Z39.50 requests
Adam Dickmeiss [Tue, 24 Apr 2012 12:58:08 +0000 (14:58 +0200)]
sru_z3950: pass through incoming Z39.50 requests

sru_z3950 filter passes through incoming Z39.50 requests again. Was
not handled by mistake in Metaproxy versions 1.3.29, 1.3.30 and 1.3.31.

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 12:30:19 +0000 (14:30 +0200)]
Merge branch 'master' into graceful_stop

12 years agoDo not build for Debian lenny anymore
Adam Dickmeiss [Tue, 24 Apr 2012 12:30:08 +0000 (14:30 +0200)]
Do not build for Debian lenny anymore

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 12:14:52 +0000 (14:14 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.31 v1.3.31
Adam Dickmeiss [Tue, 24 Apr 2012 10:31:24 +0000 (12:31 +0200)]
Version 1.3.31

12 years agozoom: refactor retry logic to separate function
Adam Dickmeiss [Tue, 24 Apr 2012 10:26:46 +0000 (12:26 +0200)]
zoom: refactor retry logic to separate function

12 years agozoom: properly handle proxy failover for re-used backends
Adam Dickmeiss [Tue, 24 Apr 2012 10:08:36 +0000 (12:08 +0200)]
zoom: properly handle proxy failover for re-used backends

Also log the diagnostic that is received from the backend in
case of retry/failover because they will be not be returned
via Z39.50/SRU.

12 years agoVersion 1.3.30 v1.3.30
Adam Dickmeiss [Mon, 23 Apr 2012 18:07:15 +0000 (20:07 +0200)]
Version 1.3.30

12 years agoUpdate NEWS
Adam Dickmeiss [Mon, 23 Apr 2012 18:02:48 +0000 (20:02 +0200)]
Update NEWS

12 years agozoom: proxy error returns diagnostic Bib-1:1014 / SRU:3
Adam Dickmeiss [Sat, 21 Apr 2012 08:35:14 +0000 (10:35 +0200)]
zoom: proxy error returns diagnostic Bib-1:1014 / SRU:3

12 years agozoom: return addinfo="proxy failure" for proxy failures
Adam Dickmeiss [Sat, 21 Apr 2012 08:24:44 +0000 (10:24 +0200)]
zoom: return addinfo="proxy failure" for proxy failures

This commit also changes the scheme for dealing with proxies a bit.
zoom now always do "proxy-check", even if there's no failover.
Fortunately, that's not very expensive.

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Fri, 20 Apr 2012 13:31:29 +0000 (15:31 +0200)]
Merge branch 'master' into graceful_stop

12 years agozoom: implement cunning scheme for retry/proxy failover
Adam Dickmeiss [Fri, 20 Apr 2012 13:00:07 +0000 (15:00 +0200)]
zoom: implement cunning scheme for retry/proxy failover

12 years agosession_shared: disable session retry by default
Adam Dickmeiss [Fri, 20 Apr 2012 12:58:29 +0000 (14:58 +0200)]
session_shared: disable session retry by default

Can be enabled by restart="true" in resultset section.

12 years agozoom: guess if invalid response was an auth failure
Adam Dickmeiss [Fri, 20 Apr 2012 09:16:47 +0000 (11:16 +0200)]
zoom: guess if invalid response was an auth failure

12 years agozoom: Init rejected wo diagnostics maps to Bib-1:1014
Adam Dickmeiss [Fri, 20 Apr 2012 08:54:41 +0000 (10:54 +0200)]
zoom: Init rejected wo diagnostics maps to Bib-1:1014

Bib-1 1014, "Init/AC: Authentication System error", seems pretty
generic. We don't know why the init would fail; IP, user, block IP, etc.
sru_z3950 filter maps this to SRU diagnostic 3: "Authentication error".

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Wed, 18 Apr 2012 11:57:31 +0000 (13:57 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.29 v1.3.29
Adam Dickmeiss [Wed, 18 Apr 2012 11:25:27 +0000 (13:25 +0200)]
Version 1.3.29

12 years agozoom: update zoom info on contentProxy
Adam Dickmeiss [Wed, 18 Apr 2012 11:24:31 +0000 (13:24 +0200)]
zoom: update zoom info on contentProxy

12 years agoUpdate NEWS
Adam Dickmeiss [Wed, 18 Apr 2012 11:18:15 +0000 (13:18 +0200)]
Update NEWS

12 years agozoom: may read cf-proxy's config settings
Adam Dickmeiss [Wed, 18 Apr 2012 10:20:20 +0000 (12:20 +0200)]
zoom: may read cf-proxy's config settings

This reduces manual configuration of the content proxy server host.
The %s notation for server is no longer supported. The ZOOM module will
use the old style session.proxyhost if "server" is given (deprecated)
and use the new style proxyhost/session if "config_file" is in use.

12 years agoMinor updates to config zoom example
Adam Dickmeiss [Wed, 18 Apr 2012 08:16:55 +0000 (10:16 +0200)]
Minor updates to config zoom example

12 years agozoom: more configurable format for contentProxy@server
Adam Dickmeiss [Wed, 18 Apr 2012 08:13:37 +0000 (10:13 +0200)]
zoom: more configurable format for contentProxy@server

The proxy attribute of contentProxy element may include a %s magic,
which will be substituted by the session ID. For example
server="proxy.indexdata.com/%s"

12 years agoSignal SIGUSR1 akes a graceful stop
Adam Dickmeiss [Tue, 17 Apr 2012 14:20:03 +0000 (16:20 +0200)]
Signal SIGUSR1 akes a graceful stop

Thus, all Z39.50/HTTP connections to the server are kept alive, but
the listening socket is closed. Signal SIGTERM destroys the server
immediately as before.

12 years agoFrontend_net exits when all sessions have terminated
Adam Dickmeiss [Tue, 17 Apr 2012 12:46:38 +0000 (14:46 +0200)]
Frontend_net exits when all sessions have terminated

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 17 Apr 2012 10:49:12 +0000 (12:49 +0200)]
Merge branch 'master' into graceful_stop

12 years agozoom: simplify cproxyhost XSLT parm passing
Adam Dickmeiss [Tue, 17 Apr 2012 09:28:25 +0000 (11:28 +0200)]
zoom: simplify cproxyhost XSLT parm passing

12 years agoRemove incoming requests that can not be handled
Adam Dickmeiss [Tue, 17 Apr 2012 08:33:12 +0000 (10:33 +0200)]
Remove incoming requests that can not be handled

Requests in queue for filter frontend_net are removed if client
closes connection for the session and request is not yet handled.

12 years agosru_z3950: serialize requests
Adam Dickmeiss [Mon, 16 Apr 2012 12:56:48 +0000 (14:56 +0200)]
sru_z3950: serialize requests

This is to ensure that pipelined HTTP requests are handled
properly.

12 years agosru_z3950: reformat; remove useless comments
Adam Dickmeiss [Fri, 13 Apr 2012 12:14:15 +0000 (14:14 +0200)]
sru_z3950: reformat; remove useless comments

12 years agoBeginnings of graceful stop
Adam Dickmeiss [Tue, 10 Apr 2012 11:43:29 +0000 (13:43 +0200)]
Beginnings of graceful stop

12 years agoFix metaproxy.prerm: missing /bin/sh header
Adam Dickmeiss [Wed, 4 Apr 2012 15:46:23 +0000 (17:46 +0200)]
Fix metaproxy.prerm: missing /bin/sh header

12 years agoVersion 1.3.28 v1.3.28
Adam Dickmeiss [Wed, 4 Apr 2012 11:40:27 +0000 (13:40 +0200)]
Version 1.3.28

12 years agozoom: remove 'xslt successful' message
Adam Dickmeiss [Wed, 4 Apr 2012 08:34:24 +0000 (10:34 +0200)]
zoom: remove 'xslt successful' message

12 years agoNew WRBUF wrapper mp::wrbuf
Adam Dickmeiss [Wed, 4 Apr 2012 08:33:53 +0000 (10:33 +0200)]
New WRBUF wrapper mp::wrbuf

12 years agoVersion 1.3.27 v1.3.27
Adam Dickmeiss [Fri, 30 Mar 2012 11:18:57 +0000 (13:18 +0200)]
Version 1.3.27

12 years agoMetaproxy conflicts with CF 2.12.5 and earlier
Adam Dickmeiss [Fri, 30 Mar 2012 11:14:00 +0000 (13:14 +0200)]
Metaproxy conflicts with CF 2.12.5 and earlier

This is because Metaproxy is running as a different user now -
and old lock files etc, previously created as "nobody" would cause
permission problems for CF.

12 years agoUser info in /etc/metaproxy/metaproxy.user
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:49 +0000 (10:14 +0200)]
User info in /etc/metaproxy/metaproxy.user

12 years agoDebian compat 5
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:30 +0000 (10:14 +0200)]
Debian compat 5

12 years agoRPM: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 13:12:32 +0000 (13:12 +0000)]
RPM: metaproxy running as user "metaproxy"

12 years agoDebian: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 11:08:34 +0000 (13:08 +0200)]
Debian: metaproxy running as user "metaproxy"

New scripts to create and remove this user during installation
and removal.

12 years agoVersion 1.3.26 v1.3.26
Adam Dickmeiss [Tue, 20 Mar 2012 09:58:57 +0000 (10:58 +0100)]
Version 1.3.26

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 20 Mar 2012 09:57:24 +0000 (10:57 +0100)]
Update NEWS

12 years agoRPM metaproxy.xml: add comment about logging
Adam Dickmeiss [Tue, 20 Mar 2012 09:46:58 +0000 (10:46 +0100)]
RPM metaproxy.xml: add comment about logging

in the frontend net filter.

12 years agoSort module documentation, schema, fixes
Adam Dickmeiss [Tue, 20 Mar 2012 09:23:38 +0000 (10:23 +0100)]
Sort module documentation, schema, fixes

12 years agosort: cache sorted records
Adam Dickmeiss [Mon, 19 Mar 2012 22:03:30 +0000 (23:03 +0100)]
sort: cache sorted records

So they can be refetched invidually for example.

12 years agoSort filter using xpath result for sort criteria
Adam Dickmeiss [Mon, 19 Mar 2012 19:15:40 +0000 (20:15 +0100)]
Sort filter using xpath result for sort criteria

Sort order may be given in configuration.

12 years agoFurther work on sort filter .
Adam Dickmeiss [Mon, 19 Mar 2012 15:08:32 +0000 (16:08 +0100)]
Further work on sort filter .

Using x-path for getting score, but this is not yet in use.

12 years agosort: add skeleton for new sort filter
Adam Dickmeiss [Mon, 19 Mar 2012 09:13:24 +0000 (10:13 +0100)]
sort: add skeleton for new sort filter

12 years agotemplate: Use full configure for Impl configure
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:19 +0000 (10:12 +0100)]
template: Use full configure for Impl configure

12 years agoRemove useless comment
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:07 +0000 (10:12 +0100)]
Remove useless comment

12 years agomulti: adjust mediumSetPresentNumber to disable piggyback
Adam Dickmeiss [Fri, 16 Mar 2012 12:42:47 +0000 (13:42 +0100)]
multi: adjust mediumSetPresentNumber to disable piggyback

The value was adjusted from 1 to 0.. It should not make a difference,
but still.

12 years agoProtect the two Usemarcon handles
Adam Dickmeiss [Thu, 8 Mar 2012 16:28:14 +0000 (17:28 +0100)]
Protect the two Usemarcon handles

Multiple threads may use these. Allow only one at a time.

12 years agoUpdate scheme for XSLT parms
Adam Dickmeiss [Thu, 8 Mar 2012 15:59:34 +0000 (16:59 +0100)]
Update scheme for XSLT parms

This is actually supported in next YAZ version

12 years agovirt_db: remove query-encoding facility
Adam Dickmeiss [Thu, 8 Mar 2012 12:21:39 +0000 (13:21 +0100)]
virt_db: remove query-encoding facility

It's not in use and not documented.

12 years agomulti: allow backend-auth to be given for target element
Adam Dickmeiss [Thu, 8 Mar 2012 12:18:07 +0000 (13:18 +0100)]
multi: allow backend-auth to be given for target element

12 years agoconfigure: fix check for YAZ version
Adam Dickmeiss [Thu, 8 Mar 2012 10:03:53 +0000 (11:03 +0100)]
configure: fix check for YAZ version

12 years agouse outputcharset in example
Adam Dickmeiss [Thu, 8 Mar 2012 08:59:42 +0000 (09:59 +0100)]
use outputcharset in example

12 years agoupdate retrievalinfo schema
Adam Dickmeiss [Thu, 8 Mar 2012 08:56:48 +0000 (09:56 +0100)]
update retrievalinfo schema

Allow outputcharset (missing and supported for quite some time)
and leaderspec (new in YAZ 4.2.29).

12 years agomulti: empty route pattern uses route as default
Adam Dickmeiss [Thu, 8 Mar 2012 08:53:36 +0000 (09:53 +0100)]
multi: empty route pattern uses route as default

That is
 <target route="z3950.indexdata.com">z3950.indexdata.com</route>
may use the shorter notation
 <target route="z3950.indexdata.com"/>

12 years agoquery_rewrite: use config path to locate XSLT
Adam Dickmeiss [Wed, 7 Mar 2012 14:01:40 +0000 (15:01 +0100)]
query_rewrite: use config path to locate XSLT

12 years agoAdd include of sstream header
Adam Dickmeiss [Tue, 6 Mar 2012 12:04:49 +0000 (12:04 +0000)]
Add include of sstream header

12 years agoFilter frontend_net may log statistics
Adam Dickmeiss [Tue, 6 Mar 2012 11:44:50 +0000 (12:44 +0100)]
Filter frontend_net may log statistics

If a custom message element in frontend_net configuration it makes
the frontend_net filter produce a log entry whenever an operation
is completed. The log is always written using yaz_log with the
custom message given, the package ID (session ID) , the time
the operation has been active (end-to-end) , the threads currently
active/total and the size of the request input/output queues.

12 years agoRequire YAZ 4.2.28
Adam Dickmeiss [Tue, 6 Mar 2012 11:39:39 +0000 (12:39 +0100)]
Require YAZ 4.2.28

This is because record_transform uses yaz_retrieval_configure_t
introduced in YAZ 4.2.28.

12 years agozoom: re-connect when database is reused
Adam Dickmeiss [Mon, 5 Mar 2012 13:09:54 +0000 (14:09 +0100)]
zoom: re-connect when database is reused

Re-connect is necessary if a connection is lost or a timeout occurs.
If not, we'll be seeing zero hits, when we shouldn't.

12 years agoMinor documentation updates.
Adam Dickmeiss [Fri, 2 Mar 2012 21:48:45 +0000 (22:48 +0100)]
Minor documentation updates.

12 years agoUpdate doc/common
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:09 +0000 (22:46 +0100)]
Update doc/common

12 years agorecord_transform: doc updates
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:04 +0000 (22:46 +0100)]
record_transform: doc updates

12 years agorecord_transform: new step usemarcon
Adam Dickmeiss [Fri, 2 Mar 2012 12:19:32 +0000 (13:19 +0100)]
record_transform: new step usemarcon

For calling USEMARCON to convert record(s).

12 years agoUpdate m4
Adam Dickmeiss [Fri, 2 Mar 2012 10:22:17 +0000 (11:22 +0100)]
Update m4

12 years agorecord_transform: honor piggyback searches
Adam Dickmeiss [Thu, 1 Mar 2012 10:29:06 +0000 (11:29 +0100)]
record_transform: honor piggyback searches

12 years agorecord_transform: remove some dead code
Adam Dickmeiss [Wed, 29 Feb 2012 13:56:27 +0000 (14:56 +0100)]
record_transform: remove some dead code

12 years agoReformat
Adam Dickmeiss [Wed, 29 Feb 2012 13:51:13 +0000 (14:51 +0100)]
Reformat

12 years agoquery_rewrite: charset conversion of query terms
Adam Dickmeiss [Wed, 29 Feb 2012 13:17:41 +0000 (14:17 +0100)]
query_rewrite: charset conversion of query terms

This is an optional feature. Enabled by element <charset> in
configuration with attribute 'from' and 'to' that specifies
from/to encodings. The default 'from' encoding is UTF-8.

12 years agoVersion 1.3.25 v1.3.25
Adam Dickmeiss [Wed, 29 Feb 2012 08:54:44 +0000 (09:54 +0100)]
Version 1.3.25

12 years agozoom: ccl_err_msg may return 0
Adam Dickmeiss [Wed, 29 Feb 2012 08:53:51 +0000 (09:53 +0100)]
zoom: ccl_err_msg may return 0

So use odr_strdup_null. Just in case.

12 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:49 +0000 (09:51 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy

12 years agozoom: doc updates WRT content proxy host
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:17 +0000 (09:51 +0100)]
zoom: doc updates WRT content proxy host

12 years agoRPM/Deb: compile with 4.2.27 or later
Adam Dickmeiss [Tue, 28 Feb 2012 20:07:38 +0000 (21:07 +0100)]
RPM/Deb: compile with 4.2.27 or later

This is to ensure CCL_ERR_TRUNC_NOT_.. defines that appeared in YAZ
4.2.27 are checked.

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 28 Feb 2012 16:07:56 +0000 (17:07 +0100)]
Update NEWS

12 years agozoom: Only base database as additional info
Adam Dickmeiss [Tue, 28 Feb 2012 16:06:11 +0000 (17:06 +0100)]
zoom: Only base database as additional info

When 'Database does not exist' is returned.

12 years agoMerge branch 'hide_errors'
Adam Dickmeiss [Tue, 28 Feb 2012 15:06:20 +0000 (16:06 +0100)]
Merge branch 'hide_errors'

12 years agomulti: document hideerrors
Adam Dickmeiss [Tue, 28 Feb 2012 15:06:01 +0000 (16:06 +0100)]
multi: document hideerrors

12 years agomulti: adjust schema for hideerrors
Adam Dickmeiss [Tue, 28 Feb 2012 15:02:57 +0000 (16:02 +0100)]
multi: adjust schema for hideerrors

12 years agomulti: hideerrors functional
Adam Dickmeiss [Tue, 28 Feb 2012 14:36:13 +0000 (15:36 +0100)]
multi: hideerrors functional

12 years agozoom: urlRecipe by default disabled
Adam Dickmeiss [Tue, 28 Feb 2012 14:37:51 +0000 (15:37 +0100)]
zoom: urlRecipe by default disabled

12 years agoMerge branch 'master' into hide_errors
Adam Dickmeiss [Tue, 28 Feb 2012 13:43:48 +0000 (14:43 +0100)]
Merge branch 'master' into hide_errors

12 years agozoom: insert generated-url before common XSLT
Adam Dickmeiss [Tue, 28 Feb 2012 13:03:21 +0000 (14:03 +0100)]
zoom: insert generated-url before common XSLT

12 years agozoom: content-proxy no longer part of generated-url
Adam Dickmeiss [Tue, 28 Feb 2012 12:54:16 +0000 (13:54 +0100)]
zoom: content-proxy no longer part of generated-url

12 years agomulti: initial work on hide_errors tweak
Adam Dickmeiss [Tue, 28 Feb 2012 12:23:25 +0000 (13:23 +0100)]
multi: initial work on hide_errors tweak

12 years agozoom: mention record_xsl
Adam Dickmeiss [Tue, 28 Feb 2012 11:50:17 +0000 (12:50 +0100)]
zoom: mention record_xsl

12 years agozoom: tweak element set rules
Adam Dickmeiss [Tue, 28 Feb 2012 11:31:48 +0000 (12:31 +0100)]
zoom: tweak element set rules

If element is not pz2/raw, use explain_xsp if present; if explain_xsp
is not present don't do any pz2 retrievals (old behavior).

12 years agozoom: extra XSLT with cproxyhost param
Adam Dickmeiss [Tue, 28 Feb 2012 11:23:47 +0000 (12:23 +0100)]
zoom: extra XSLT with cproxyhost param

The extra XSLT enabled by if record_xsl attribute is specified
for zooom configuration. This will make a final transform
(after pz2 transform) and will be passed parameter cproxyhost
if content proxy is enabled; not passed otherwise.

12 years agozoom: document timeout setting.
Adam Dickmeiss [Fri, 24 Feb 2012 12:13:09 +0000 (13:13 +0100)]
zoom: document timeout setting.

12 years agozoom: timeout is configurable
Adam Dickmeiss [Fri, 24 Feb 2012 12:07:37 +0000 (13:07 +0100)]
zoom: timeout is configurable

Set as value of attribute 'timeout' in element 'zoom' of configuration.

12 years agozoom: fix spelling for a few errors
Adam Dickmeiss [Fri, 24 Feb 2012 11:42:47 +0000 (12:42 +0100)]
zoom: fix spelling for a few errors

12 years agozoom: tune CCL to Z39.50 diagnostics mapping
Adam Dickmeiss [Fri, 24 Feb 2012 11:36:53 +0000 (12:36 +0100)]
zoom: tune CCL to Z39.50 diagnostics mapping

Throw Bib-1: 108 "Malformed query" for syntax errors and related ones;
throw Bib-1: 3 "Unsupported search" for everything else. Details from
the CCL parser is provided as additional-info.

12 years agoVersion 1.3.24 v1.3.24
Adam Dickmeiss [Thu, 23 Feb 2012 11:21:56 +0000 (11:21 +0000)]
Version 1.3.24