metaproxy-moved-to-github.git
12 years agoVersion 1.3.34 v1.3.34
Adam Dickmeiss [Wed, 25 Apr 2012 16:53:10 +0000 (18:53 +0200)]
Version 1.3.34

12 years agoRPM/Deb metaproxy.xml enables frontend_net logging
Adam Dickmeiss [Wed, 25 Apr 2012 16:49:30 +0000 (18:49 +0200)]
RPM/Deb metaproxy.xml enables frontend_net logging

Enable frontend_net logging by default and remove the log filter.
Because the frontend_net filter already logs incoming request.

12 years agoMerge remote branch 'origin/frontend_log'
Adam Dickmeiss [Wed, 25 Apr 2012 16:46:22 +0000 (18:46 +0200)]
Merge remote branch 'origin/frontend_log'

12 years agozoom: use other diagnostic if Torus server is unavailable
Adam Dickmeiss [Wed, 25 Apr 2012 14:19:41 +0000 (16:19 +0200)]
zoom: use other diagnostic if Torus server is unavailable

12 years agozoom config example: use frontend_net for logging
Adam Dickmeiss [Wed, 25 Apr 2012 13:02:53 +0000 (15:02 +0200)]
zoom config example: use frontend_net for logging

12 years agoenables frontend_net log
Adam Dickmeiss [Wed, 25 Apr 2012 13:02:44 +0000 (15:02 +0200)]
enables frontend_net log

12 years agofrontent_net: does "access" log if message is configured
Adam Dickmeiss [Wed, 25 Apr 2012 13:02:18 +0000 (15:02 +0200)]
frontent_net: does "access" log if message is configured

The filter only logged thread usage upon completion. It also now
logs incoming request ala "access" in the log filter.

12 years agoRPM: metaproxy libs depend on yazpp 1.3.0, yaz 4.2.32
Adam Dickmeiss [Wed, 25 Apr 2012 12:00:36 +0000 (14:00 +0200)]
RPM: metaproxy libs depend on yazpp 1.3.0, yaz 4.2.32

12 years agozoom: check for valid proxy from Torus too
Adam Dickmeiss [Wed, 25 Apr 2012 11:58:17 +0000 (13:58 +0200)]
zoom: check for valid proxy from Torus too

12 years agoBuild require yazpp 1.3.0
Adam Dickmeiss [Wed, 25 Apr 2012 11:24:35 +0000 (13:24 +0200)]
Build require yazpp 1.3.0

12 years agoLog when metaproxy is stopped
Adam Dickmeiss [Wed, 25 Apr 2012 11:22:39 +0000 (13:22 +0200)]
Log when metaproxy is stopped

12 years agoAdd helper variable
Adam Dickmeiss [Wed, 25 Apr 2012 11:22:17 +0000 (13:22 +0200)]
Add helper variable

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Wed, 25 Apr 2012 09:14:36 +0000 (11:14 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVesrion 1.3.33 v1.3.33
Adam Dickmeiss [Wed, 25 Apr 2012 08:34:51 +0000 (10:34 +0200)]
Vesrion 1.3.33

12 years agoUse new diagnostic for proxy failures
Adam Dickmeiss [Wed, 25 Apr 2012 08:32:54 +0000 (10:32 +0200)]
Use new diagnostic for proxy failures

12 years agoRequire YAZ 4.2.32 or later for build
Adam Dickmeiss [Wed, 25 Apr 2012 08:21:27 +0000 (10:21 +0200)]
Require YAZ 4.2.32 or later for build

12 years agoMake check_proxy, you know ... work
Adam Dickmeiss [Wed, 25 Apr 2012 07:47:59 +0000 (09:47 +0200)]
Make check_proxy, you know ... work

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 13:21:56 +0000 (15:21 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.32 v1.3.32
Adam Dickmeiss [Tue, 24 Apr 2012 13:05:50 +0000 (15:05 +0200)]
Version 1.3.32

12 years agosru_z3950: pass through incoming Z39.50 requests
Adam Dickmeiss [Tue, 24 Apr 2012 12:58:08 +0000 (14:58 +0200)]
sru_z3950: pass through incoming Z39.50 requests

sru_z3950 filter passes through incoming Z39.50 requests again. Was
not handled by mistake in Metaproxy versions 1.3.29, 1.3.30 and 1.3.31.

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 12:30:19 +0000 (14:30 +0200)]
Merge branch 'master' into graceful_stop

12 years agoDo not build for Debian lenny anymore
Adam Dickmeiss [Tue, 24 Apr 2012 12:30:08 +0000 (14:30 +0200)]
Do not build for Debian lenny anymore

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 24 Apr 2012 12:14:52 +0000 (14:14 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.31 v1.3.31
Adam Dickmeiss [Tue, 24 Apr 2012 10:31:24 +0000 (12:31 +0200)]
Version 1.3.31

12 years agozoom: refactor retry logic to separate function
Adam Dickmeiss [Tue, 24 Apr 2012 10:26:46 +0000 (12:26 +0200)]
zoom: refactor retry logic to separate function

12 years agozoom: properly handle proxy failover for re-used backends
Adam Dickmeiss [Tue, 24 Apr 2012 10:08:36 +0000 (12:08 +0200)]
zoom: properly handle proxy failover for re-used backends

Also log the diagnostic that is received from the backend in
case of retry/failover because they will be not be returned
via Z39.50/SRU.

12 years agoVersion 1.3.30 v1.3.30
Adam Dickmeiss [Mon, 23 Apr 2012 18:07:15 +0000 (20:07 +0200)]
Version 1.3.30

12 years agoUpdate NEWS
Adam Dickmeiss [Mon, 23 Apr 2012 18:02:48 +0000 (20:02 +0200)]
Update NEWS

12 years agozoom: proxy error returns diagnostic Bib-1:1014 / SRU:3
Adam Dickmeiss [Sat, 21 Apr 2012 08:35:14 +0000 (10:35 +0200)]
zoom: proxy error returns diagnostic Bib-1:1014 / SRU:3

12 years agozoom: return addinfo="proxy failure" for proxy failures
Adam Dickmeiss [Sat, 21 Apr 2012 08:24:44 +0000 (10:24 +0200)]
zoom: return addinfo="proxy failure" for proxy failures

This commit also changes the scheme for dealing with proxies a bit.
zoom now always do "proxy-check", even if there's no failover.
Fortunately, that's not very expensive.

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Fri, 20 Apr 2012 13:31:29 +0000 (15:31 +0200)]
Merge branch 'master' into graceful_stop

12 years agozoom: implement cunning scheme for retry/proxy failover
Adam Dickmeiss [Fri, 20 Apr 2012 13:00:07 +0000 (15:00 +0200)]
zoom: implement cunning scheme for retry/proxy failover

12 years agosession_shared: disable session retry by default
Adam Dickmeiss [Fri, 20 Apr 2012 12:58:29 +0000 (14:58 +0200)]
session_shared: disable session retry by default

Can be enabled by restart="true" in resultset section.

12 years agozoom: guess if invalid response was an auth failure
Adam Dickmeiss [Fri, 20 Apr 2012 09:16:47 +0000 (11:16 +0200)]
zoom: guess if invalid response was an auth failure

12 years agozoom: Init rejected wo diagnostics maps to Bib-1:1014
Adam Dickmeiss [Fri, 20 Apr 2012 08:54:41 +0000 (10:54 +0200)]
zoom: Init rejected wo diagnostics maps to Bib-1:1014

Bib-1 1014, "Init/AC: Authentication System error", seems pretty
generic. We don't know why the init would fail; IP, user, block IP, etc.
sru_z3950 filter maps this to SRU diagnostic 3: "Authentication error".

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Wed, 18 Apr 2012 11:57:31 +0000 (13:57 +0200)]
Merge branch 'master' into graceful_stop

12 years agoVersion 1.3.29 v1.3.29
Adam Dickmeiss [Wed, 18 Apr 2012 11:25:27 +0000 (13:25 +0200)]
Version 1.3.29

12 years agozoom: update zoom info on contentProxy
Adam Dickmeiss [Wed, 18 Apr 2012 11:24:31 +0000 (13:24 +0200)]
zoom: update zoom info on contentProxy

12 years agoUpdate NEWS
Adam Dickmeiss [Wed, 18 Apr 2012 11:18:15 +0000 (13:18 +0200)]
Update NEWS

12 years agozoom: may read cf-proxy's config settings
Adam Dickmeiss [Wed, 18 Apr 2012 10:20:20 +0000 (12:20 +0200)]
zoom: may read cf-proxy's config settings

This reduces manual configuration of the content proxy server host.
The %s notation for server is no longer supported. The ZOOM module will
use the old style session.proxyhost if "server" is given (deprecated)
and use the new style proxyhost/session if "config_file" is in use.

12 years agoMinor updates to config zoom example
Adam Dickmeiss [Wed, 18 Apr 2012 08:16:55 +0000 (10:16 +0200)]
Minor updates to config zoom example

12 years agozoom: more configurable format for contentProxy@server
Adam Dickmeiss [Wed, 18 Apr 2012 08:13:37 +0000 (10:13 +0200)]
zoom: more configurable format for contentProxy@server

The proxy attribute of contentProxy element may include a %s magic,
which will be substituted by the session ID. For example
server="proxy.indexdata.com/%s"

12 years agoSignal SIGUSR1 akes a graceful stop
Adam Dickmeiss [Tue, 17 Apr 2012 14:20:03 +0000 (16:20 +0200)]
Signal SIGUSR1 akes a graceful stop

Thus, all Z39.50/HTTP connections to the server are kept alive, but
the listening socket is closed. Signal SIGTERM destroys the server
immediately as before.

12 years agoFrontend_net exits when all sessions have terminated
Adam Dickmeiss [Tue, 17 Apr 2012 12:46:38 +0000 (14:46 +0200)]
Frontend_net exits when all sessions have terminated

12 years agoMerge branch 'master' into graceful_stop
Adam Dickmeiss [Tue, 17 Apr 2012 10:49:12 +0000 (12:49 +0200)]
Merge branch 'master' into graceful_stop

12 years agozoom: simplify cproxyhost XSLT parm passing
Adam Dickmeiss [Tue, 17 Apr 2012 09:28:25 +0000 (11:28 +0200)]
zoom: simplify cproxyhost XSLT parm passing

12 years agoRemove incoming requests that can not be handled
Adam Dickmeiss [Tue, 17 Apr 2012 08:33:12 +0000 (10:33 +0200)]
Remove incoming requests that can not be handled

Requests in queue for filter frontend_net are removed if client
closes connection for the session and request is not yet handled.

12 years agosru_z3950: serialize requests
Adam Dickmeiss [Mon, 16 Apr 2012 12:56:48 +0000 (14:56 +0200)]
sru_z3950: serialize requests

This is to ensure that pipelined HTTP requests are handled
properly.

12 years agosru_z3950: reformat; remove useless comments
Adam Dickmeiss [Fri, 13 Apr 2012 12:14:15 +0000 (14:14 +0200)]
sru_z3950: reformat; remove useless comments

12 years agoBeginnings of graceful stop
Adam Dickmeiss [Tue, 10 Apr 2012 11:43:29 +0000 (13:43 +0200)]
Beginnings of graceful stop

12 years agoFix metaproxy.prerm: missing /bin/sh header
Adam Dickmeiss [Wed, 4 Apr 2012 15:46:23 +0000 (17:46 +0200)]
Fix metaproxy.prerm: missing /bin/sh header

12 years agoVersion 1.3.28 v1.3.28
Adam Dickmeiss [Wed, 4 Apr 2012 11:40:27 +0000 (13:40 +0200)]
Version 1.3.28

12 years agozoom: remove 'xslt successful' message
Adam Dickmeiss [Wed, 4 Apr 2012 08:34:24 +0000 (10:34 +0200)]
zoom: remove 'xslt successful' message

12 years agoNew WRBUF wrapper mp::wrbuf
Adam Dickmeiss [Wed, 4 Apr 2012 08:33:53 +0000 (10:33 +0200)]
New WRBUF wrapper mp::wrbuf

12 years agoVersion 1.3.27 v1.3.27
Adam Dickmeiss [Fri, 30 Mar 2012 11:18:57 +0000 (13:18 +0200)]
Version 1.3.27

12 years agoMetaproxy conflicts with CF 2.12.5 and earlier
Adam Dickmeiss [Fri, 30 Mar 2012 11:14:00 +0000 (13:14 +0200)]
Metaproxy conflicts with CF 2.12.5 and earlier

This is because Metaproxy is running as a different user now -
and old lock files etc, previously created as "nobody" would cause
permission problems for CF.

12 years agoUser info in /etc/metaproxy/metaproxy.user
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:49 +0000 (10:14 +0200)]
User info in /etc/metaproxy/metaproxy.user

12 years agoDebian compat 5
Adam Dickmeiss [Thu, 29 Mar 2012 08:14:30 +0000 (10:14 +0200)]
Debian compat 5

12 years agoRPM: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 13:12:32 +0000 (13:12 +0000)]
RPM: metaproxy running as user "metaproxy"

12 years agoDebian: metaproxy running as user "metaproxy"
Adam Dickmeiss [Wed, 28 Mar 2012 11:08:34 +0000 (13:08 +0200)]
Debian: metaproxy running as user "metaproxy"

New scripts to create and remove this user during installation
and removal.

12 years agoVersion 1.3.26 v1.3.26
Adam Dickmeiss [Tue, 20 Mar 2012 09:58:57 +0000 (10:58 +0100)]
Version 1.3.26

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 20 Mar 2012 09:57:24 +0000 (10:57 +0100)]
Update NEWS

12 years agoRPM metaproxy.xml: add comment about logging
Adam Dickmeiss [Tue, 20 Mar 2012 09:46:58 +0000 (10:46 +0100)]
RPM metaproxy.xml: add comment about logging

in the frontend net filter.

12 years agoSort module documentation, schema, fixes
Adam Dickmeiss [Tue, 20 Mar 2012 09:23:38 +0000 (10:23 +0100)]
Sort module documentation, schema, fixes

12 years agosort: cache sorted records
Adam Dickmeiss [Mon, 19 Mar 2012 22:03:30 +0000 (23:03 +0100)]
sort: cache sorted records

So they can be refetched invidually for example.

12 years agoSort filter using xpath result for sort criteria
Adam Dickmeiss [Mon, 19 Mar 2012 19:15:40 +0000 (20:15 +0100)]
Sort filter using xpath result for sort criteria

Sort order may be given in configuration.

12 years agoFurther work on sort filter .
Adam Dickmeiss [Mon, 19 Mar 2012 15:08:32 +0000 (16:08 +0100)]
Further work on sort filter .

Using x-path for getting score, but this is not yet in use.

12 years agosort: add skeleton for new sort filter
Adam Dickmeiss [Mon, 19 Mar 2012 09:13:24 +0000 (10:13 +0100)]
sort: add skeleton for new sort filter

12 years agotemplate: Use full configure for Impl configure
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:19 +0000 (10:12 +0100)]
template: Use full configure for Impl configure

12 years agoRemove useless comment
Adam Dickmeiss [Mon, 19 Mar 2012 09:12:07 +0000 (10:12 +0100)]
Remove useless comment

12 years agomulti: adjust mediumSetPresentNumber to disable piggyback
Adam Dickmeiss [Fri, 16 Mar 2012 12:42:47 +0000 (13:42 +0100)]
multi: adjust mediumSetPresentNumber to disable piggyback

The value was adjusted from 1 to 0.. It should not make a difference,
but still.

12 years agoProtect the two Usemarcon handles
Adam Dickmeiss [Thu, 8 Mar 2012 16:28:14 +0000 (17:28 +0100)]
Protect the two Usemarcon handles

Multiple threads may use these. Allow only one at a time.

12 years agoUpdate scheme for XSLT parms
Adam Dickmeiss [Thu, 8 Mar 2012 15:59:34 +0000 (16:59 +0100)]
Update scheme for XSLT parms

This is actually supported in next YAZ version

12 years agovirt_db: remove query-encoding facility
Adam Dickmeiss [Thu, 8 Mar 2012 12:21:39 +0000 (13:21 +0100)]
virt_db: remove query-encoding facility

It's not in use and not documented.

12 years agomulti: allow backend-auth to be given for target element
Adam Dickmeiss [Thu, 8 Mar 2012 12:18:07 +0000 (13:18 +0100)]
multi: allow backend-auth to be given for target element

12 years agoconfigure: fix check for YAZ version
Adam Dickmeiss [Thu, 8 Mar 2012 10:03:53 +0000 (11:03 +0100)]
configure: fix check for YAZ version

12 years agouse outputcharset in example
Adam Dickmeiss [Thu, 8 Mar 2012 08:59:42 +0000 (09:59 +0100)]
use outputcharset in example

12 years agoupdate retrievalinfo schema
Adam Dickmeiss [Thu, 8 Mar 2012 08:56:48 +0000 (09:56 +0100)]
update retrievalinfo schema

Allow outputcharset (missing and supported for quite some time)
and leaderspec (new in YAZ 4.2.29).

12 years agomulti: empty route pattern uses route as default
Adam Dickmeiss [Thu, 8 Mar 2012 08:53:36 +0000 (09:53 +0100)]
multi: empty route pattern uses route as default

That is
 <target route="z3950.indexdata.com">z3950.indexdata.com</route>
may use the shorter notation
 <target route="z3950.indexdata.com"/>

12 years agoquery_rewrite: use config path to locate XSLT
Adam Dickmeiss [Wed, 7 Mar 2012 14:01:40 +0000 (15:01 +0100)]
query_rewrite: use config path to locate XSLT

12 years agoAdd include of sstream header
Adam Dickmeiss [Tue, 6 Mar 2012 12:04:49 +0000 (12:04 +0000)]
Add include of sstream header

12 years agoFilter frontend_net may log statistics
Adam Dickmeiss [Tue, 6 Mar 2012 11:44:50 +0000 (12:44 +0100)]
Filter frontend_net may log statistics

If a custom message element in frontend_net configuration it makes
the frontend_net filter produce a log entry whenever an operation
is completed. The log is always written using yaz_log with the
custom message given, the package ID (session ID) , the time
the operation has been active (end-to-end) , the threads currently
active/total and the size of the request input/output queues.

12 years agoRequire YAZ 4.2.28
Adam Dickmeiss [Tue, 6 Mar 2012 11:39:39 +0000 (12:39 +0100)]
Require YAZ 4.2.28

This is because record_transform uses yaz_retrieval_configure_t
introduced in YAZ 4.2.28.

12 years agozoom: re-connect when database is reused
Adam Dickmeiss [Mon, 5 Mar 2012 13:09:54 +0000 (14:09 +0100)]
zoom: re-connect when database is reused

Re-connect is necessary if a connection is lost or a timeout occurs.
If not, we'll be seeing zero hits, when we shouldn't.

12 years agoMinor documentation updates.
Adam Dickmeiss [Fri, 2 Mar 2012 21:48:45 +0000 (22:48 +0100)]
Minor documentation updates.

12 years agoUpdate doc/common
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:09 +0000 (22:46 +0100)]
Update doc/common

12 years agorecord_transform: doc updates
Adam Dickmeiss [Fri, 2 Mar 2012 21:46:04 +0000 (22:46 +0100)]
record_transform: doc updates

12 years agorecord_transform: new step usemarcon
Adam Dickmeiss [Fri, 2 Mar 2012 12:19:32 +0000 (13:19 +0100)]
record_transform: new step usemarcon

For calling USEMARCON to convert record(s).

12 years agoUpdate m4
Adam Dickmeiss [Fri, 2 Mar 2012 10:22:17 +0000 (11:22 +0100)]
Update m4

12 years agorecord_transform: honor piggyback searches
Adam Dickmeiss [Thu, 1 Mar 2012 10:29:06 +0000 (11:29 +0100)]
record_transform: honor piggyback searches

12 years agorecord_transform: remove some dead code
Adam Dickmeiss [Wed, 29 Feb 2012 13:56:27 +0000 (14:56 +0100)]
record_transform: remove some dead code

12 years agoReformat
Adam Dickmeiss [Wed, 29 Feb 2012 13:51:13 +0000 (14:51 +0100)]
Reformat

12 years agoquery_rewrite: charset conversion of query terms
Adam Dickmeiss [Wed, 29 Feb 2012 13:17:41 +0000 (14:17 +0100)]
query_rewrite: charset conversion of query terms

This is an optional feature. Enabled by element <charset> in
configuration with attribute 'from' and 'to' that specifies
from/to encodings. The default 'from' encoding is UTF-8.

12 years agoVersion 1.3.25 v1.3.25
Adam Dickmeiss [Wed, 29 Feb 2012 08:54:44 +0000 (09:54 +0100)]
Version 1.3.25

12 years agozoom: ccl_err_msg may return 0
Adam Dickmeiss [Wed, 29 Feb 2012 08:53:51 +0000 (09:53 +0100)]
zoom: ccl_err_msg may return 0

So use odr_strdup_null. Just in case.

12 years agoMerge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:49 +0000 (09:51 +0100)]
Merge branch 'master' of ssh://git.indexdata.com/home/git/pub/metaproxy

12 years agozoom: doc updates WRT content proxy host
Adam Dickmeiss [Wed, 29 Feb 2012 08:51:17 +0000 (09:51 +0100)]
zoom: doc updates WRT content proxy host

12 years agoRPM/Deb: compile with 4.2.27 or later
Adam Dickmeiss [Tue, 28 Feb 2012 20:07:38 +0000 (21:07 +0100)]
RPM/Deb: compile with 4.2.27 or later

This is to ensure CCL_ERR_TRUNC_NOT_.. defines that appeared in YAZ
4.2.27 are checked.

12 years agoUpdate NEWS
Adam Dickmeiss [Tue, 28 Feb 2012 16:07:56 +0000 (17:07 +0100)]
Update NEWS

12 years agozoom: Only base database as additional info
Adam Dickmeiss [Tue, 28 Feb 2012 16:06:11 +0000 (17:06 +0100)]
zoom: Only base database as additional info

When 'Database does not exist' is returned.