X-Git-Url: http://git.indexdata.com/?p=irspy-moved-to-github.git;a=blobdiff_plain;f=archive%2Ftests;fp=archive%2Ftests;h=0000000000000000000000000000000000000000;hp=839bc74c61ecdd338949e043513272434ba2ae37;hb=f0f8f40910525c365c5bbac74c366944c87b7124;hpb=6962db83488294669326989232161cf76c52bc6b diff --git a/archive/tests b/archive/tests deleted file mode 100644 index 839bc74..0000000 --- a/archive/tests +++ /dev/null @@ -1,439 +0,0 @@ -From mike Tue May 23 08:49:36 2006 -X-VM-v5-Data: ([nil nil nil nil nil nil nil nil nil] - ["10552" "Tuesday" "23" "May" "2006" "09:43:08" "+0200" "marc" "marc@indexdata.dk" nil "326" "SRU Server lint/tester" "^X-Spam-Status:" nil nil "5" nil nil nil nil nil nil nil nil nil] - nil) -Return-path: -X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on bagel.indexdata.dk -X-Spam-Level: -Envelope-to: mike@miketaylor.org.uk -Delivery-date: Tue, 23 May 2006 09:43:10 +0200 -Received: from localhost.localdomain [127.0.0.1] - by localhost with POP3 (fetchmail-6.2.5) - for mike@localhost (single-drop); Tue, 23 May 2006 08:49:36 +0100 (BST) -Received: from user.indexdata.dk ([213.150.43.10] helo=[10.0.1.66]) - by bagel.indexdata.dk with esmtp (Exim 3.35 #1 (Debian)) - id 1FiRXp-0004lO-00; Tue, 23 May 2006 09:43:09 +0200 -Message-ID: <4472BD0C.1000102@indexdata.dk> -User-Agent: Debian Thunderbird 1.0.7 (X11/20051017) -X-Accept-Language: en-us, en -MIME-Version: 1.0 -References: <17522.6764.89623.774386@localhost.localdomain> -In-Reply-To: <17522.6764.89623.774386@localhost.localdomain> -Content-Type: text/plain; charset=UTF-8; format=flowed -Content-Transfer-Encoding: 8bit -X-Spam-Status: No, score=-2.5 required=5.0 tests=AWL,BAYES_00 autolearn=ham - version=3.1.1 -From: marc -To: Mike Taylor , adam@indexdata.dk, - Ralph LeVan -Subject: SRU Server lint/tester -Date: Tue, 23 May 2006 09:43:08 +0200 - -Mike Taylor wrote: -> Guys, -> -> Ralph's fixed his SRU-lint web-page. It takes a few minutes to get -> its head around foo.indexdata.dk, but it does manage, and has some -> useful things to say. -> - - -Hej Ralph - -Thanks for a fast fix of your SRU Server tester -http://alcme.oclc.org/srw/SRUServerTester.html -for the Alvis-Zebra SRU server URL -http://foo.indexdata.dk - -I think your SRU checker does a nice job. And it did indeed find some -errors in our implementation, so we all can improve. Thanks for that! - -I have a couple of small comments: - - -1) -You test scan like this: - -http://foo.indexdata.dk?version=1.1&scanClause=rec.id+=+dog&operation=scan&responsePosition=1&maximumTerms=5 - -I think you should always add a responsePosition=3 to the mix, as there -might be indexes (and there are here!) where the term 'dog' comes -lexocographically after the last index entry, and you get a fat empty - - -1.1 - - -But using - -http://foo.indexdata.dk/?version=1.1&operation=scan&scanClause=rec.id+%3D+%28dog%29&responsePosition=3&maximumTerms=5&stylesheet= - -gives you - - -1.1 - - -FFFEBE6A0D7773AF401A728D5C818AEB -1 - - -FFFF3A78648AC540304B1F50A2C0D644 -1 - - - - -By the way, an empty index is not that useful, but I think it's not -necessarily an error to have one unpopulated index, so using a warning -from your side is a good choice, I feel. - - -2) scan relation 'exact' - -You try -http://foo.indexdata.dk?version=1.1&scanClause=rec.id+exact+dog&operation=scan&responsePosition=1&maximumTerms=5 - -with relation 'exact', but my explain never told you that the server -supports relation 'exact'. - -I think, my correct server response to this should be a fatal -diagnostic, and your correct test result should have been 'diagnostic -this-and-that expected'. - -Unless it's mandatory that any index supports 'exact', in which case an -error should be reported (I need to look in the specs to be sure ..) - -3) test of search retrieve - -You are doing a decent job here. I have a suggestion for a slight -improvement: you might want to use your information from a scan in the -follwing way: - -- search for a term _not_ found in the index, and see that there are 0 - hits (and the response is correct) - -- search for at term found in the scan response, and see that the number - of hits equals the number of hits claimed in the scan response - -I know, it's more work to check for numbers, but it's also a nice sanity -check on top of a syntax/protocol check. - -4) huge records: some of the records are insane huge (up to 5 MB of -XML). For example you hit one here: - -http://foo.indexdata.dk?version=1.1&query=alvis.entity-disease+=+"dominant -optic atrophy"&operation=searchRetrieve&maximumRecords=1 - -You might want to test for XML response message size before doing -anything else to it, and report a warning like 'response too huge to be -tested, exceeds X MB of XML' - -(I know, I should use anotheŕ default schema here, to give small -records, for example the 'dc' schema. We have to improve too ..) - -5) recordSchema -In these cases, one might want to try the other record schema's to see -if one get something useful there .. I did not see you testing any -recordSchema of those I did mention, nor testing non-existent record -schema's .. - -6) In general, testing with wrong arguments on almost any place one can -do is a good idea as well, as the hardest part of SRU/SRW is to get the -diagnostics right .. for example record position too high, or -non-existing relaiton or index, non-existing operation .. ect .. -(Yes, I know, this is huge work to do ..) - -7) Finally, useability: I think it's a nice idea to have this report -formatted in XHTML tables, with nice links to click on for each test -case, such that one can just execute the request which did produce -errors/warnings. This is of course only eye-candy, but also a cheap -improvement of useability. - - -Still, I think you did a very decent job, and created a very useful -service. I thank for the problems discovered with my service. I have -some programming to do as well .. - - -Marc Cromme - -Index Data - -> ------- start of forwarded message ------- -> Return-path: -> X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on bagel.indexdata.dk -> X-Spam-Level: -> Envelope-to: mike@miketaylor.org.uk -> Delivery-date: Mon, 22 May 2006 21:07:05 +0200 -> Received: from localhost.localdomain [127.0.0.1] -> by localhost with POP3 (fetchmail-6.2.5) -> for mike@localhost (single-drop); Mon, 22 May 2006 20:56:19 +0100 (BST) -> Received: from mshieldserver1.oclc.org ([132.174.29.209]) -> by bagel.indexdata.dk with smtp (Exim 3.35 #1 (Debian)) -> id 1FiFk9-0005kc-00 -> for ; Mon, 22 May 2006 21:07:05 +0200 -> Received: From OAEXCH2SERVER.oa.oclc.org ([132.174.29.222]) by mshieldserver1.oclc.org (WebShield SMTP v4.5 MR2); -> id 1148324788949; Mon, 22 May 2006 15:06:28 -0400 -> X-MimeOLE: Produced By Microsoft Exchange V6.5 -> Content-class: urn:content-classes:message -> MIME-Version: 1.0 -> Content-Type: text/plain; -> charset="us-ascii" -> Content-Transfer-Encoding: quoted-printable -> Message-ID: <811A02A11096B343880D2EEF72C4C83202FCD5E9@OAEXCH2SERVER.oa.oclc.org> -> X-MS-Has-Attach: -> X-MS-TNEF-Correlator: -> Thread-Topic: [Adam Dickmeiss: Re: [Tech-alert] SRU Server lint/tester] -> thread-index: AcZ7Hk4E9wk02cosR0uT69PyXob4kACsz3fA -> X-Spam-Status: No, score=-2.6 required=5.0 tests=AWL,BAYES_00 autolearn=ham -> version=3.1.1 -> From: "LeVan,Ralph" -> To: "Mike Taylor" -> Subject: RE: [Adam Dickmeiss: Re: [Tech-alert] SRU Server lint/tester] -> Date: Mon, 22 May 2006 15:06:28 -0400 -> -> Let's just pretend I didn't send that last email, okay? -> -> So, lovely Explain records we're having today! -> -> I've fixed the blow up. You've got a couple of searches that return -> very large records that I think are peculiar. Your stylesheet can't -> render them and I report that I'm getting an error 400 from them. -> -> Run the test against the server again and let me know if there's -> something more I should be doing. -> -> Thanks, Mike! -> -> Ralph -> -> ->>-----Original Message----- ->>From: Mike Taylor [mailto:mike@miketaylor.org.uk] ->>Sent: Friday, May 19, 2006 4:29 AM ->>To: LeVan,Ralph ->>Subject: [Adam Dickmeiss: Re: [Tech-alert] SRU Server lint/tester] ->>=20 ->>Hi, Ralph. FYI, it seems that your SRU lint barfs on our server. ->>=20 ->>------- start of forwarded message ------- ->>Return-path: ->>X-Spam-Checker-Version: SpamAssassin 3.1.1 (2006-03-10) on ->>bagel.indexdata.dk ->>X-Spam-Level: ->>Envelope-to: mike@indexdata.com ->>Delivery-date: Thu, 18 May 2006 18:38:14 +0200 ->>Received: from localhost.localdomain [127.0.0.1] ->> by localhost with POP3 (fetchmail-6.2.5) ->> for mike@localhost (single-drop); Thu, 18 May 2006 17:49:11 -> -> +0100 -> ->>(BST) ->>Received: from kebab.indexdata.dk ([83.133.64.60]) ->> by bagel.indexdata.dk with esmtp (Exim 3.35 #1 (Debian)) ->> id 1FglVt-0007y3-00; Thu, 18 May 2006 18:38:13 +0200 ->>Received: from localhost ([127.0.0.1] helo=3Dkebab.indexdata.dk) ->> by kebab.indexdata.dk with esmtp (Exim 4.50) ->> id 1FglVU-0001I6-DK; Thu, 18 May 2006 18:37:48 +0200 ->>Received: from user.indexdata.dk ([213.150.43.10] -> -> helo=3Dbagel.indexdata.dk) -> ->> by kebab.indexdata.dk with esmtp (Exim 4.50) id 1FglUy-0001Hv-WF ->> for tech-alert@lists.indexdata.dk; Thu, 18 May 2006 18:37:36 -> -> +0200 -> ->>Received: from dickmeiss.net ([213.173.244.115] helo=3D[10.0.0.18]) ->> by bagel.indexdata.dk with esmtp (Exim 3.35 #1 (Debian)) ->> id 1FglUj-0007QK-00 ->> for ; Thu, 18 May 2006 18:37:01 -> -> +0200 -> ->>Message-ID: <446CA2AC.1030200@indexdata.dk> ->>User-Agent: Thunderbird 1.5.0.2 (X11/20060501) ->>MIME-Version: 1.0 ->>References: <446C8BB1.6080206@indexdata.dk> ->>In-Reply-To: <446C8BB1.6080206@indexdata.dk> ->>Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed ->>Content-Transfer-Encoding: 7bit ->>X-BeenThere: tech-alert@lists.indexdata.dk ->>X-Mailman-Version: 2.1.5 ->>Precedence: list ->>Reply-To: Announcements/discussion of interesting technology ->> ->>List-Id: Announcements/discussion of interesting technology ->> ->>List-Unsubscribe: >bin/mailman/listinfo/tech-alert>, ->> -> -> -> ->>List-Archive: >alert> ->>List-Post: ->>List-Help: = -> -> -> ->>List-Subscribe: -> -> ->>alert>, ->> ->>Errors-To: tech-alert-bounces@lists.indexdata.dk ->>X-SA-Exim-Connect-IP: 127.0.0.1 ->>X-SA-Exim-Mail-From: tech-alert-bounces@lists.indexdata.dk ->>X-SA-Exim-Scanned: No (on kebab.indexdata.dk); SAEximRunCond expanded -> -> to -> ->>false ->>X-Spam-Status: No, score=3D-2.5 required=3D5.0 tests=3DAWL,BAYES_00, ->> FORGED_RCVD_HELO autolearn=3Dham version=3D3.1.1 ->>From: Adam Dickmeiss ->>Sender: tech-alert-bounces@lists.indexdata.dk ->>To: Announcements/discussion of interesting technology ->> ->>Subject: Re: [Tech-alert] SRU Server lint/tester ->>Date: Thu, 18 May 2006 18:37:00 +0200 ->>=20 ->>marc wrote: ->> ->>>SRU Server tester ->>> ->>>Try it: surf into ->>>http://alcme.oclc.org/srw/SRUServerTester.html ->>> ->>>and give the Alvis-Zebra SRU server URL ->>>http://foo.indexdata.dk ->>>into the box. ->>> ->>>Have fun! ->> ->>Sort of. I get a big Java runtime exception. Nice. ->>=20 ->>/ Adam ->>=20 ->> ->>>Marc ->>> ->> ->>=20 ->>=20 ->>_______________________________________________ ->>Tech-alert mailing list ->>Tech-alert@lists.indexdata.dk ->>http://lists.indexdata.dk/cgi-bin/mailman/listinfo/tech-alert ->>------- end of forwarded message ------- -> -> ------- end of forwarded message ------- - - --- - -Marc Cromme, cand. polyt, Ph.D -Senior Developer, Project Manager - -Index Data Aps -Købmagergade 43, 2 -1150 Copenhagen K. -Denmark - -tel: +45 3341 0100 -fax: +45 3341 0101 - -http://www.indexdata.com - -INDEX DATA Means Business -for Open Source and Open Standards - - - - -From mike Mon Oct 2 09:13:02 2006 -X-VM-v5-Data: ([nil nil nil nil nil nil nil nil nil] - ["4081" "Monday" "2" "October" "2006" "10:02:11" "+0200" "Per M. Hansen" "perhans@indexdata.dk" nil "100" "Tests in Z-SPy" "^From:" nil nil "10" nil nil nil nil nil nil nil nil nil] - nil) -Return-path: -Envelope-to: mike@indexdata.com -Delivery-date: Mon, 02 Oct 2006 10:03:06 +0200 -Received: from localhost.localdomain [127.0.0.1] - by localhost.localdomain with POP3 (fetchmail-6.3.2) - for (single-drop); Mon, 02 Oct 2006 09:13:02 +0100 (BST) -Received: from user.indexdata.dk ([213.150.43.10] helo=[10.0.1.61]) - by bagel.indexdata.dk with esmtp (Exim 4.50) - id 1GUIlW-0000zk-12; Mon, 02 Oct 2006 10:03:06 +0200 -Message-ID: <4520C783.60307@indexdata.dk> -Organization: Index Data ApS -User-Agent: Thunderbird 1.5.0.7 (Windows/20060909) -MIME-Version: 1.0 -X-SA-Do-Not-Run: Yes -X-SA-Exim-Connect-IP: 213.150.43.10 -X-SA-Exim-Rcpt-To: sondberg@indexdata.dk, mike@indexdata.com -X-SA-Exim-Mail-From: perhans@indexdata.dk -X-SA-Exim-Scanned: No (on bagel.indexdata.dk); SAEximRunCond expanded to false -X-UIDL: FnH"!K?f!!"L["!4!["! -From: "Per M. Hansen" -To: =?ISO-8859-1?Q?Anders_S=F8nderberg_Mortensen?= - , Mike Taylor -Subject: Tests in Z-SPy -Date: Mon, 02 Oct 2006 10:02:11 +0200 -X-StripMime: Non-text section removed by stripmime -Content-Transfer-Encoding: 7bit -Content-Type: text/plain; charset=ISO-8859-1; format=flowed - -Guys, - -Anders has asked me to list the test that the Z-Spy performs. - - * Test Bib-1 attributes from atrribute 1-1036 - * Test the extended Bib-1 attributes 1037-1096 - * Test the extended DubliCore attributes 1097-1111 - * Test the GILS attributes 1112-1184 - * Test the extended Bib-1 attributes 1085-1209 - * Test the Dan-1 attributes 1-27 - * Test what record foamats the target i capable of returning from - the list: DANMARC USMARC JPMARC UNIMARC CANMARC NORMARC UKMARC - PICAMARC IBERMARC INTERMARC LIBRISMARC GRS-1 SUTRS XML OPAC - SUMMARY MAB RUSMARC SWEMARC - * Test what parts of Explain the server supports from the list: - CategoryList TargetInfo DatabaseInfo SchemaInfo TagSetInfo - RecordSyntaxInfo AttributeSetInfo TermListInfo - ExtendedServicesInfo AttributeDetails TermListDetails - ElementSetDetails RetrivalRecordDetails SortDetails Processing - VariantSetInfo UnitSet - * Test support of bolean operators: and or not - * Test what services the target supports - -Apart from that Z-Spy has the following features: - - * When a server closes the connection in the middel of a test, Z-Spy - can reconnect and continue the test where it crashed. - * When a test has failed n number of times, with the same error, an - email is send to the sys admin. - * Z-Spy can put a sleap in between the serches in order not to - stress the target too much - * To begin with a query with a common word is used, until a record - has been found so that the record format test can be performed. - When this record has been formed, the query is switched to - something more uncommon like "askdndd" in order to stress the - server as little as possible. - --- -Per - - - ---- StripMime Report -- processed MIME parts --- -multipart/alternative - text/plain (text body -- kept) - text/html ---- - -