LISTSERV mailing list manager LISTSERV 16.0

Help for ZNG Archives


ZNG Archives

ZNG Archives


[email protected]


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

ZNG Home

ZNG Home

ZNG  December 2004

ZNG December 2004

Subject:

multi-word queries (long)

From:

Eric Lease Morgan <[log in to unmask]>

Reply-To:

Z39.50 Next-Generation Initiative

Date:

Wed, 22 Dec 2004 14:31:12 -0500

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (124 lines)

Please advise me on how my SRU server should handle multi-word queries.
Should I:

   * do nothing and just throw an error,
   * munge these queries into valid CQL on the client side, or
   * munge these queries into valid CQL on the server side

After reading and re-reading the CQL documentation, I appreciate the
expressiveness of the language. At the same time, I don't expect users
to take advantage of this expressiveness, even if they are provided
with a rich query-by-example interface such as a form with lots o'
boxes, buttons, and pull-down menus. Experience has taught me that most
people, even librarians, use simple one or two word queries and expect
the world. If I'm lucky people will send phrase searches by enclosing
them in quotes. If I'm really lucky people will denote an index to
search with queries like title=foo. If I'm really, really lucky users
will do Boolean logic and pattern matching. Whether we like it or not
people's expectations are being driven by Google.

If the above is more or less true, then I expect to get the following
sorts of queries as input from users, and the majority of the queries
will be like numbers 1, 2, 3, and 4:

   1. foo
   2. bar
   3. foo bar
   4. "foo bar"
   5. title=foo bar
   6. title="foo bar"
   7. title=foo and creator=bar
   8. title=foo and (creator=bar or creator=baz)
   9. title=foo and creator=ba*

Part of my question is, "Is Query #3, above, a valid CQL query?" I
think the answer is "Yes, and such a query is treated is a proximity
search." According to the end of section #2 of the Gentle Introduction
to CQL:

   In general, multi-word terms are interpreted as requesting
   records in which a single field contains all the specified
   words, in the specified order, with no other words in
   between. This is a proximity search. But see the section
   below on relations for exceptions.

(Even if Query #3 is not valid CQL, I think it should be, but that is
beside the point.)

Another question, "Are Queries #3 and #4 intended to be equivalent?"
Again, I think the answer is yes, but I am not able not put my finger
on any documentation explicitly stating this.

My SRU client interface WILL receive queries such as the following --
people WILL enter queries such as these:

   * foo bar
   * repetitive task
   * virtual libraries
   * International Technology Education Association

My interface needs to gracefully accept such queries, process them, and
return meaningful results; I do not intend to throw back to the user
errors such as "Bad syntax. Read the documentation and try again."

My Perl-based CQL parser (beautifully written by Ed S.) is heavily
based on the cql-java parser. In both cases, queries such as the ones
above output this error:

   unknown first class relation

Furthermore, a number of the test SRU servers also output errors of
various flavors for multi-word searches:

   Illegal or unsupported boolean found.
   unknown first-class relation
   Query syntax error

Try:


http://alert.ockham.org/sru-server.cgi?
operation=searchRetrieve&version=1.1&query=repetitive+task

http://alcme.oclc.org/srw/search/SOAR?
operation=searchRetrieve&version=1.1&query=repetitive+task

http://z3950.loc.gov:7090/voyager?
operation=searchRetrieve&version=1.1&query=repetitive+task

http://greta.pica.nl:1080/sru/?
operation=searchRetrieve&version=1.1&query=repetitive+task

On the other hand, this server returns no error but actually returns
results:


http://krait.kb.nl/cgi-zoek/sru.pl?
operation=searchRetrieve&version=1.1&query=repetitive+task

Again, is the following query valid CQL:

   repetitive task

If it is a valid query, then which one of the following alternatives
should be considered equivalent to the query above:

   1. "repetitive task"
   2. repetitive and task

If the query above is valid CQL, then I need to have my CQL parser
updated to not return errors. It and apparently the cql-java parser
currently do return errors.

If the query above is invalid, then I will need to modify my client to
accept such queries (because people WILL enter such queries), transform
them into alternatives (#1 or #2), and pass along an SRU URL to my
server for execution.

Whew! What do you think? Is the mulit-word query, repetitive task, a
valid CQL query?

--
Eric "Why Am I Working At This Time Of Year?!" Morgan
University Libraries of Notre Dame

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

July 2017
October 2016
July 2016
August 2014
February 2014
December 2013
November 2013
October 2013
February 2013
January 2013
October 2012
August 2012
April 2012
January 2012
October 2011
May 2011
April 2011
November 2010
October 2010
September 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
October 2009
September 2009
August 2009
July 2009
May 2009
April 2009
March 2009
February 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003
May 2003
April 2003
March 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002
August 2002
July 2002
June 2002
May 2002
April 2002
March 2002
February 2002
January 2002
December 2001
November 2001
October 2001
September 2001
August 2001
July 2001

ATOM RSS1 RSS2



LISTSERV.LOC.GOV

CataList Email List Search Powered by the LISTSERV Email List Manager