LISTSERV mailing list manager LISTSERV 16.0

Help for ZNG Archives


ZNG Archives

ZNG Archives


[email protected]


View:

Message:

[

First

|

Previous

|

Next

|

Last

]

By Topic:

[

First

|

Previous

|

Next

|

Last

]

By Author:

[

First

|

Previous

|

Next

|

Last

]

Font:

Proportional Font

LISTSERV Archives

LISTSERV Archives

ZNG Home

ZNG Home

ZNG  December 2004

ZNG December 2004

Subject:

Re: multi-word queries (long)

From:

Adam Dickmeiss <[log in to unmask]>

Reply-To:

Z39.50 Next-Generation Initiative

Date:

Thu, 23 Dec 2004 00:06:27 +0100

Content-Type:

text/plain

Parts/Attachments:

Parts/Attachments

text/plain (147 lines)

Eric Lease Morgan wrote:
> Please advise me on how my SRU server should handle multi-word queries.
> Should I:
>
>   * do nothing and just throw an error,
Your server should throw an error if it receives invalid requests
including queries.
>   * munge these queries into valid CQL on the client side, or
Your client may offer some query language (not CQL) which must then be
converted to CQL on the client side.
>   * munge these queries into valid CQL on the server side
Nono.
>
> will do Boolean logic and pattern matching. Whether we like it or not
> people's expectations are being driven by Google.
Sure.

>
> If the above is more or less true, then I expect to get the following
> sorts of queries as input from users, and the majority of the queries
> will be like numbers 1, 2, 3, and 4:
>
>   1. foo
>   2. bar
>   3. foo bar
This is invalid CQL as it is defined today.
>   4. "foo bar"
>   5. title=foo bar

> (Even if Query #3 is not valid CQL, I think it should be, but that is
> beside the point.)
If the purpose of CQL is that it is supposed to be typed-in by regular
users, I agree with you.

OTOH, if CQL is supposed to be an easy-to-use language for applications
(and programmers!) there is no immediate problem as I see it. The focus
is that CQL should be easy to _generate_ (and parse) from input forms,
other command line languages, etc.

For example, a danish user interface might use a different reserved word
for and ("og"), or the user interface might wan to use operators like +
instead of "and".

CQL does not use a TOKEN ALONE to specify whether it is a operator or
search term. Instead it is the context (position) that makes them what
they are.. So
   a b c
is treated as term=a, booleanop=b, term=b, whereas
   a b
is treated as term=a, booleanop=b, term missing.

You have to convert your Google type language to CQL. Consider this query:
  a "b c" d
Tokenize the query. You have 3 tokens.. Put AND or OR between them and
preceed with proper index+relation.. So it could be converted to
  dc.title = a AND dc.title = "b c" AND dc.title = d

and you're set. Unfortunately it is not (yet) possible to use:
  dc.title = (a AND "b c" AND d)

If CQL had been different queries like
  a b
could have been allowed. This is NOT as CQL stands right now and what
I'm going to write has been written before more than a year ago (IIRC)
when CQL was "young". So old-timers can ignore.

1. The operators could be escaped, something like:
   a @and b
   a <and> b
   a \and b
Bad: looks ugly. A programming language - not a user friendly language.
Good: Extremly easy to generate and parse (even for userfriendly
interfaces). For example, it is trivial to convert
   a and b
to
   a @and b
if the client uses english "reserved" words.

2. Reserved words could be introduced. Names must be quoted to avoid
them being treated as operators .e.g
   a "and" b
is OK and is query consisting of three terms, whereas
   a and b
is a AND b.

Good: looks good. Close to Google.
Bad: as things progress more words will be introduced.. So people might
be in for "surprises" (some words now suddenly reserved)...

> Another question, "Are Queries #3 and #4 intended to be equivalent?"
Since query #3 is invalid you won't get an answer for me. Note that "a
b" in
  dc.title any "a b"
is not a phrase. So it depends on the relation.

When you just write
   "a b"
without field+relation it is serverChoice.. which by definition is
undefined.

My favorite method is 1.

> Again, I think the answer is yes, but I am not able not put my finger
> on any documentation explicitly stating this.
>
> My SRU client interface WILL receive queries such as the following --
> people WILL enter queries such as these:
You have to change your interface.

>   * foo bar
>   * repetitive task
>   * virtual libraries
>   * International Technology Education Association
>
> My interface needs to gracefully accept such queries, process them, and
> return meaningful results; I do not intend to throw back to the user
> errors such as "Bad syntax. Read the documentation and try again."
Of course not:-)

> My Perl-based CQL parser (beautifully written by Ed S.) is heavily
> based on the cql-java parser. In both cases, queries such as the ones
> above output this error:
>
>   unknown first class relation
That's what they should do. Sorry.
>
> Furthermore, a number of the test SRU servers also output errors of
> various flavors for multi-word searches:
>
>   Illegal or unsupported boolean found.
>   unknown first-class relation
>   Query syntax error
At least they all throw some error!

Have deleted some text cuase the same question seem to be raised
multiple times ;-)
> Whew! What do you think? Is the mulit-word query, repetitive task, a
> valid CQL query?
No.
>
> --
> Eric "Why Am I Working At This Time Of Year?!" Morgan
> University Libraries of Notre Dame
Of course:-)

/ Adam

Top of Message | Previous Page | Permalink

Advanced Options


Options

Log In

Log In

Get Password

Get Password


Search Archives

Search Archives


Subscribe or Unsubscribe

Subscribe or Unsubscribe


Archives

July 2017
October 2016
July 2016
August 2014
February 2014
December 2013
November 2013
October 2013
February 2013
January 2013
October 2012
August 2012
April 2012
January 2012
October 2011
May 2011
April 2011
November 2010
October 2010
September 2010
July 2010
June 2010
May 2010
April 2010
March 2010
February 2010
January 2010
December 2009
October 2009
September 2009
August 2009
July 2009
May 2009
April 2009
March 2009
February 2009
December 2008
November 2008
October 2008
September 2008
August 2008
July 2008
June 2008
May 2008
April 2008
March 2008
February 2008
January 2008
December 2007
November 2007
October 2007
September 2007
August 2007
July 2007
June 2007
May 2007
April 2007
March 2007
January 2007
December 2006
November 2006
October 2006
September 2006
August 2006
July 2006
June 2006
May 2006
April 2006
March 2006
February 2006
January 2006
December 2005
November 2005
October 2005
September 2005
August 2005
July 2005
June 2005
May 2005
April 2005
March 2005
February 2005
January 2005
December 2004
November 2004
October 2004
September 2004
August 2004
July 2004
June 2004
May 2004
April 2004
March 2004
February 2004
January 2004
December 2003
November 2003
October 2003
September 2003
August 2003
July 2003
June 2003
May 2003
April 2003
March 2003
February 2003
January 2003
December 2002
November 2002
October 2002
September 2002
August 2002
July 2002
June 2002
May 2002
April 2002
March 2002
February 2002
January 2002
December 2001
November 2001
October 2001
September 2001
August 2001
July 2001

ATOM RSS1 RSS2



LISTSERV.LOC.GOV

CataList Email List Search Powered by the LISTSERV Email List Manager