[OAI-implementers] New OAI crawl results in progress...

herbert van de sompel hvdsomp@yahoo.com
Sat, 02 Mar 2002 09:39:41 +0000


Alan,

This looks like wonderful work!  A significant addition to the toolset
available for repositories to inspect their implementations.

greetings

herbert van de sompel

Alan Kent wrote:

> I have started up my new OAI crawler which does a few more sanity
> checks on data formats etc, automatically disables crawls from
> bad sites, and so on. The results page has moved (but is linked
> from the old manually generated page). The new page is:
>
>     http://www.mds.rmit.edu.au/~ajk/oai/interop/summary.htm
>
> If you site has been disbled, its because my end things you did
> something wrong. If you click on the link for your repository name,
> it will take you to a log of status messages and errors.
>
> At present, I regenerate the HTML pages using a script I run by
> hand so the results might not be 100% up to date when you view
> them. But they should be pretty accurate.
>
> I am now doing things like correctly supporting aggregators
> (sites where records coming back do not belong to that site).
> For example, I think the 'anu' site returns 'caltechEERL'
> records - even though I don't have any details about such
> a repository.
>
> After the crawler is a bit more robust, I may move the whole database
> outside our firewall so others can query it.
>
> Alan
> --
> Alan Kent (mailto:ajk@mds.rmit.edu.au, http://www.mds.rmit.edu.au)
> Postal: Multimedia Database Systems, RMIT, GPO Box 2476V, Melbourne 3001.
> Where: RMIT MDS, Bld 91, Level 3, 110 Victoria St, Carlton 3053, VIC
> Australia.
> Phone: +61 3 9925 4114  Reception: +61 3 9925 4099  Fax: +61 3 9925 4098
> _______________________________________________
> OAI-implementers mailing list
> OAI-implementers@oaisrv.nsdl.cornell.edu
> http://oaisrv.nsdl.cornell.edu/mailman/listinfo/oai-implementers
>
> *********************************************************************
> The information contained in this e-mail is confidential and may be
> legally privileged. It is intended for the addressee(s) only. If you
> are not the intended recipient, please delete this e-mail and notify
> the postmaster@bl.uk : The contents of this e-mail must not be
> disclosed or copied without the sender's consent.
>
> The statements and opinions expressed in this message are those of
> the author and do not necessarily reflect those of the British
> Library. The British Library does not take any responsibility for
> the views of the author.
> *********************************************************************


_________________________________________________________
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com