[OAI-implementers] How many records should typically be returned over OAI-PMH?

[Simeon Warner]

I have had arXiv.org's OAI interface sending replies of around 1MB
(actually up to about 1.5) for some time and no one has told me of any
problems with the reply size.

Cheers,
Simeon


On Wed, 2 Feb 2005, Hussein Suleman wrote:
> hi Dan
>
> i dont think there is a de facto standard ... but i recall some people a
> while back saying responses should not exceed about 1MB in size because
> of limitations of popular XML processing tools
>
> if your responses are about that size and the RE does not accept them,
> let me know and ill increase the limits ...
>
> ttfn,
> ----hussein
>
> ps. personally, i think 500 records is fine
>
>
> Dan Stowell wrote:
>
> > Thanks - but yes, I'm aware of the resumptionToken - I just wanted to
> > know whether there's a de facto standard for how many records to return
> > in a single response, before giving the resumptionToken.
> >
> > Best,
> > Dan
> >
> >
> > At 21:51 02/02/2005 +1100, Baden Hughes wrote:
> >
> >> OAI-PMH has a flow control mechanism [1], which, if followed, allows
> >> the use of a resumptionToken for handling larger data sets. This is
> >> widely implemented in OAI tools.
> >>
> >> [1]
> >> http://www.openarchives.org/OAI/2.0/openarchivesprotocol.htm#FlowControl
> >>
> >> Baden
> >>
> >> On Wed, 2 Feb 2005, Dan Stowell wrote:
> >>
> >>> Hi,
> >>>
> >>> I'm implementing OAI-PMH and at first I decided that my system could
> >>> easily return 2000 records in a single OAI-PMH request. Unfortunately
> >>> the "OAI Repository Explorer" doesn't seem to be able to cope with
> >>> that much data since it ended up having timeout and too-much-data
> >>> errors.
> >>>
> >>> I've now reduced that number to 500 and my repository now validates
> >>> happily. But is there a rule of thumb for how many records it's
> >>> "polite" to return, or how many a typical OAI-PMH harvester "expects"
> >>> to have to deal with?
> >>>
> >>> Thanks
> >>> Dan
> >>>
> >>> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> >>> Dan Stowell
> >>> Faculty Information Support Officer (Life Sciences), UCL
> >>> http://www.ucl.ac.uk/is/fiso/lifesciences/
> >>>
> >>> Room B07A, Drayton House, 30 Gordon Street, London
> >>> Phone: +44 (0)20 7679 5472      (within UCL: dial 25472)
> >>> Email: d.stowell at ucl.ac.uk
> >>>
> >>>
> >>> _______________________________________________
> >>> OAI-implementers mailing list
> >>> List information, archives, preferences and to unsubscribe:
> >>> http://www.openarchives.org/mailman/listinfo/oai-implementers
> >
> >
> >
> > _______________________________________________
> > OAI-implementers mailing list
> > List information, archives, preferences and to unsubscribe:
> > http://www.openarchives.org/mailman/listinfo/oai-implementers
> >
>
> --
> =====================================================================
> hussein suleman ~ hussein at cs.uct.ac.za ~ http://www.husseinsspace.com
> =====================================================================
>
>
> _______________________________________________
> OAI-implementers mailing list
> List information, archives, preferences and to unsubscribe:
> http://www.openarchives.org/mailman/listinfo/oai-implementers
>