[OAI-implementers] Number of records in each request

[Simeon Warner]

The main issue concerning the maximum size of responses seems to be the
size that XML parsers will readily handle. The maximum number of records
that should be returned thus depends partly on the size of each record.
Limiting response size to a few MB seems sensible at present. For
arXiv.org I return <=1500 records which is typically 2-3MB.

One can of course return many more identifiers in a ListIdentifiers
response then records in a ListRecords response within the same size
limit.

Cheers,
Simeon.

On Fri, 21 Mar 2003, François Schiettecatte wrote:
> Venu
> 
> Whatever you feel comfortable with, if you have a big machine and a fast
> pipe to the net, I would return larger chunks of data, on the order of 1MB
> or larger, if you donıt, I would return small chunks of data, say 100K or
> less.
> 
> One think I would suggest you implement, if you have not already, is the
> "Retry-After" to prevent badly behaved harvesters from swamping your system.
> 
> On 3/21/03 11:57 AM, "Venugopal Reddy Pally" <pally_reddy@yahoo.com> wrote:
> 
> > 
> > Hi all,
> > 
> >  I am implementing ResumptionToken. how many records should be returned in any
> > response ?. How should I decide the number of records to be returned in a
> > partial response ?
> > 
> > Thanks,
> > 
> > Venu.
> > 
> > 
> > 
> > ---------------------------------
> > Do you Yahoo!?
> > Yahoo! Platinum - Watch CBS' NCAA March Madness, live on your desktop!
> 
> _______________________________________________
> OAI-implementers mailing list
> OAI-implementers@oaisrv.nsdl.cornell.edu
> http://oaisrv.nsdl.cornell.edu/mailman/listinfo/oai-implementers
>