[OAI-implementers] Harvesting- how to efficiently poll?

steve racker stracker321 at yahoo.com
Sat Apr 29 22:39:41 EDT 2006


If the granularity of an archive is YYYY-MM-DD and there are
many records per day, how can one efficiently poll for the
newest records?  I would have expected there to be a way to
specify the last seen record and get any newer records, but
it appears the only method is to first make a request with the
date then keep requesting on any encountered resumptionTokens.
when a response is received with no resumptionToken, keep
it until it expires, then the next poll starts with the date
again.  Is this correct? That seems to generate much repeated
data in responses when polling with the last resumptionToken.

		
---------------------------------
Yahoo! Messenger with Voice. Make PC-to-Phone Calls to the US (and 30+ countries) for 2¢/min or less.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://openarchives.org/pipermail/oai-implementers/attachments/20060429/64fed9f5/attachment.htm


More information about the OAI-implementers mailing list