Skip to content
This repository has been archived by the owner on Feb 17, 2022. It is now read-only.

api: support finer-grain datetime #103

Open
kaplun opened this issue Dec 3, 2015 · 2 comments
Open

api: support finer-grain datetime #103

kaplun opened this issue Dec 3, 2015 · 2 comments

Comments

@kaplun
Copy link
Member

kaplun commented Dec 3, 2015

Currently, according to https://claimstore.readthedocs.org/en/latest/users.html#list-claims, the claimstore allows for datetime-based queries of the type:

  • since (datetime) – it must have the format ‘YYYY-MM-DD’. It fetches claims that were created from this given datetime.
  • until (datetime) – it must have the format ‘YYYY-MM-DD’. It fetches claims that were created up to this given datetime.

The day-based granularity could not be enough for certain services which needs to exchange and query IDs more often during the day.

Already today, we are exchanging between CDS and INSPIRE, respectively CDS IDs and INSPIRE IDs for corresponding papers, and due to limitation in OAI-PMH granularity and other technical constraints this propagation happens with potential 4-days of delays. With some hacks we are managing to put it under one day.

Would be great if no hacks were needed to have less-than-a-day updates once we move to exchange IDs via the claimstore.

@kaplun kaplun changed the title api: support finer-grained datetime api: support finer-grain datetime Dec 3, 2015
@tiborsimko
Copy link
Member

Hmm, each service can use REST API of the central ClaimStore to push their claims (or interrogate others' claims) many times during the day at their leisure according to their "live" needs. Hence I wonder whether it isn't enough to query about some wanted PID when a need arise and relying on getting a "real-time" replies back? The REST API paradigm provides here quite a difference already when compared to exchanging OAI-PMH feeds between two parties.

(That said, if there is a need to restrict resulting claims in time to those issued between, say, 10:00 and 11:23, then we can surely add that...)

@tiborsimko tiborsimko added the RFC label Dec 9, 2015
@tiborsimko tiborsimko added this to the someday milestone Dec 9, 2015
@kaplun
Copy link
Member Author

kaplun commented Dec 9, 2015

I can imagine it is more efficient for a client to query the claimstore in bulk for all the new claims related to some namespace since the last time (with general granularity) the query was performed, rather than perform thousands of get reqeusts for every known ID.

E.g.: Give me anything new has been declared since yesterday 10:33:11 on INSPIRE records.

@tiborsimko tiborsimko added Type: RFC and removed RFC labels Aug 1, 2016
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

3 participants