Meta Issue

[labra]

This meta-issue includes a roadmap of the WDSub Project.

The following picture contains a context diagram that represents the main components that are related with wdsub.

Wikidata/Wikibase data generate JSON dumps which follow almost directly the wikibase data model. They can also generate RDF dumps which are serializations of the data model that include some conversions.

The most typical usage is that WDSub takes as input Wikidata/Wikibase dumps in JSON as well as a WShEx file that describes the Wikidata/wikibase data model from which we want to obtain a subset.

Another potential usage will be entity schemas that describe the subset. Entity schemas describe the RDF serialization of the Wikibase data model so it is required to convert entity schemas (ShEx) to WShEx. This conversion can be tracked in this issue .

WDSub currently generates JSON dumps as output, but we are planning to generate RDF dumps as well. This issue tracks that conversion.

One approach we could consider when processing JSON records is to convert them to RDF and validate them with entity schemas. This #22 tracks that option.