Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Resource not reachable #2

Open
harsh9t opened this issue May 25, 2018 · 4 comments
Open

Resource not reachable #2

harsh9t opened this issue May 25, 2018 · 4 comments

Comments

@harsh9t
Copy link

harsh9t commented May 25, 2018

The resources at http://worldbank.270a.info/ are no longer reachable. Can this be fixed? If not is there another mirror of these datasets?

@csarven
Copy link
Owner

csarven commented May 25, 2018

Yes, it can be fixed. Unfortunately, not soon. I can't recall exact mirrors if any out there.

The data was on a server that I no longer have access to. So, we'll have to rebuild / rerun the scripts on a new server. Something I'm looking forward to doing but can't get to it in the next months (a small part of my thesis needs this, so I might have to revisit - getting *.270a.info [WB in particular] going any way)

The dumps were at: http://worldbank.270a.info/data/

See also:

http://lod.openlinksw.com/ may (should?) had/has the data in there.

There may be an HDT around somewhere too.

Aside: Perhaps you can raise this in [email protected] for some archeological digging? :)

@harsh9t
Copy link
Author

harsh9t commented May 25, 2018

Thanks for the detailed reply.

If I wanted to build/ run the scripts myself, could you recommend or point me to some documentation (readme or something) which I could refer to do so? :)

@csarven
Copy link
Owner

csarven commented May 26, 2018

I can't track worldbank in LOD Cache, but possibly of interest via @kidehen :

What we have in LOD Cache:

SPARQL Query Template:

SELECT DISTINCT  ?o
WHERE {
        GRAPH <http://{dataset-origin}/data/import/> {?s a ?o .}
      } 
LIMIT 100

Example:

SELECT DISTINCT  ?o
WHERE {
        GRAPH <http://fao.270a.info/data/import/> {?s a ?o .}
        # FILTER (CONTAINS(STR(?g),'270a.info'))
      } 
LIMIT 100

Origins:
abs.270a.info bis.270a.info fao.270a.info imf.270a.info uis.270a.info
bfs.270a.info ecb.270a.info frb.270a.info oecd.270a.info

Live Query Definition Example:
https://tinyurl.com/ycxz9gmm

Live Query Result Example:
https://tinyurl.com/y7k4qzh7

@csarven
Copy link
Owner

csarven commented May 26, 2018

I think the scripts are fairly readable but unfortunately documentation is lacking. It was a long time ago :S (not an excuse). So, I'll have to revisit everything myself to make sense of it and document.

On a related note, we'll have to check the worldbank's APIs to see in what state they are in, because even if we have the scripts all ready to go, it might not work out in the end. The 4 major datasets: indicators, finances, projects, and climate, all used different endpoints/APIs to retrieve. We literally have to hunt them down, and possibly update the scripts. Most people are interested in the indicators, and I think WB finally has an SDMX endpoint nowadays. If the datasets they are publishing (somewhere up to 10k if I remember correctly) can be programmatically called, we can use https://github.com/csarven/linked-sdmx instead of WorldBank.java in this repo. That was always desired but when I worked on these datasets, they weren't using SDMX for their indicators datasets.

I can also check some personal backups elsewhere with small hopes of finding them, but I'm not counting on it since the datasets were quite large.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants