Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some missing domains #15

Open
www2000 opened this issue Mar 26, 2023 · 7 comments
Open

Some missing domains #15

www2000 opened this issue Mar 26, 2023 · 7 comments

Comments

@www2000
Copy link

www2000 commented Mar 26, 2023

He i have done some datamining and found some more urls that missing
img-eshop.cdn.nintendo.net # firth image cdn
m1.nintendo.net # pdf
www.nintendo.co.jp # pdf

@neobrain
Copy link
Member

Could you provide more information on where these URLs referenced?

@neobrain
Copy link
Member

neobrain commented Mar 26, 2023

Can you tell me specific metadata files (from the samurai folder) these are referenced in so this can be verified independently? The links by themselves aren't too useful unless I understand how they are referenced in the metadata.

@neobrain
Copy link
Member

For 3DS, only PDFs from samurai servers are referenced, and only on JP region for some titles. Sadly all of them return status 404 with the message "Sorry, not found" when trying to fetch them using curl, however.

Other than JP, only region ES has exactly one title (50010000044217) that references a PDF on a capcom server. This server is likely unaffected by the impending eShop shutdown, but since it's only one file it's out of scope for saveShop scraping. Interested people should download this file manually.

@www2000
Copy link
Author

www2000 commented Mar 26, 2023

the pdf's are in samurai/{}/{}/title/{titleid}
and https://img-eshop.cdn.nintendo.net are the default of unknown4

@www2000
Copy link
Author

www2000 commented Mar 26, 2023

and try https://www.nintendo.co.jp/data/software/manual/{filename} as a backup option

@neobrain
Copy link
Member

Very interesting, that works!

I won't be able to integrate this quickly enough into saveShop, but interested people can run the following UNIX command chain to download the files manually:

mkdir manuals && cd manuals
ack "\.pdf" ../samurai/JP/ja/ | tr '>' '\n' | grep 'https.*pdf' | cut -d'<' -f1 | sort | sed 's/samurai-ctr.cdn.nintendo.net\/d/www.nintendo.co.jp\/data\/software\/manual/g' | xargs -I{} wget '{}'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants