Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Crawl I2P links #25

Open
PROxZIMA opened this issue Sep 28, 2022 · 0 comments
Open

Crawl I2P links #25

PROxZIMA opened this issue Sep 28, 2022 · 0 comments
Assignees
@PROxZIMA
Labels
enhancement New feature or request hacktoberfest Hacktoberfest 2022 contribution

Comments

@PROxZIMA
Copy link
Owner

Dark web isn't made of just .onion links. Dark web consist of various darknets such as tor, I2P and freenet. These darknets also holds considerable amount of data. As they are P2P (peer to peer) networks, some adjustments are required to crawl them as well

Describe the solution you'd like

  • Starting a I2P server on the local machine
  • Using its proxy (127.0.0.1:4444) to traverse a I2P links.

I successfully implemented this method but need more ideas on integrating it with current crawler efficiently.

image
@PROxZIMA PROxZIMA added enhancement New feature or request hacktoberfest Hacktoberfest 2022 contribution labels Sep 28, 2022
@PROxZIMA PROxZIMA self-assigned this Feb 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@PROxZIMA PROxZIMA

Labels
enhancement New feature or request hacktoberfest Hacktoberfest 2022 contribution
Projects
DarkSpider
Status: 🆕 New
Milestone
No milestone
Development

No branches or pull requests
1 participant
@PROxZIMA