Skip to content

Commit

Permalink
Deploy kalisio/krawler to github.com/kalisio/krawler.git:gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
traviscibot committed Jan 16, 2024
1 parent c00fb07 commit 0f06d3c
Show file tree
Hide file tree
Showing 20 changed files with 23 additions and 23 deletions.
2 changes: 1 addition & 1 deletion 404.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion about/contact.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion about/contributing.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion about/introduction.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion about/license.html

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion about/roadmap.html

Large diffs are not rendered by default.

Large diffs are not rendered by default.

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion examples/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -67,7 +67,7 @@
<span class="line"><span style="color:#24292E;"> </span><span style="color:#005CC5;">&quot;link&quot;</span><span style="color:#24292E;">: </span><span style="color:#032F62;">&quot;https://s3.eu-central-1.amazonaws.com/krawler/bc185cb0-7983-11e8-883f-a333a7402f4a.png&quot;</span></span>
<span class="line"><span style="color:#24292E;"> }</span></span>
<span class="line"><span style="color:#24292E;">]</span></span></code></pre></div><h3 id="seeder" tabindex="-1">Seeder <a class="header-anchor" href="#seeder" aria-label="Permalink to &quot;Seeder&quot;"></a></h3><p>The seeder take advantage of <a href="https://kalisio.github.io/kargo/" target="_blank" rel="noreferrer">Kargo</a> to seed a dataset. It relies on the seeding capabilities of <a href="https://mapproxy.org/docs/nightly/seed.html" target="_blank" rel="noreferrer">MapProxy</a>. The global approach is to subdivide the job into multiple tasks and run <code>mapprroxy-seed</code> utility for each task. To subdivide the job, we use a spatial grid and each cell is used as a coverage entry to limit the extend of the corresponding task. All the tasks, i.e. <code>mapproxy-seed</code> share the same MapProxy configuration file and use a generated seed file.</p><p>We use the same image of MapProxy as the one used in Kargo, but for now we do not use the benefits of a Swarm infrastructure to deploy the task. Meanwhile, if you plan to seed a layer with a source exposed by TileserverGL, you can easily scale the number of instances of TileserverGL to fit the required charge.</p></div></div></main><footer class="VPDocFooter" data-v-a3c25e27 data-v-a2d931e4><!--[--><!--]--><!----><!----></footer><!--[--><!--]--></div></div></div><!--[--><!--]--></div></div><footer class="VPFooter" data-v-9d8abc1e data-v-e4279f1c><div class="container" data-v-e4279f1c><!----><p class="copyright" data-v-e4279f1c>MIT Licensed | Copyright © 2017-20xx Kalisio</p></div></footer><!--[--><!--]--></div></div>
<script>window.__VP_HASH_MAP__=JSON.parse("{\"guides_index.md\":\"8bac4ba9\",\"about_roadmap.md\":\"2f902165\",\"reference_index.md\":\"76bdc228\",\"reference_hooks.md\":\"2f6bf6ef\",\"about_license.md\":\"51fe04ca\",\"reference_known-issues.md\":\"29bbda91\",\"reference_services.md\":\"4fa3200f\",\"about_contributing.md\":\"30a97c28\",\"about_introduction.md\":\"b4a8b11a\",\"examples_index.md\":\"2db99c6c\",\"guides_extending-krawler.md\":\"ccca42a7\",\"guides_installing-krawler.md\":\"60d1a08e\",\"guides_understanding-krawler.md\":\"56d783c6\",\"about_contact.md\":\"8fe8c179\",\"guides_using-krawler.md\":\"e66b4f7b\",\"index.md\":\"ee3add83\"}");window.__VP_SITE_DATA__=JSON.parse("{\"lang\":\"en-US\",\"dir\":\"ltr\",\"title\":\"Krawler\",\"description\":\"A minimalist Geospatial ETL\",\"base\":\"/krawler/\",\"head\":[],\"appearance\":true,\"themeConfig\":{\"logo\":\"https://s3.eu-central-1.amazonaws.com/kalisioscope/krawler/krawler-icon-64x64.png\",\"socialLinks\":[{\"icon\":\"linkedin\",\"link\":\"https://fr.linkedin.com/company/kalisio\"},{\"icon\":\"twitter\",\"link\":\"https://twitter.com/Kalisio3\"},{\"icon\":\"github\",\"link\":\"https://github.com/kalisio\"}],\"nav\":[{\"text\":\"About\",\"link\":\"/about/introduction\"},{\"text\":\"Guides\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Reference\",\"link\":\"/reference/services\"},{\"text\":\"Examples\",\"link\":\"/examples/\"},{\"text\":\"GitHub\",\"link\":\"https://github.com/kalisio/krawler\"}],\"sidebar\":{\"/about/\":[{\"text\":\"Introduction\",\"link\":\"/about/introduction\"},{\"text\":\"Roadmap\",\"link\":\"/about/roadmap\"},{\"text\":\"Contributing\",\"link\":\"/about/contributing\"},{\"text\":\"License\",\"link\":\"/about/license\"},{\"text\":\"Contact\",\"link\":\"/about/contact\"}],\"/guides/\":[{\"text\":\"Understanding Krawler\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Installing Krawler\",\"link\":\"/guides/installing-krawler\"},{\"text\":\"Using Krawler\",\"link\":\"/guides/using-krawler\"},{\"text\":\"Extending Krawler\",\"link\":\"/guides/extending-krawler\"}],\"/reference/\":[{\"text\":\"Services\",\"link\":\"/reference/services\"},{\"text\":\"Hooks\",\"link\":\"/reference/hooks\"},{\"text\":\"Known-issues\",\"link\":\"/reference/known-issues\"}],\"/examples/\":[]},\"footer\":{\"copyright\":\"MIT Licensed | Copyright © 2017-20xx Kalisio\"}},\"locales\":{},\"scrollOffset\":90,\"cleanUrls\":false}");</script>
<script>window.__VP_HASH_MAP__=JSON.parse("{\"about_contact.md\":\"8fe8c179\",\"about_license.md\":\"51fe04ca\",\"about_roadmap.md\":\"2f902165\",\"examples_index.md\":\"2db99c6c\",\"guides_extending-krawler.md\":\"ccca42a7\",\"guides_index.md\":\"8bac4ba9\",\"guides_understanding-krawler.md\":\"56d783c6\",\"guides_using-krawler.md\":\"e66b4f7b\",\"index.md\":\"ee3add83\",\"reference_hooks.md\":\"3cc0f923\",\"guides_installing-krawler.md\":\"60d1a08e\",\"about_contributing.md\":\"30a97c28\",\"about_introduction.md\":\"b4a8b11a\",\"reference_services.md\":\"4fa3200f\",\"reference_index.md\":\"76bdc228\",\"reference_known-issues.md\":\"29bbda91\"}");window.__VP_SITE_DATA__=JSON.parse("{\"lang\":\"en-US\",\"dir\":\"ltr\",\"title\":\"Krawler\",\"description\":\"A minimalist Geospatial ETL\",\"base\":\"/krawler/\",\"head\":[],\"appearance\":true,\"themeConfig\":{\"logo\":\"https://s3.eu-central-1.amazonaws.com/kalisioscope/krawler/krawler-icon-64x64.png\",\"socialLinks\":[{\"icon\":\"linkedin\",\"link\":\"https://fr.linkedin.com/company/kalisio\"},{\"icon\":\"twitter\",\"link\":\"https://twitter.com/Kalisio3\"},{\"icon\":\"github\",\"link\":\"https://github.com/kalisio\"}],\"nav\":[{\"text\":\"About\",\"link\":\"/about/introduction\"},{\"text\":\"Guides\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Reference\",\"link\":\"/reference/services\"},{\"text\":\"Examples\",\"link\":\"/examples/\"},{\"text\":\"GitHub\",\"link\":\"https://github.com/kalisio/krawler\"}],\"sidebar\":{\"/about/\":[{\"text\":\"Introduction\",\"link\":\"/about/introduction\"},{\"text\":\"Roadmap\",\"link\":\"/about/roadmap\"},{\"text\":\"Contributing\",\"link\":\"/about/contributing\"},{\"text\":\"License\",\"link\":\"/about/license\"},{\"text\":\"Contact\",\"link\":\"/about/contact\"}],\"/guides/\":[{\"text\":\"Understanding Krawler\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Installing Krawler\",\"link\":\"/guides/installing-krawler\"},{\"text\":\"Using Krawler\",\"link\":\"/guides/using-krawler\"},{\"text\":\"Extending Krawler\",\"link\":\"/guides/extending-krawler\"}],\"/reference/\":[{\"text\":\"Services\",\"link\":\"/reference/services\"},{\"text\":\"Hooks\",\"link\":\"/reference/hooks\"},{\"text\":\"Known-issues\",\"link\":\"/reference/known-issues\"}],\"/examples/\":[]},\"footer\":{\"copyright\":\"MIT Licensed | Copyright © 2017-20xx Kalisio\"}},\"locales\":{},\"scrollOffset\":90,\"cleanUrls\":false}");</script>

</body>
</html>
2 changes: 1 addition & 1 deletion guides/extending-krawler.html
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@
<span class="line"><span style="color:#24292E;"> }</span></span>
<span class="line"><span style="color:#24292E;">}</span></span>
<span class="line"><span style="color:#24292E;">hooks.</span><span style="color:#6F42C1;">registerHook</span><span style="color:#24292E;">(</span><span style="color:#032F62;">&#39;custom&#39;</span><span style="color:#24292E;">, hook)</span></span></code></pre></div><p>After that you can use your custom hook like the built-in ones with the <a href="./using-krawler.html#command-line-interface">CLI</a>.</p><div class="tip custom-block"><p class="custom-block-title">TIP</p><p>For this to work you need to add krawler as a dependency in the <code>package.json</code> of your job module or link to it in development mode. Please refer to our <a href="./installing-krawler.html#as-module">installation section</a></p></div><h2 id="complete-example" tabindex="-1">Complete example <a class="header-anchor" href="#complete-example" aria-label="Permalink to &quot;Complete example&quot;"></a></h2><p>A complete example of extension is available in the <a href="https://github.com/kalisio/krawler/blob/master/examples/extend/index.js" target="_blank" rel="noreferrer">samples</a>.</p></div></div></main><footer class="VPDocFooter" data-v-a3c25e27 data-v-a2d931e4><!--[--><!--]--><!----><nav class="prev-next" data-v-a2d931e4><div class="pager" data-v-a2d931e4><a class="pager-link prev" href="/krawler/guides/using-krawler.html" data-v-a2d931e4><span class="desc" data-v-a2d931e4>Previous page</span><span class="title" data-v-a2d931e4>Using Krawler</span></a></div><div class="pager" data-v-a2d931e4><!----></div></nav></footer><!--[--><!--]--></div></div></div><!--[--><!--]--></div></div><footer class="VPFooter has-sidebar" data-v-9d8abc1e data-v-e4279f1c><div class="container" data-v-e4279f1c><!----><p class="copyright" data-v-e4279f1c>MIT Licensed | Copyright © 2017-20xx Kalisio</p></div></footer><!--[--><!--]--></div></div>
<script>window.__VP_HASH_MAP__=JSON.parse("{\"guides_index.md\":\"8bac4ba9\",\"about_roadmap.md\":\"2f902165\",\"reference_index.md\":\"76bdc228\",\"reference_hooks.md\":\"2f6bf6ef\",\"about_license.md\":\"51fe04ca\",\"reference_known-issues.md\":\"29bbda91\",\"reference_services.md\":\"4fa3200f\",\"about_contributing.md\":\"30a97c28\",\"about_introduction.md\":\"b4a8b11a\",\"examples_index.md\":\"2db99c6c\",\"guides_extending-krawler.md\":\"ccca42a7\",\"guides_installing-krawler.md\":\"60d1a08e\",\"guides_understanding-krawler.md\":\"56d783c6\",\"about_contact.md\":\"8fe8c179\",\"guides_using-krawler.md\":\"e66b4f7b\",\"index.md\":\"ee3add83\"}");window.__VP_SITE_DATA__=JSON.parse("{\"lang\":\"en-US\",\"dir\":\"ltr\",\"title\":\"Krawler\",\"description\":\"A minimalist Geospatial ETL\",\"base\":\"/krawler/\",\"head\":[],\"appearance\":true,\"themeConfig\":{\"logo\":\"https://s3.eu-central-1.amazonaws.com/kalisioscope/krawler/krawler-icon-64x64.png\",\"socialLinks\":[{\"icon\":\"linkedin\",\"link\":\"https://fr.linkedin.com/company/kalisio\"},{\"icon\":\"twitter\",\"link\":\"https://twitter.com/Kalisio3\"},{\"icon\":\"github\",\"link\":\"https://github.com/kalisio\"}],\"nav\":[{\"text\":\"About\",\"link\":\"/about/introduction\"},{\"text\":\"Guides\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Reference\",\"link\":\"/reference/services\"},{\"text\":\"Examples\",\"link\":\"/examples/\"},{\"text\":\"GitHub\",\"link\":\"https://github.com/kalisio/krawler\"}],\"sidebar\":{\"/about/\":[{\"text\":\"Introduction\",\"link\":\"/about/introduction\"},{\"text\":\"Roadmap\",\"link\":\"/about/roadmap\"},{\"text\":\"Contributing\",\"link\":\"/about/contributing\"},{\"text\":\"License\",\"link\":\"/about/license\"},{\"text\":\"Contact\",\"link\":\"/about/contact\"}],\"/guides/\":[{\"text\":\"Understanding Krawler\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Installing Krawler\",\"link\":\"/guides/installing-krawler\"},{\"text\":\"Using Krawler\",\"link\":\"/guides/using-krawler\"},{\"text\":\"Extending Krawler\",\"link\":\"/guides/extending-krawler\"}],\"/reference/\":[{\"text\":\"Services\",\"link\":\"/reference/services\"},{\"text\":\"Hooks\",\"link\":\"/reference/hooks\"},{\"text\":\"Known-issues\",\"link\":\"/reference/known-issues\"}],\"/examples/\":[]},\"footer\":{\"copyright\":\"MIT Licensed | Copyright © 2017-20xx Kalisio\"}},\"locales\":{},\"scrollOffset\":90,\"cleanUrls\":false}");</script>
<script>window.__VP_HASH_MAP__=JSON.parse("{\"about_contact.md\":\"8fe8c179\",\"about_license.md\":\"51fe04ca\",\"about_roadmap.md\":\"2f902165\",\"examples_index.md\":\"2db99c6c\",\"guides_extending-krawler.md\":\"ccca42a7\",\"guides_index.md\":\"8bac4ba9\",\"guides_understanding-krawler.md\":\"56d783c6\",\"guides_using-krawler.md\":\"e66b4f7b\",\"index.md\":\"ee3add83\",\"reference_hooks.md\":\"3cc0f923\",\"guides_installing-krawler.md\":\"60d1a08e\",\"about_contributing.md\":\"30a97c28\",\"about_introduction.md\":\"b4a8b11a\",\"reference_services.md\":\"4fa3200f\",\"reference_index.md\":\"76bdc228\",\"reference_known-issues.md\":\"29bbda91\"}");window.__VP_SITE_DATA__=JSON.parse("{\"lang\":\"en-US\",\"dir\":\"ltr\",\"title\":\"Krawler\",\"description\":\"A minimalist Geospatial ETL\",\"base\":\"/krawler/\",\"head\":[],\"appearance\":true,\"themeConfig\":{\"logo\":\"https://s3.eu-central-1.amazonaws.com/kalisioscope/krawler/krawler-icon-64x64.png\",\"socialLinks\":[{\"icon\":\"linkedin\",\"link\":\"https://fr.linkedin.com/company/kalisio\"},{\"icon\":\"twitter\",\"link\":\"https://twitter.com/Kalisio3\"},{\"icon\":\"github\",\"link\":\"https://github.com/kalisio\"}],\"nav\":[{\"text\":\"About\",\"link\":\"/about/introduction\"},{\"text\":\"Guides\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Reference\",\"link\":\"/reference/services\"},{\"text\":\"Examples\",\"link\":\"/examples/\"},{\"text\":\"GitHub\",\"link\":\"https://github.com/kalisio/krawler\"}],\"sidebar\":{\"/about/\":[{\"text\":\"Introduction\",\"link\":\"/about/introduction\"},{\"text\":\"Roadmap\",\"link\":\"/about/roadmap\"},{\"text\":\"Contributing\",\"link\":\"/about/contributing\"},{\"text\":\"License\",\"link\":\"/about/license\"},{\"text\":\"Contact\",\"link\":\"/about/contact\"}],\"/guides/\":[{\"text\":\"Understanding Krawler\",\"link\":\"/guides/understanding-krawler\"},{\"text\":\"Installing Krawler\",\"link\":\"/guides/installing-krawler\"},{\"text\":\"Using Krawler\",\"link\":\"/guides/using-krawler\"},{\"text\":\"Extending Krawler\",\"link\":\"/guides/extending-krawler\"}],\"/reference/\":[{\"text\":\"Services\",\"link\":\"/reference/services\"},{\"text\":\"Hooks\",\"link\":\"/reference/hooks\"},{\"text\":\"Known-issues\",\"link\":\"/reference/known-issues\"}],\"/examples/\":[]},\"footer\":{\"copyright\":\"MIT Licensed | Copyright © 2017-20xx Kalisio\"}},\"locales\":{},\"scrollOffset\":90,\"cleanUrls\":false}");</script>

</body>
</html>
2 changes: 1 addition & 1 deletion guides/index.html

Large diffs are not rendered by default.

Loading

0 comments on commit 0f06d3c

Please sign in to comment.