Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Usecase: wikimedia visualization #40

Open
bluemonk3y opened this issue Apr 16, 2020 · 0 comments
Open

Usecase: wikimedia visualization #40

bluemonk3y opened this issue Apr 16, 2020 · 0 comments
Assignees
Labels
use case Use case to provide example of how to use and value extracted

Comments

@bluemonk3y
Copy link
Collaborator

bluemonk3y commented Apr 16, 2020

Datasource from: https://stream.wikimedia.org/v2/stream/recentchange

Look at

  1. StreamFlow using timeoverlay to extrapolate trends
  2. Sankey against some different stages
  3. Unique users per 'n'
  4. Top 'n' domains over time 'n'

Useful attributes:

  • timestamp - "dt":"2020-04-16T16:19:17Z"
  • user: string: - "user":"Abishe"
  • bot: boolean - "bot":false
  • domain: string - "domain":"en.wikipedia.org",
  • stream: string - "stream":"mediawiki.recentchange"
  • topic: string - "topic":"eqiad.mediawiki.recentchange"
  • server_name: string: - "server_name":"en.wikipedia.org"

{"$schema":"/mediawiki/recentchange/1.0.0","meta":{"uri":"https://en.wikipedia.org/wiki/Rajathandhiram","request_id":"34f2bcd9-cb4e-4d5d-934a-4e875466cd21","id":"9c2bf7fc-299d-4472-8d9d-d241f3e6ebc8","dt":"2020-04-16T16:19:17Z","domain":"en.wikipedia.org","stream":"mediawiki.recentchange","topic":"eqiad.mediawiki.recentchange","partition":0,"offset":2326787135},"id":1251510556,"type":"edit","namespace":0,"title":"Rajathandhiram","comment":"Adding local [[Wikipedia:Short description|short description]]: \"2015 Indian Tamil-language film\", overriding Wikidata description \"2015 film\" ([[Wikipedia:Shortdesc helper|Shortdesc helper]])","timestamp":1587053957,"user":"Abishe","bot":false,"minor":false,"length":{"old":9163,"new":9217},"revision":{"old":948879830,"new":951322626},"server_url":"https://en.wikipedia.org","server_name":"en.wikipedia.org","server_script_path":"/w","wiki":"enwiki","parsedcomment":"Adding local <a href=\"/wiki/Wikipedia:Short_description\" title=\"Wikipedia:Short description\">short description</a>: &quot;2015 Indian Tamil-language film&quot;, overriding Wikidata description &quot;2015 film&quot; (<a href=\"/wiki/Wikipedia:Shortdesc_helper\" title=\"Wikipedia:Shortdesc helper\">Shortdesc helper</a>)"}

@bluemonk3y bluemonk3y added the enhancement New feature or request label Apr 16, 2020
@bluemonk3y bluemonk3y self-assigned this Apr 20, 2020
@logscape logscape added use case Use case to provide example of how to use and value extracted and removed enhancement New feature or request labels Apr 30, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
use case Use case to provide example of how to use and value extracted
Projects
None yet
Development

No branches or pull requests

2 participants