Many of us have experienced long, uninterrupted sessions of scrolling through social media feeds. But has anyone ever paused to ask: what exactly are all these users discussing?
This project seeks to answer that question. Its primary objective is to provide an unbiased, comprehensive analysis of public Mastodon servers by leveraging the capabilities of the BERTopic model. The project is designed with an extensible architecture, allowing for flexible and scalable insights into public discourse across these platforms.
Miro board here
| Component | Version |
|---|---|
| Docker | 20.10.5 |
| Docker-Compose | 1.25.0 |
| Mastodon API | 2.0 |
Obtain the project
git clone https://github.com/AndrewDarnall/The-Observer.git
cd The-ObserverRun a setup shell script (builds some container images such as Apache Kafka)
bash ./Scripts/project_setup.shBuild the project (this might take a while)
docker-compose buildRun the project
docker-compose upOpen your web browser of choice and enter:
localhost:5601/- Go to > Saved Objects > Import > The-Observer/Data_Visualization/saved-objects/dashboard_export.ndjson > click import
- Reload the page as is
- Go to dashboard and select the 'the_observer' dashboard
