deployment/quickstart_install/sh-scripts/minikube.sh
or
deployment/quickstart_install/ps-scripts/minikube.ps1
deployment/quickstart_install/sh-scripts/dependencies.sh
or
deployment/quickstart_install/ps-scripts/dependencies.ps1
- Go to https://github.com/G-Research/siembol-config
- Fork into your own organization or personal account
- Go to https://github.com/settings/tokens
- Click Generate new token
- Select "repo - Full control of private repositories" scope
- Hit "Generate token"
- Keep this token value as you will need it for the next step.
- This will ask for your github details related to the Siembol Config repository and the token created in previous step.
deployment/quickstart_install/sh-scripts/demoInstall.sh
or
deployment/quickstart_install/ps-scripts/demoInstall.ps1
To install Siembol in the cluster
helm install siembol deployment/helm-k8s/ -f deployment/helm-k8s/values.yaml -n=siembol
This step might take a few minutes depending on the specs of your development machine.
In a browser, go to:
You should now see the Siembol UI homepage. You can also try Storm UI to see running topologies:
To add enrichment tables.
deployment/quickstart_install/sh-scripts/enrichmentStore.sh
or
deployment/quickstart_install/ps-scripts/enrichmentStore.ps1
We are scraping Siembol metrics using Prometheus and displaying the metrics in a Grafana dashboard.
To install these components:
- Download charts:
helm dependency update deployment/helm-k8s/monitoring-tools/
- Install the charts:
helm install monitoring deployment/helm-k8s/monitoring-tools/ -n=siembol
To see the dashboard:
You can also see the raw Prometheus metrics from:
We are using Kafdrop UI to view topics and messages. You can send messages to parsing topics and to test siembol configs.
- To install this and create a kafka client pod:
deployment/quickstart_install/sh-scripts/kafkaExtra.sh
or
deployment/quickstart_install/ps-scripts/kafkaExtra.ps1
- Exec into the kafka client pod:
kubectl exec --tty -i kafka-client --namespace siembol -- bash
- Connect to the broker:
kafka-console-producer.sh \
--broker-list kafka-0.kafka-headless.siembol.svc.cluster.local:9092 \
--topic <your-topic>
- Produce your message in terminal window
We have a simple deployment which generates messages which Siembol processes. The Kafka topics, frequency and messages can be modified here
- To run this:
helm install traffic-generator deployment/helm-k8s/kafka-traffic-generator/ -n=siembol
If you're done poking about on a local instance, you can clean up with:
- For cleaning up siembol resources and dependencies:
deployment/quickstart_install/sh-scripts/cleanUp.sh
or
deployment/quickstart_install/ps-scripts/cleanUp.ps1
- For deleting everything; delete the siembol minikube profile:
minikube delete -p siembol
sudo rm /etc/resolver/minikube-*