Configuration question for running Druid with the Operator

[itamar-marom]

From the druid-operator Slack channel:

• What are you doing with the -Djava.io.tmpdir= configuration?
• How do you handle TLS?
• Using autoscaling? on which component and how?
• What Kubernetes kind are you using for each component?
• Using ZooKeeper-less?
• Using MiddleManager-less?
• What is your -Xmx , -Xms? How is it compared to the pods’ resource request/limits
• Setting CPU limit?
• How do you spread your pods across the cluster?
• Using Karpenter? What is your Provisioner and Launch Template
• What are you doing with these configurations: druid.segmentCache.locations and druid.server.maxSize
• Created Service objects? for which component?

[Jmoore1127]

+1. I am attempting to evaluate Druid for a few use cases. We run nearly all of our infra on k8s. I have found this operator to be practically unusable because of lack of documentation. Pointing to the CR spec and straight to druid docs is not helpful. Having the only example support only a single node cluster is also not helpful since there is nothing to compare against. Please please please provide even basic docs and examples.

[AdheipSingh]

@Jmoore1127 i totally understand your concern. We have basic documentation to get started. We also have a druid operator slack community to get started. There is a video session on druid on k8s which can help you get started.

I personally have been constrained on time, we are building a documentation and tutorials to get started.

[itamar-marom]

When I'll have a production-grade Druid cluster up and running I will also add mine as an example

[Jmoore1127]

Thanks all. I understand how large an undertaking good documentation and examples really is. It is much appreciated.

[itamar-marom]

Hi @Jmoore1127
I opened an issue that we'll try to take soon: #80
Also, I'm starting to add more code examples:

• secure metadata storage example #78
• install hadoop dependencies on init example #79

If you've got any specific question/use-case you're missing please ping us in the druid-operator channel / add context to the issue I opened.

[pbailey-ipsos]

@Jmoore1127 i totally understand your concern. We have basic documentation to get started. We also have a druid operator slack community to get started. There is a video session on druid on k8s which can help you get started.

@AdheipSingh in your video at 38:22, you mention that you are using Druid Operator to manage multiple Druid Clusters. Can you post your Druid CR Spec YAML for others to reference?