Evaluate eBPF and how it can be applied (or not)

[JorTurFer]

Proposal

Currently, we are deploying the interceptor instances as containers, which works well, but eBPF could improve the performance working at kernel level instead of at application level.

Using eBPF we should be able to get the metrics about the traffic, so technically we should be able to get all the metrics that we need for scaling but we still have to check if we can "hold" the request during cold starts.

Actually, this issue is just a place to bump thoughts to plan next steps in this direction than a real issue or feature request. We should define the next steps from here.

[isala404]

Hi,
We are using the KEDA HTTP add-on to provide scale-to-zero functionality for our internal platform, and one day, this exact thought popped into my mind. So, I just made a really quick POC using Rust and Aya, and the results were promising.

https://github.com/MrSupiri/scale-to-zero-ebpf

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically closed due to inactivity.

[mmalyska]

It's sad that it got closed without any response. I'm really interested in this with usage of tcp/udp traffic to scale my services to 0 when no customer traffic is detected.

[mmalyska]

@JorTurFer can we reopen this?
@isala404 did you had any success in using this with cilium and keda?

[JorTurFer]

It's sad that it got closed without any response. I'm really interested in this with usage of tcp/udp traffic to scale my services to 0 when no customer traffic is detected.

That's currently possible with the current approach without eBPF

@JorTurFer can we reopen this?

Sure!

[mmalyska]

It's sad that it got closed without any response. I'm really interested in this with usage of tcp/udp traffic to scale my services to 0 when no customer traffic is detected.

That's currently possible with the current approach without eBPF

@JorTurFer can we reopen this?

Sure!

I cannot find anywhere how to scale TCP or UDP workloads with current approach. I can only see HTTP ones using ingress.

[isala404]

@isala404 did you had any success in using this with cilium and keda?

Sorry, I couldn't find time to improve upon my POC. I will try to share some more results in a few weeks.

[JorTurFer]

I cannot find anywhere how to scale TCP or UDP workloads with current approach. I can only see HTTP ones using ingress.

True, I misunderstood the requirement :/ sorry