Skip to content

Presentation initially about GetThru's concurrent, multi-stage data processing pipeline written in Elixir.

Notifications You must be signed in to change notification settings

CuriousCurmudgeon/messaging_with_limits_talk

Repository files navigation

Messaging With Limits: Concurrent, Multi-Stage Data Processing in the Real World

Our team at GetThru found ourselves with a scaling problem. Working with our existing infrastructure for sending text messages was becoming increasingly complex. Years of bewildering external requirements had led us to the point where the existing system was both incorrect and difficult to reason about. In this session, we'll go over a case study of our new concurrent, multi-stage data processing pipeline. Starting from the fundamentals, we'll see how our team efficiently handled our existing external requirements and built in flexibility for the future. Finally, we'll look at how we did all of this in our existing monolith, avoiding the complexity of microservices.

Presentation History

Stir Trek 2024 (2024-05-03)

Site: https://stirtrek.com/speakers/2024/Brian-Meeker.html
Recording: https://youtu.be/S82oyR4fzsc?si=lWHS9oc8oWYDyRxK

Watch the video

ElixirConf US 2024 (2024-08-29)

Site: https://2024.elixirconf.com/schedule/messaging-with-limits-concurrent-multi-stage-data-processing-in-the-real-world
Recording: Coming soon

About

Presentation initially about GetThru's concurrent, multi-stage data processing pipeline written in Elixir.

Resources

Stars

Watchers

Forks

Packages

No packages published