Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade azure-eventhub to the new Event Hub SDK #39796

Merged
merged 41 commits into from
Aug 7, 2024

Commits on Aug 2, 2024

  1. Initial POC import

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    cd799af View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    983fd79 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    b7af8a5 View commit details
    Browse the repository at this point in the history
  4. Update tests

    Switch from the v1 Outlet to the v2 PipelineClient
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    926eb80 View commit details
    Browse the repository at this point in the history
  5. Address linter complaints

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    4a8ddaf View commit details
    Browse the repository at this point in the history
  6. Update NOTICE

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    87525a8 View commit details
    Browse the repository at this point in the history
  7. Remove the eventHubInputV2 POC

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    b79abea View commit details
    Browse the repository at this point in the history
  8. Cleanup

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    3f43d21 View commit details
    Browse the repository at this point in the history
  9. Update x-pack/filebeat/input/azureeventhub/v1_input_test.go

    Co-authored-by: Tiago Queiroz <[email protected]>
    zmoog and belimawr committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    bd410eb View commit details
    Browse the repository at this point in the history
  10. Remove a leftover empty file

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    edd984e View commit details
    Browse the repository at this point in the history
  11. Rename engine to processor

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    023cc36 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    78b7a10 View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    73f35c0 View commit details
    Browse the repository at this point in the history
  14. Retry starting the processor 30s after an error

    I don't wanna use `time.Sleep`, this is just a test.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    00befb0 View commit details
    Browse the repository at this point in the history
  15. Add input metrics to input v2

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    41e104c View commit details
    Browse the repository at this point in the history
  16. Configuration menu
    Copy the full SHA
    1b617ba View commit details
    Browse the repository at this point in the history
  17. Adding acker.LastEventPrivateReporter()

    Trying to listen for the ack of the last event, and store its
    checkpoint information
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2a9e51c View commit details
    Browse the repository at this point in the history
  18. Configuration menu
    Copy the full SHA
    947ec02 View commit details
    Browse the repository at this point in the history
  19. Add processor restarts metric

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    1431e97 View commit details
    Browse the repository at this point in the history
  20. minor: add comments

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2922b5f View commit details
    Browse the repository at this point in the history
  21. Configuration menu
    Copy the full SHA
    ea4b6ba View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    eedded6 View commit details
    Browse the repository at this point in the history
  23. minor: comments

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    a871280 View commit details
    Browse the repository at this point in the history
  24. Add support for partition key in eventhub metadata

    Alongside the partition ID, users can optional send event with a
    partition key.
    
    Add an (optional) partition key to the event hub metadata.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    fedfcf4 View commit details
    Browse the repository at this point in the history
  25. Add migrate_checkpoint config option

    The new migrate_checkpoint config option controls if the input v2
    should perform a migration check on start.
    
    If migrate_checkpoint is true, the input checks and performs the
    migration (if v1 info exists) on the very first v2 run.
    
    If migrate_checkpoint is false, the input will skip the migration
    assistant and will not perform any checks or migration.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c687656 View commit details
    Browse the repository at this point in the history
  26. Make starting position adjustable (+validation)

    Expand processor options by adding a new `start_position`
    configuration.
    
    Possible values for `start_position` are:
    
    - "earliest" to start from the beginning of the event hub retention
      period.
    - "latest" to start from new events.
    
    The input uses the 'start_position' option when checkpoint information
    from the storage account container is unavailable (on the input's
    first start).
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    f58aaaa View commit details
    Browse the repository at this point in the history
  27. Configuration menu
    Copy the full SHA
    d539017 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    d0a37b0 View commit details
    Browse the repository at this point in the history
  29. READNE cleanup

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    0b7fd84 View commit details
    Browse the repository at this point in the history
  30. Add receive_timeout and receive_count to config

    Makes the receive configuration settings available for customization
    on the input settings.
    
    The current default values (receive_timeout: 5s, receive_count: 100)
    are probably fine, but it is better to make these options available
    to users.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2c6044f View commit details
    Browse the repository at this point in the history
  31. Update tests

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    e2f0a43 View commit details
    Browse the repository at this point in the history
  32. Configuration menu
    Copy the full SHA
    769d199 View commit details
    Browse the repository at this point in the history
  33. make update

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    2eaa9ac View commit details
    Browse the repository at this point in the history
  34. Apply suggestions from code review

    Co-authored-by: Andrew Gizas <[email protected]>
    Co-authored-by: subham sarkar <[email protected]>
    3 people committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    cb62264 View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    91c0229 View commit details
    Browse the repository at this point in the history
  36. Add config validation on new options

    Also update the option description as well adding the default value.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    0f33396 View commit details
    Browse the repository at this point in the history
  37. Double-check private data in acknowledged events

    It's better to check the private data in the event has the expected
    type.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    feb52b7 View commit details
    Browse the repository at this point in the history
  38. Add sequence number and offset to checkpoint log

    Adding more details to the message logged on successful store:
    
    - sequence_number
    - offset
    - enqueued_time
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    9361b56 View commit details
    Browse the repository at this point in the history
  39. Add teardown() function on the v2 input

    The teardown() function is responsible to release all the resources
    allocated in the setup() function.
    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    53925c0 View commit details
    Browse the repository at this point in the history
  40. Update NOTICE.txt

    zmoog committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    03f0625 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Configuration menu
    Copy the full SHA
    fa5f346 View commit details
    Browse the repository at this point in the history