Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade common-streams to 0.8.0-M4 #383

Merged
merged 3 commits into from
Sep 16, 2024
Merged

Upgrade common-streams to 0.8.0-M4 #383

merged 3 commits into from
Sep 16, 2024

Conversation

oguzhanunlu
Copy link
Contributor

@oguzhanunlu oguzhanunlu commented Sep 16, 2024

Compared to M2, common-streams 0.8.0-M4 brings the following changes:

  • schema-ddl 0.25.0-M1
    • This upgrade brings a bug fix: fields starting with a digit wouldn't work properly with bq loader v2. With this release, fields are prefixed with an underscore _ if they start with a digit.
  • iglu scala client 3.2.0
  • brand-new kinesis source implementation without fs2-kinesis
  • parallel schema resolution
  • a new http client suitable for our streaming apps

The new http client has a single configuration field maxConnectionsPerServer that should be configurable in bq loader, hence we introduce a new top-level config, http containing maxConnectionsPerServer only for the moment.

@oguzhanunlu oguzhanunlu self-assigned this Sep 16, 2024
@oguzhanunlu oguzhanunlu force-pushed the cs-0.8.0-M4 branch 3 times, most recently from 1ec1e0b to 263a31c Compare September 16, 2024 13:00
Copy link
Contributor

@istreeter istreeter left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Neither your commit nor your PR has a description. Even though you are just bumping a library, this is a very important library change that directly affects the behaviour of the loader. See #381 or #371 for examples of where common-streams was bumped to a newer version, and the PR has a nice description to explain the impact of the change.

@oguzhanunlu
Copy link
Contributor Author

@istreeter , I just added a detailed PR description and pushed a new commit to address your comments, could you have another look please?

@oguzhanunlu oguzhanunlu merged commit 5d5d7f5 into v2 Sep 16, 2024
2 checks passed
@oguzhanunlu oguzhanunlu deleted the cs-0.8.0-M4 branch September 16, 2024 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants