Co-authored-by: Rebecca Szper <[email protected]>

This reverts commit 45cae03.

* Standardize workflow files

* Fix job names

* Resolve comments

* Fix removing m2/setting.xml

…e#27679)

…teNotNull to IllegalStateException

Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.37.1 to 1.38.0.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](aws/aws-sdk-go-v2@service/s3/v1.37.1...service/s3/v1.38.0)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…apache#27769)

Bumps [github.com/fsouza/fake-gcs-server](https://github.com/fsouza/fake-gcs-server) from 1.46.0 to 1.47.0.
- [Release notes](https://github.com/fsouza/fake-gcs-server/releases)
- [Commits](fsouza/fake-gcs-server@v1.46.0...v1.47.0)

---
updated-dependencies:
- dependency-name: github.com/fsouza/fake-gcs-server
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* [apache#23043] Re-enable single iteration for the Go SDK.

* more debuging

* don't drop plan

* debug text.

* Fix beam23043

* clean up debugging.

* update unit test.

* go fmt

---------

Co-authored-by: lostluck <[email protected]>

* Inline external action

* Temporarily run on non-self-hosted

* Add sha

* Update beam_PreCommit_Website_Stage_GCS.yml

* Update beam_PreCommit_Website_Stage_GCS.yml

* Update beam_PreCommit_Website_Stage_GCS.yml

* Update beam_PreCommit_Website_Stage_GCS.yml

* Update beam_PreCommit_Website_Stage_GCS.yml

* Go back to self hosted runners

* Attribution

* Reflecting test result that portable runner support missing

…27779)

* Authenticate to docker before pushing images

* Allow manually triggering builds

* Auth to gcr

…ntainers.

…#27770)

Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.11.74 to 1.11.75.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](aws/aws-sdk-go-v2@feature/s3/manager/v1.11.74...feature/s3/manager/v1.11.75)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…he#27789

Co-authored-by: Valentyn Tymofieiev <[email protected]>

…7723)

…on for idempotent initialization of file systems

Bumps [github.com/aws/aws-sdk-go-v2/service/s3](https://github.com/aws/aws-sdk-go-v2) from 1.38.0 to 1.38.1.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](aws/aws-sdk-go-v2@service/s3/v1.38.0...service/s3/v1.38.1)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/service/s3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…apache#27794)

Bumps [github.com/fsouza/fake-gcs-server](https://github.com/fsouza/fake-gcs-server) from 1.47.0 to 1.47.2.
- [Release notes](https://github.com/fsouza/fake-gcs-server/releases)
- [Commits](fsouza/fake-gcs-server@v1.47.0...v1.47.2)

---
updated-dependencies:
- dependency-name: github.com/fsouza/fake-gcs-server
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Log dataflow messages at appropriate levels

* Use single-cast message importance for error case

* Add catch-all

…#27796)

Bumps [github.com/aws/aws-sdk-go-v2/feature/s3/manager](https://github.com/aws/aws-sdk-go-v2) from 1.11.75 to 1.11.76.
- [Release notes](https://github.com/aws/aws-sdk-go-v2/releases)
- [Changelog](https://github.com/aws/aws-sdk-go-v2/blob/main/CHANGELOG.md)
- [Commits](aws/aws-sdk-go-v2@feature/s3/manager/v1.11.75...feature/s3/manager/v1.11.76)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go-v2/feature/s3/manager
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Co-authored-by: lostluck <[email protected]>

* [prism] Make Prism the default Go SDK runner.

* ws lint

* add maincall to ptest test.

* update comments on prism test filters.

* Update playground script to use go1.20

* fix typo

---------

Co-authored-by: lostluck <[email protected]>

* automodel first pass

* new model

* updated model handler api

* add model_class param

* update doc comments

* updated integration test and example

* unit test, modified params

* add test setup for hugging face tests

* fix lints

* fix import order

* refactor, doc, lints

* refactor, doc comments

* change test file

* update types

* add hugging face pipeline support

* integration test for pipeline

* add doc, gs link

* test raises exception

* fix python lints

* add inference fn

* update doc

* docs, lint

* docs, lint

* remove optional from inference_fn

* add enum for tasks

* update pydoc

* update pydoc

* doc, formatting changes

* fix doc

* fix optional in doc

* pin model version

…nder pushed by GH tests every 6 weeks. (apache#27807)

…he#27815)

* Use correct concurrency condition to avoid incorrect interrupts

* Another one

…flow ARM (apache#27810)

…GES.md (apache#27816)

* mention prism in changes.md

* ws lint

* review comments

---------

Co-authored-by: lostluck <[email protected]>

Removing myself from the IO reviewer list as I don't have much context on IO changes. With the recent reorg, I would have even less opportunity to explore this side :(

Previously these were implicitly lifted from the base dictionary.
We may want to consider allowing that again, but it is easier to loosen
restrictions than tighten them up once this is declared stable.

* Add a new gradle file.

* Removed all legacy worker related tasks in build.gradle, adjust tasks for multiarch containers

* Created new files for Java Dataflow ARM tests, still need to figure out Java version and Java home issues.

* Remove unused code in build.gradle.

* remove unused target, add build multiarch Java container flags, adjust build.gradle file.

* Add the TAG as env variable shared by diff Java version tests.

* Adjust dependencies.

* Change READNE for Java versions and yml file for auth.

* Made changes based on PR comments.

* Made changes based on comments, standardize yml file.

* Change github_job.

* Update .github/workflows/beam_PostCommit_Java_Examples_Dataflow_ARM.yml

Co-authored-by: Danny McCormick <[email protected]>

* Update .github/workflows/beam_PostCommit_Java_Examples_Dataflow_ARM.yml

Co-authored-by: Danny McCormick <[email protected]>

* remove redundant underscore

---------

Co-authored-by: Danny McCormick <[email protected]>

…che#27777)

…e (Cron, Commit, Phrase) (apache#27482)

* GoPortable PreCommit

* GoPortable PreCommit

* GoPortable PreCommit

* beam_PreCommit_GoPortable

* fix readme and run

* timeout-minutes

* step name added

* new fix cron and worflow dispatch

…ed schemas

…amples (apache#27350)

…ache#27619)

…he#27826)

Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.12.0 to 1.12.1.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases)
- [Commits](mongodb/mongo-go-driver@v1.12.0...v1.12.1)

---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Upgrade Kryo coder from Kryo v4 to Kryo v5

* Update CHANGES.md

… in an explicit 'config' parameter.

…rtifacts containing guava (apache#27766)

…Python (apache#27425)

* Add  model manager class to hold many models at once

* Remove extraneous always_proxy addition

* Format/lint

* Use ordereddict + one more tested behavior

* use move_to_end

* Type hints + doc update

Bumps [actions/setup-go](https://github.com/actions/setup-go) from 3 to 4.
- [Release notes](https://github.com/actions/setup-go/releases)
- [Commits](actions/setup-go@v3...v4)

---
updated-dependencies:
- dependency-name: actions/setup-go
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* fix comment trigger against PR branch

* encapsulate checkout logic into the action

* updated setup action and readme file

* updated setup action and readme file

* updated workflow file

… Github Actions (apache#27541)

* added beam_PreCommit_Java_Examples_Dataflow_Java11.yml job

* added beam_PreCommit_Java_Examples_Dataflow_Java11.yml job

* fixed formatting

* added timeout for the beam_PreCommit_Java_Examples_Dataflow_Java11.yml job

* updated the README file

* added additional changes

* merge master into beam_PreCommit_Java_Examples_Dataflow_Java11

Co-authored-by: lostluck <[email protected]>

Bumps [golang.org/x/net](https://github.com/golang/net) from 0.12.0 to 0.13.0.
- [Commits](golang/net@v0.12.0...v0.13.0)

---
updated-dependencies:
- dependency-name: golang.org/x/net
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…ctions (apache#27564)

* added beam_PreCommit_Java_Spark3_Versions.yml job

* added caching for gradle tasks

* fixed formatting

* added timeout for the beam_PreCommit_Java_Spark3_Versions.yml job

* updated the README file

* added additional changes

* updated workflow files

* code clean up

…p transform

…of bytes read)

…move auto delete (apache#27840)

…apache#27844)

Bumps [github.com/fsouza/fake-gcs-server](https://github.com/fsouza/fake-gcs-server) from 1.47.2 to 1.47.3.
- [Release notes](https://github.com/fsouza/fake-gcs-server/releases)
- [Commits](fsouza/fake-gcs-server@v1.47.2...v1.47.3)

---
updated-dependencies:
- dependency-name: github.com/fsouza/fake-gcs-server
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Update settings.gradle.kts to include project `arm`

* Update build.gradle for dependency issue

* Add publish:false

* Move make javaVer accessible.

* Fix typo

* update classPath

* remove auto delete.

* trim white space

…e right section in CHANGES.md

* Setup Java Flink runner PreCommit

* Split Flink 1.13-1.15 tests from main Java PreCommit

* Only run one flink version on main java precommit

* address comments

* set timeout

* address comment

* address comments

* Fix copy-paste

* Disable spotless and checkstyle

…27755)

* Remove reconciled partitions from list of missing partitions

After missing partitions have been reconciled and outputted, remove them
from the list of missing partitions. This prevents a race condition that
leads to multiple reconcile runs consecutively. Added an unit test to
verify this works.

Also increase the wait time before reconciling because typically
reconciler is only needed in pipelines that are slow to process
partitions. Adding extra wait time gives the pipeline time to catch
up.

Change-Id: Ib4a767ab72b20561517eb264924f09f5884cfbc8

* Reset hasAddedMissingPartitions to ensure we add missing partitions again before reconciling

Change-Id: I5341e8891b14ee16098901f112cbe5a2e61021d8

---------

Co-authored-by: Tony Tang <[email protected]>

Co-authored-by: tvalentyn <[email protected]>

* Add logging at error to Bootloader logger

* Use Beam logging package instead of base go

* Revert "Use Beam logging package instead of base go"

This reverts commit 91f9b33.

* Move GCThrashing option to SdkHarnessOptions, and use it on the Fn Harness to allow thrashing tuning

* Remove unused variable

…pache#27855)

…a sampling apache#25065 (apache#27837)

…Iterators.

…he#27861)

…pache#27828)

* Fix broken url for 'Tour of Beam'

* Update examples/notebooks/get-started/learn_beam_basics_by_doing.ipynb

Co-authored-by: Danny McCormick <[email protected]>

* Fix unrelated diff

---------

Co-authored-by: Danny McCormick <[email protected]>

Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.10.0 to 0.11.0.
- [Commits](golang/oauth2@v0.10.0...v0.11.0)

---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

…onal. (apache#27800)

…stency (apache#27865)

…not block on Phaser. (apache#26631)

* Ensure that if grpc stream terminates that DirectStreamObserver does not
block on Phaser.

* address review comments

* Fix action run on base branch

* Fix flink version precommit trailing newline

* Remove redundant checkout action for cron/push/dispatch event

* Fix routing header issue in Firestore Beam connector

* Apply the lint

---------

Co-authored-by: Sichen Liu <[email protected]>