Skip to content

Issues: GoogleCloudDataproc/spark-bigquery-connector

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 511 Closed
27 Open 511 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

"spark.sql.sources.partitionOverwriteMode": "DYNAMIC" - creates additional tables
#1314 opened Nov 15, 2024 by MichalBogoryja
Destination table's schema is not compatible with dataframe's schema. Incompatible max length for field: FIELD_NAME, cannot write source field with max length: null to destination field with max length: 8
#1312 opened Oct 28, 2024 by kumarshekhar
1
GCP Identity federation auth failure with AWS
#1306 opened Oct 16, 2024 by sytianhe
2
Support for spark version 3.5.0 - support required for UNTYPED_SCALA_UDF version
#1297 opened Sep 24, 2024 by VIKCT001
@davidrabinowitz
2
org.apache.spark.sql.AnalysisException: [UNSUPPORTED_DESERIALIZER.DATA_TYPE_MISMATCH] The deserializer is not supported: need a(n) "ARRAY" field but got "MAP<STRING, STRING>".
#1295 opened Sep 20, 2024 by VIKCT001
@isha97
6
BigQuery RANGE (and INTERVAL) support enhancement New feature or request
#1292 opened Sep 12, 2024 by 0rnella
1
Issue with BigQuery counts in Spark after writing to table
#1290 opened Sep 5, 2024 by rchynoweth
@vishalkarve15
3
bigquery.tables.create Permission required on appending data to a BigQuery Table
#1277 opened Aug 6, 2024 by smic-datalabs-jdcastro
@vishalkarve15
4
cloud cost when using spark bq connector
#1274 opened Aug 2, 2024 by kaiseu
@isha97
Empty array filtering issue
#1268 opened Jul 23, 2024 by vokuk-walkme
@vishalkarve15
1
Configuring DataProc Cluster to Publish BigQuery Metrics on GCP enhancement New feature or request
#1233 opened May 24, 2024 by gmiano
1
Add createTable(TableInfo) method to BigQueryClient enhancement New feature or request
#1213 opened Apr 15, 2024 by jphalip
java.lang.NoSuchMethodError: 'org.apache.spark.sql.catalyst.encoders.ExpressionEncoder org.apache.spark.sql.catalyst.encoders.RowEncoder.apply(org.apache.spark.sql.types.StructType)' enhancement New feature or request
#1209 opened Apr 9, 2024 by CatalinMihaiIonescu
6
BigQuery Pushdown filtering on Spark 3.4.2 enhancement New feature or request
#1207 opened Apr 3, 2024 by sid-habu
11
Automatically read JSON types enhancement New feature or request
#1203 opened Mar 25, 2024 by Guilherme-B
Idempotent write support in BQ enhancement New feature or request
#1199 opened Mar 14, 2024 by SubhamSinghal
Table expiration with write() operation enhancement New feature or request
#1189 opened Feb 23, 2024 by mikeperello-scopely
2
Clarification on Billing and Improved README.md Explanation
#1172 opened Jan 17, 2024 by LakshmanKishore
@isha97
1
Support use of bigquery-emulator for integration testing enhancement New feature or request
#1169 opened Jan 16, 2024 by JosefNagelschmidt
4
Support spark 3.5 enhancement New feature or request
#1142 opened Dec 11, 2023 by melin
2
BigQuery Write API cannot use BigQuery CDC feature enhancement New feature or request
#1086 opened Oct 11, 2023 by jster1357
HTTP PROXY Support NTCredentials blocked Waiting for another issue to be fixed
#1071 opened Sep 27, 2023 by dfercode
3
Spark observable metrics not working when writing to BigQuery tables enhancement New feature or request
#1040 opened Aug 9, 2023 by ylashin
3
Is there a way we can run a DML Query (INSERT/MERGE) via BigQuery spark connector? enhancement New feature or request
#575 opened Mar 27, 2022 by spadhi7
8
Support SQL push down including joins enhancement New feature or request
#515 opened Jan 2, 2022 by richard-williamson
1
ProTip! What’s not been updated in a month: updated:<2024-10-15.