Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dolt 1.41.2 #176255

Merged
merged 2 commits into from
Jul 3, 2024
Merged

dolt 1.41.2 #176255

merged 2 commits into from
Jul 3, 2024

Conversation

BrewTestBot
Copy link
Member

Created by brew bump


Created with brew bump-formula-pr.

release notes
# Merged PRs

dolt

  • 8093: go/libraries/doltcore/remotestorage: internal/reliable: Recv: Fix a race where a completed state machine run and a canceled parent context could return a nil response message with a nil error.
  • 8090: dolt sql shell slash redux
  • 8087: Bug fix: Use correct log position in Dolt to MySQL replication heartbeats
    Ensure heartbeat events sent from a Dolt primary to a MySQL replica have the latest nextLogPosition populated, otherwise the MySQL replica will close the binlog event stream.
  • 8086: define schema for dolt_schemas table
    add pg_views table to pg_catalog and views displayed on \d psql cmd dolthub/doltgresql#454 depends on this PR.
  • 8082: /docker/{docker-entrypoint.sh,serverDockerfile}: change image to pass all args to dolt sql-server command
    This PR fixes dolthub/dolt-sql-server image doesnt work correctly when regular dolt commands are supplied to it as arguments dolthub/dolt#8079. Now when running dolthub/dolt-sql-server if the args dolt sql-server are passed to the image, it will error. This will also prevent accidentally starting two Dolt servers in the container.
  • 8081: Fixed keyless secondary indexing for Doltgres
    • Companion PR: Fixed secondary indexing dolthub/doltgresql#452
      This PR fixes two issues with creating secondary indexes for Doltgres types. The first deals with handlers, as we were not adding a nil handler for the additional hash type, which would cause a panic as the counts were not equal (all non-Extended types should have a matching nil handler).
      The second issue was due to the reuse of an ExtendedTupleComparator. When creating a new ExtendedTupleComparator, we pass in the previous TupleTypeHandler to handle all non-Extended types. If the previous TupleTypeHandler was ExtendedTupleComparator and the new one was also ExtendedTupleComparator, then we could end up with a misinterpretation of data that could lead to incorrect results, as the handler assumed a different type than the actual type. This has been changed so that ExtendedTupleComparator will always use the inner comparator of a previous ExtendedTupleComparator. For now this will always be the default comparator, but if we ever add another one, then this should properly handle that change.
  • 8080: Re-enable doltgres sysbench scripts
  • 8078: Archive index rework to make loading faster
    The initial impl of archive indexes over optimized for space. This resulted in being 10x slower to load the index of archives than noms table files. To address this:
    • Dropped the end to end compression of the index
    • Dropped the use of var ints for offset deltas and chunk refs
    • Altered the use of byte span offsets, and instead used a end-offset approach which requires no delta processing on load.
    • Used only slices of primitive types in the index memory. Constant time read path with a little more complexity, but allows us to read directly off disk into memory.
      Testing indicates that on a 41 Gb archive file, this returned load performance to match classic table files, and the size of the index increased by about 350Mb (total ~ 1Gb)
  • 8077: /go/libraries/doltcore/remotestorage/chunk_fetcher.go: fix nil pointer
    We observe dolthubapi can crash with the following nil pointer error:
    panic: runtime error: invalid memory address or nil pointer dereference
    [signal SIGSEGV: segmentation violation code=0x1 addr=0x48 pc=0x29e14d1]
    goroutine 399548427 [running]:
    github.com/dolthub/dolt/go/libraries/doltcore/remotestorage.fetcherRPCDownloadLocsThread.func3()
    external/com_github_dolthub_dolt_go/libraries/doltcore/remotestorage/chunk_fetcher.go:266 +0xf1
    golang.org/x/sync/errgroup.(*Group).Go.func1()
    external/org_golang_x_sync/errgroup/errgroup.go:78 +0x56
    created by golang.org/x/sync/errgroup.(*Group).Go in goroutine 399548420
    external/org_golang_x_sync/errgroup/errgroup.go:75 +0x96
    
    This pr aims to prevent this.
  • 8076: Bump golang.org/x/image from 0.10.0 to 0.18.0 in /go
    Bumps golang.org/x/image from 0.10.0 to 0.18.0.
    Commits
    • 3bbf4a6 tiff: Validate palette indices when parsing palette-color images
    • 6c5fa46 go.mod: update golang.org/x dependencies
    • 55c4ab6 go.mod: update golang.org/x dependencies
    • 0057a93 tiff: fix function name in comment
    • 9e190ae webp: disallow multiple VP8X chunks
    • 445ab0e go.mod: update golang.org/x dependencies
    • 240a51a font/sfnt: support early version 0 OS/2 tables
    • c20bbc3 draw: simplify some calls to fmt.Fprintf
    • 491771c draw: merge draw_go117.go into draw.go
    • 4aa0222 go.mod: update go directive to 1.18
    • Additional commits viewable in compare view

    [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=golang.org/x/image&package-manager=go_modules&previous-version=0.10.0&new-version=0.18.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) ---
    Dependabot commands and options
    You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/dolthub/dolt/network/alerts).
  • 8073: Added schema to index creation
    In Doltgres, whenever we would create an index, we would use the empty schema as the destination (the default value for the schema name). This meant that the updated table with an index was saved into the empty schema, which is incorrect since Doltgres always has a schema. This adds the schema to index creation, along with several other locations that it should be in.

go-mysql-server

  • 2583: [stats] Disable histogram bucket merging for now because it mutated shared memory
    Merging buckets in the current format is unsafe:
    • we collect statistics for an index where two buckets have overlapping values
    • we execute a join using the index with overlapping values, and use a merge algorithm to combine those buckets. The merged bucket is synthetic, but the statistics used for the join is also synthetic, so this all works as expected.
    • a future indexscan selects the compressed range from before, accessing one of the synthetic buckets created by the join
    • we error invalid bucket type: *stats.Bucket at the end of the indexscan when adding the filtered histogram with a synthetic back to the implementor-type statistic
      Edited mergeOverlappingBuckets to not share memory, but also I'm not sure if merging buckets is a common performance win in most cases, so disabling for now
  • 2581: [stats] populate types for nil zeroing
  • 2577: calling JSON_EXTRACT and JSON_VALUE with a path that has an out-of-bounds array access should return SQL NULL, not an error.
    The jsonpath module returns an error when performing a lookup with an out-of-bounds array index. We need to capture that error and return nil for the lookup operation instead.
  • 2576: fix type and precision for unix_timestamp
    builds off of: fix: add checking precision to decide sql types & handling limit unix timestamp date dolthub/go-mysql-server#2573
  • 2572: fix for table_catalog for information_schema.tables

vitess

  • 355: New functions to create PreviousGtids events, and to update event checksum

Closed Issues

  • 8079: dolthub/dolt-sql-server image doesnt work correctly when regular dolt commands are supplied to it as arguments
  • 8054: Checked out a branch but data is still obtained from the main branch
  • 8051: Flyway and dolt: missing performance_schema
  • 8052: select from a subquery with information_schema: command denied to user 'restadmin'@'%'

@github-actions github-actions bot added go Go use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Jul 3, 2024
Copy link
Contributor

github-actions bot commented Jul 3, 2024

🤖 An automated task has requested bottles to be published to this PR.

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Jul 3, 2024
@BrewTestBot BrewTestBot added this pull request to the merge queue Jul 3, 2024
Merged via the queue into master with commit 4260ccb Jul 3, 2024
14 checks passed
@BrewTestBot BrewTestBot deleted the bump-dolt-1.41.2 branch July 3, 2024 04:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. go Go use is a significant feature of the PR or issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants