[pull] main from ydb-platform:main #28
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
commit_hash:12d86de033f73ea238ebde7f47b689d30014119a
Motivation: Network is limited, we need to reduce amount of transfers between nodes. One of problem: Session actor has no knowledge about key range distribution (data shard locations). Which means we have to transfer data between data shard and kqp executor to perform read or write. Workaround: Provide estimation about keyRange -> nodeId distribution to use session (which means executor and other kqp components) created on the same node where located corresponding data shard.
Co-authored-by: Pavel Ivanov <[email protected]>
- yt/client: include async_stream.h in file_reader.h NApi::IFileReader needs NConcurrency::IAsyncZeroCopyInputStream. - Declare yt/yt/client/api/rpc_proxy/protocol_version_variables.h using CONFIGURE_FILE Otherwise resulting file does not materialize after: ya make --build-all --force-build-depends --replace-result --add-result=.h yt/yt/client/ Proper source file generation is required at least for making clangd happy. --- Pull Request resolved: ytsaurus/ytsaurus#894 commit_hash:b27f7963bc113543c0ac3842f78636be4f33416f
Co-authored-by: Dmitriy Orlov <[email protected]>
…10935) Motivation: Network is limited, we need to reduce amount of transfers between nodes. One of problem: Session actor has no knowledge about key range distribution (data shard locations). Which means we have to transfer data between data shard and kqp executor to perform read or write. The solution: Provide estimation about keyRange -> nodeId distribution to use session (which means executor and other kqp components) created on the same node where located corresponding data shard. This commit contains server side code, and basic c++ sdk functions to perform describe.
Co-authored-by: Ilnaz Nizametdinov <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )