* support trailing generic query responses (#1441)

* improving potential bottleneck in grpc layer of the query service (#1278)

Set mkql runtime version, fix tests. (KIKIMR-19847)

* Initial commit

* Fixes

Co-authored-by: Nikolay Shumkov <[email protected]>

* Fix scrubbing and flapping unittest (#1640)

* Fix leaking blobs via using patching (#1639)

---------

Co-authored-by: kruall <[email protected]>

* Yql 17542 simplify alloc in compute actor (#1452)

* YQL-17542 Simplify allocator usage in ComputeActors

* fix build

* fix dup

* YQL-17542 move SaveState LoadState (#1474)

* YQL-17703 always use sized allocator in CA (#1522)

* YQL-17542 split FillIoMaps (#1537)

* YQL-17755 fix drying input up (#1604)

* YQL-17542 split stat (#1553)

* YQL-17542 remove transition guards (#1610)

* YQL-17542 get rid of std::any in handling sources state (#1635)

* YQL-17755 ut for TComputeActorAsyncInputHelperTest::PollAsyncInput (#1626)

* YQL-17542 move TaskRunner dependent Execute to TDqSyncComputeActorBase (#1599)

* YQL-17542 move TaskRunner dependent Execute to TDqSyncComputeActorBase (#1666)

Co-authored-by: Tony-Romanov <[email protected]>

#1837)

#1835)

)

Co-authored-by: Iuliia Sidorina <[email protected]>

…ervice queries (#1603) (#1815)

)

Co-authored-by: nsofya <[email protected]>

)

Co-authored-by: Nikolay Shumkov <[email protected]>

…start race (#2169)

Co-authored-by: nsofya <[email protected]>
Co-authored-by: nsofya <[email protected]>

… - merge 24-1 (#2318)

Cherry-pick 3819aed from main (#2083).

Make schemeboard replicas consume less CPU, especially when processing rapid updates for tables with huge amount of partitions.

Schema information on a path exist in the form of `DescribeSchemeResult` object: schemeshard generates those objects and publishes them to the schemeboard, schemeboard notifies scheme-caches on the nodes about path info changes. So schemeshard generates `DescribeSchemeResult`, scheme-cache serves `DescribeSchemeResult` to the consumers. But schemeboard components in-between do not require the full content of a TEvDescribeSchemeResult to operate efficiently.

This update enables the schemeboard to transmit `DescribeSchemeResult` through as an opaque payload rather than as a fully detailed protobuf object. Thus reducing the unnecessary memory management and serialization/deserialization overhead.

#2479)

KIKIMR-21002

In this PR we add the following algorithm for invalidating cache entries for outdated VIEWs:

1. Store path ids and schema versions of the views that were used in the query in the cache entries, so they can be accessed later.
2. Whenever we retrieve a compilation result from cache, send a request for SchemeCache to check if the schema version of the views used in this query (if any) has not changed since we compiled this query.
3. Send a recompilation request if any view is outdated.

There are two important things to note about this solution:

- We make a SchemeCache request for each repeated query and there is a lot of these in an OLTP-focused database like YDB. However, we have already been sending these request for preliminary (this is not the last check of schema version mismatch (at least for tables)) cache invalidation for tables, so views should not incur an additional performance impact here.
- This solution does not guarantee strong consistency for queries using views, because query cache invalidation will not happen instantly after the view definition is updated. The node should get an update from the SchemeCache, which takes some time.

#2540)

…2574)

Co-authored-by: Andrey Neporada <[email protected]>

…lib (#2633)

…ment (#2049) (#2595)

Based on: #2049

KIKIMR-20891

CREATE VIEW statement parses (and validates) the select statement saved in the view. It should be parsed in a context isolated from the statements executed before the CREATE VIEW statement (we haven't decided yet on the exact scope of the context of the view's select statement, see [KIKIMR-20656](https://st.yandex-team.ru/KIKIMR-20656)). It is pretty obvious that one should be able to execute the following statement in one go ("one go" = one press of a "run" button in YDB UI):
```sql
-- create view NecessaryInnerView with (security_invoker = true) as select 1;
-- create view ContextTestingView with (security_invoker = true) as select * from `/local/NecessaryInnerView`; -- where `/local/...` is your cluster name

drop view ContextTestingView;
create view ContextTestingView with (security_invoker = true) as select * from `/local/NecessaryInnerView`;
```

However, executing both drop view and create view in one go currently produces and error:
```
DropObject is not yet implemented for intent determination transformer
```
which indicates that the context of the inner query:
```sql
select * from `/local/NecessaryInnerView`
```
is polluted by the previous:
```sql
drop view ContextTestingView;
```
statement.

This problem is fixed by using an empty parsing context for parsing view's inner select statement during handling of CREATE VIEW statement.

…2790)

…2765. (#2839)

Co-authored-by: Daniil Cherednik <[email protected]>
Co-authored-by: spuchin <[email protected]>

…3154. (#3165)