[Internal] Query: Adds support for continuation using SqlQuerySpec

[balaperu]

Pull Request Template

Description

Currently, supporting continuation for cross partition order by requires us to re-write the queries filter to resume from the last returned order by value. This approach of re-writing filters is very cumbersome for multi-item order by and this approach doesn't work when the continuation value is an array or object.

The new approach is to send the resume value as part of SqlQuerySpec to backend which uses it to resume the query. The backend changes have already been checked in and is currently being deployed.

Current OrderByContinuationToken:

{ 
   "compositeToken":{
           "token":"+RID:OpY0AN-mFAACAAAAAAAABA==#RT:1#TRC:1#RTD:qdTAEA==",
            "range":{"min":"05C1D9CD673398","max":"05C1E399CD6732"}
   },
   "orderByItems"[{"item":2}],
   "rid":"OpY0AN-mFAACAAAAAAAABA==",
   "skipCount":1,
   "filter":"r.key > 1"
}

New Token:
Contains resumeValues instead of orderByItems.

{
   "compositeToken":{
           "token":"+RID:OpY0AN-mFAACAAAAAAAABA==#RT:1#TRC:1#RTD:qdTAEA==",
            "range":{"min":"05C1D9CD673398","max":"05C1E399CD6732"}
   },
   "resumeValues":[2],
   "rid":"OpY0AN-mFAACAAAAAAAABA==",
   "skipCount":1,
}

Undefined values are represented by an empty array "[]"

Array and Object are represented in resume value by their hash value

{
    "type":  <"array" / "object">
    "low": <UINT128.Low>
    "high": <UINT128.High>
}

Old continuation tokens with orderByItems will be converted to SqlQuerySpec ResumeValue during pipeline create stage.

ResumeValue doesn't support C* types so the old continuation token format will be used for these types.

Type of change

• [] New feature (non-breaking change which adds functionality)

Closing issues

#3639

[github-actions]

All good!

[sboshra]

[neildsh]

[sboshra]