Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SNOW-1566363] Add telemetry for new compilation stage #2394

Open
wants to merge 10 commits into
base: main
Choose a base branch
from

Conversation

sfc-gh-yzou
Copy link
Collaborator

@sfc-gh-yzou sfc-gh-yzou commented Oct 3, 2024

  1. Which Jira issue is this PR addressing? Make sure that there is an accompanying issue to your PR.

SNOW-1566363

  1. Fill out the following pre-review checklist:

    • I am adding a new automated test(s) to verify correctness of my new code
      • If this test skips Local Testing mode, I'm requesting review from @snowflakedb/local-testing
    • I am adding new logging messages
    • I am adding a new telemetry message
    • I am adding new credentials
    • I am adding a new dependency
    • If this is a new feature/behavior, I'm adding the Local Testing parity changes.
  2. Please describe how your code solves the related issue.

  3. add status for number of selectStatement with complexity merged
    2.add status for number of cte created during repeated subquery elimination

@sfc-gh-yzou sfc-gh-yzou force-pushed the yzou-SNOW-1566363-compilation-telemetry branch from ebe1e26 to 786b795 Compare October 3, 2024 17:11
@github-actions github-actions bot added the local testing Local Testing issues/PRs label Oct 3, 2024
@sfc-gh-yzou sfc-gh-yzou added the NO-CHANGELOG-UPDATES This pull request does not need to update CHANGELOG.md label Oct 3, 2024
@sfc-gh-yzou sfc-gh-yzou marked this pull request as ready for review October 3, 2024 21:38
@sfc-gh-yzou sfc-gh-yzou requested a review from a team as a code owner October 3, 2024 21:38
Comment on lines 80 to 83
QUERY_PLAN_HEIGHT = "query_plan_height"
QUERY_PLAN_NUM_SELECTS_WITH_COMPLEXITY_MERGED = (
"query_plan_num_selects_with_complexity_merged"
)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we move these to _internal/compiler/telemetry_constants.py?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sfc-gh-aalam do you mean move all QUERY_PLAN_HEIGHT, QUERY_PLAN_NUM_SELECTS_WITH_COMPLEXITY_MERGED, QUERY_PLAN_NUM_DUPLICATE_NODES, QUERY_PLAN_COMPLEXITY all to telemetry_constants.py?
or just QUERY_PLAN_NUM_SELECTS_WITH_COMPLEXITY_MERGED. i felt if we want to move, probably be better to move all of them, instead of just wan , which seems little bit wired

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actually, let's move all those over, even though those telemetry are not just issued during the compilation stage, but the information is used by the compilation stage,

@sfc-gh-yzou sfc-gh-yzou force-pushed the yzou-SNOW-1566363-compilation-telemetry branch from 1818bfc to f1d4b34 Compare October 4, 2024 23:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
local testing Local Testing issues/PRs NO-CHANGELOG-UPDATES This pull request does not need to update CHANGELOG.md
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants