Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Script converter metrics comparison #1349

Merged
merged 11 commits into from
Oct 13, 2023
Merged

Conversation

t0yv0
Copy link
Member

@t0yv0 t0yv0 commented Aug 31, 2023

I'd like to add this script temporarily to keep it checked in while we're rolling out the new PULUMI_EXPERIMENTAL converter. It will help computing the metrics difference between baseline/experimental, something I can attach to PRs during rollout.

@t0yv0 t0yv0 requested review from guineveresaenger and a team August 31, 2023 19:12
@t0yv0 t0yv0 marked this pull request as ready for review August 31, 2023 19:12
@github-actions
Copy link

Diff for pulumi-azuread with merge commit 5d0172a

Copy link
Member

@iwahbe iwahbe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. Can we add a comment explaining that the script is temporary or put it in unstable/scripts/...?

Tests look like they are failing because of pulumi/ci-mgmt#537 (fixed by #1350).

@t0yv0 t0yv0 changed the title Script converter metrics Script converter metrics comparison Aug 31, 2023
@t0yv0
Copy link
Member Author

t0yv0 commented Aug 31, 2023

#1280 is the context. Yes will do.

@github-actions
Copy link

Diff for pulumi-azuread with merge commit 54e2ecb

@t0yv0 t0yv0 force-pushed the t0yv0/script-converter-metrics branch from 415c4c3 to da7d247 Compare October 4, 2023 14:21
@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-random with merge commit 1110332

@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-azuread with merge commit 1110332

@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-random with merge commit 0fd9570

@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-azuread with merge commit 0fd9570

@codecov-commenter
Copy link

codecov-commenter commented Oct 4, 2023

Codecov Report

Merging #1349 (881633c) into master (e3aabd3) will decrease coverage by 4.04%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1349      +/-   ##
==========================================
- Coverage   61.87%   57.83%   -4.04%     
==========================================
  Files         182      282     +100     
  Lines       32708    39468    +6760     
==========================================
+ Hits        20238    22827    +2589     
- Misses      11332    15307    +3975     
- Partials     1138     1334     +196     

see 103 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

Copy link
Member

@iwahbe iwahbe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like this script needs to be run in the directory of the provider that it is testing. That would be an excellent thing to put in a comment.

return s
}

func tfgen(convert int) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm getting strong C vibes here. Why isn't convert a bool?

var entry flattenedExample
err := dec.Decode(&entry)
if err != nil || entry.ExampleName == "" {
break
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It feels like this should be a continue. Why are we stopping on the first error?
Why don't we report the error?

@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-random with merge commit ea27b23

@github-actions
Copy link

github-actions bot commented Oct 4, 2023

Diff for pulumi-azuread with merge commit ea27b23

@github-actions
Copy link

Diff for pulumi-random with merge commit d1f0feb

@github-actions
Copy link

Diff for pulumi-azuread with merge commit d1f0feb

@github-actions
Copy link

Diff for pulumi-random with merge commit 7872a21

@github-actions
Copy link

Diff for pulumi-azuread with merge commit 7872a21

@t0yv0 t0yv0 merged commit ec290f5 into master Oct 13, 2023
9 checks passed
@t0yv0 t0yv0 deleted the t0yv0/script-converter-metrics branch October 13, 2023 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants