Skip to content
This repository has been archived by the owner on Dec 5, 2022. It is now read-only.

RFC for multi test run finalization #235

Merged

Conversation

jakubch1
Copy link
Member

No description provided.

RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
Copy link
Contributor

@AbhitejJohn AbhitejJohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:shipit:

RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
/// Gets a current processor index.
/// </summary>
[DataMember]
public long CurrentProcessorIndex { get; private set; }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are processors run linearly, even if the processor is associative?
or would it be possible for multiple processors to run simultaneously?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Our code coverage report merger is merging files and removing not needed reports as DevOps is searching for all files with .coverage extension. Because of that we shouldn't run anything in parallel for same uris.

But in case we have two processors which are working on disjoint sets of Uris we can easily use them simultaneously

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just wondering if a single long will suffice, if we'd ever allow to run merges simultaneously, if that's not the case then having a single long is ok

namespace Microsoft.VisualStudio.TestPlatform.ObjectModel.Client
{
[DataContract]
public class MultiTestRunFinalizationProgressEventArgs : EventArgs
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we have a progress for the set of attachments already processed?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Currently we pass IProgress progressReporter to attachment processor. Every time reporter is used we propagate MultiTestRunFinalizationProgressEventArgs. When attachment processor is working we can't say which attachments are already done. We have separated callback to provide already processed attachments

/// Gets or sets whether Metrics should be collected or not.
/// </summary>
[DataMember]
public bool CollectMetrics { get; set; }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be sent on each finalization request?
or perhaps there's a better place where we can configure TP settings?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do not expect sending a lot of finalization requests. Currently tests execution is also sending it in every request.

RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
RFCs/0031-Multi-Test-Run-Finalization.md Outdated Show resolved Hide resolved
Jakub Chocholowicz added 2 commits July 1, 2020 23:43
@jakubch1 jakubch1 merged commit 13b0dd3 into microsoft:master Jul 1, 2020
@jakubch1 jakubch1 deleted the dev/jachocho/1146402_rfc_finalization branch July 1, 2020 21:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants