Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for multiple subprojects #16

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

v6ak
Copy link

@v6ak v6ak commented Oct 21, 2023

Adds support for multiple subproject with just single application of the plugin and with just one SBT call. This prevents issues with parallel SBT calls.

Note that function testBothModes can be used for further test simplification.

@v6ak v6ak mentioned this pull request Oct 21, 2023
@v6ak
Copy link
Author

v6ak commented Oct 21, 2023

The failure on Windows is likely related to argument quoting/escaping. Maybe I should get a Windows VM and debug it there.

Copy link
Member

@sjrd sjrd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR. This should be good to have, indeed.

I have some comments, but I'm mostly concerned about the comment in printSbtTasks.

f: (mode: string, suffix: string) => Promise<void>,
testOptions: TestOptions,
) {
testFunction ||= it
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This like does not seem necessary.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed.

index.ts Outdated
function extractSubprojects(options: ScalaJSPluginOptions): Array<Subproject> {
if (options.subprojects) {
if (options.projectID || options.uriPrefix) {
throw new Error("If you specify subprojects, you cannot specify projectID / uriPrefix")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Coding style: we use semicolons in this codebase:

Suggested change
throw new Error("If you specify subprojects, you cannot specify projectID / uriPrefix")
throw new Error("If you specify subprojects, you cannot specify projectID / uriPrefix");

This comment applies everywhere.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added.

@@ -28,24 +28,68 @@ function printSbtTask(task: string, cwd?: string): Promise<string> {
if (code !== 0)
reject(new Error(`sbt invocation for Scala.js compilation failed with exit code ${code}.`));
else
resolve(fullOutput.trimEnd().split('\n').at(-1)!);
resolve(fullOutput.trimEnd().split('\n').slice(-tasks.length));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you quite sure this always works? Can't we get info lines between the two print results?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we can. I am not sure what to do there, though. We could filter lines starting with [info] (and warning etc.) and assume that this is not the actual path. (Technically, many weird characters might occur there, IIRC Linux allows everything but '\0' and '/' in a file name. I am sure newlines would probably break it, too, so it depends how much we want to be perfectionists…)

Other alternative would be calling SBT twice, but this would increate startup time, as starting two SBT instances in parallel sometimes fails. This still wouldn't resolve the issue with newlines, so maybe filtering [info] and similar prefixes would be a better way.

index.ts Outdated
Comment on lines 88 to 89
const spByProjectID = mapBy(subprojects, (p) => p.projectID, "projectID")
const spByUriPrefix = mapBy(subprojects, (p) => p.uriPrefix, "uriPrefix")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These variables are unused. So instead of a mapBy, consider simplifying to only check duplicates in an array:

function checkNoDuplicates<T>(a: Array<T>, itemName: string): void

then call it as

Suggested change
const spByProjectID = mapBy(subprojects, (p) => p.projectID, "projectID")
const spByUriPrefix = mapBy(subprojects, (p) => p.uriPrefix, "uriPrefix")
checkNoDuplicates(subprojects.map((p) => p.projectID), "projectID");
checkNoDuplicates(subprojects.map((p) => p.uriPrefix), "uriPrefix");

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am a bit undecided there. Sure, this can be the way. OTOH, I suspect those variables might be needed soon.

const MODES = [["production", MODE_PRODUCTION, "opt"], ["development", MODE_DEVELOPMENT, "fastopt"]]
MODES.forEach( ([modeName, mode, suffix]) => {
testFunction(
description + "(" + modeName + ")",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit:

Suggested change
description + "(" + modeName + ")",
description + " (" + modeName + ")",

will probably display better.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added.

Comment on lines 144 to 145
expect(await plugin.resolveId.call(fakePluginContext, 'scalajs/main.js'))
.toBeNull();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
expect(await plugin.resolveId.call(fakePluginContext, 'scalajs/main.js'))
.toBeNull();
expect(await plugin.resolveId.call(fakePluginContext, 'scalajs:main.js'))
.toBeNull();

would make more sense, wouldn't it?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Correct. BTW, the scalajs/main.js is copied from other tests. Maybe we should fix it in the other places, although it is out of scope of this PR.

});
});

it.fails("when both projectID and subproojects are specified", async () => {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
it.fails("when both projectID and subproojects are specified", async () => {
it.fails("when both projectID and subprojects are specified", async () => {

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

});
});

it.fails("when both uriPrefix and subproojects are specified", async () => {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
it.fails("when both uriPrefix and subproojects are specified", async () => {
it.fails("when both uriPrefix and subprojects are specified", async () => {

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

it.fails("when both uriPrefix and subproojects are specified", async () => {
setup({
uriPrefix: "xxx",
subprojects: []
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is subprojects: [] something that should be supported at all? Probably not.

Copy link
Author

@v6ak v6ak Oct 25, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, it is a kind of an edge case.

  • Theoretically, one might use it dynamically and no subprojects would equal to disabled plugin.
  • Practically, such use case is unlikely to be common.
  • It also might require the plugin to handle those edge cases. (Well, I am not sure if printSbtTasks handles empty list well…)

So, I'll disable this edge case.

EDIT: disabled

Comment on lines 190 to 193
});


it("does not work with a project that does not link", async () => {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Double blank line:

Suggested change
});
it("does not work with a project that does not link", async () => {
});
it("does not work with a project that does not link", async () => {

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants