Skip to content

Commit

Permalink
Merge branch 'master' into add-nf-wave-topics-to-docs
Browse files Browse the repository at this point in the history
  • Loading branch information
munishchouhan authored Jul 12, 2024
2 parents 5c68c47 + 0f17ca8 commit 2f0ce9d
Show file tree
Hide file tree
Showing 140 changed files with 2,611 additions and 816 deletions.
2 changes: 2 additions & 0 deletions .codespellignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
carrer
ser
26 changes: 26 additions & 0 deletions .github/workflows/codespell.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
---
name: Codespell

on:
push:
branches: [master]
pull_request:
branches: [master]

permissions:
contents: read

jobs:
codespell:
name: Check for spelling errors
runs-on: ubuntu-latest

steps:
- name: Checkout
uses: actions/checkout@v4
- name: Codespell
uses: codespell-project/actions-codespell@v2
with:
only_warn: 1
ignore_words_file: .codespellignore
exclude_file: src/main/resources/application-reserved-words.yml
40 changes: 40 additions & 0 deletions .github/workflows/typespec.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,40 @@
---
name: Typespec_Validation

on:
push:
branches:
- '**'
paths :
- 'typespec/**'
pull_request:
types: [opened, reopened, synchronize]
paths:
- 'typespec/**'

permissions:
contents: read

jobs:
typespec_validation:
name: validate typespec files
runs-on: ubuntu-latest

steps:
- name : Checkout
uses : actions/checkout@v4

- name : Setup Node.js environment
uses : actions/setup-node@v4
with :
node-version : '20.9.0'

- name : Install tsp
run : npm install -g @typespec/compiler

- name : Validate tsp files
run : |
cd typespec
tsp install
tsp compile .
5 changes: 5 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -32,3 +32,8 @@ scan-workspace/
.cache
site/
deployment-url.txt

#typespec
tsp-output/
node_modules/
package-lock.json
13 changes: 12 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ images.
* Augment container images i.e. dynamically add one or more container layers to existing images;
* Build container images on-demand for a given container file (aka Dockerfile);
* Build container images on-demand based on one or more Conda packages;
* Build container images on-demand based on one or more Spack packages;
* Build container images on-demand based on one or more Spack packages, Spack support will be removed in future releases;
* Build container images for a specified target platform (currently linux/amd64 and linux/arm64);
* Push and cache built containers to a user-provided container repository;
* Build Singularity native containers both using a Singularity spec file, Conda package(s) and Spack package(s);
Expand Down Expand Up @@ -108,6 +108,17 @@ container registry where the image is stored, while the instrumented layers are
'-Djdk.httpclient.HttpClient.log=requests,headers'
```

## TypeSpec API Specifications

- You can find the API specifications using (typespec)[https://github.com/microsoft/typespec] in typespec directory. Use following command to generate the API specifications.

```bash
'cd typespec'
'tsp install'
'tsp compile .'
```

- Check `typespec/tsp-output` directory for the generated API specifications.

## Related links
* [Wave command line tool](https://github.com/seqeralabs/wave-cli)
Expand Down
3 changes: 1 addition & 2 deletions VERSION
Original file line number Diff line number Diff line change
@@ -1,2 +1 @@
1.7.9

1.9.0
59 changes: 51 additions & 8 deletions changelog.txt
Original file line number Diff line number Diff line change
@@ -1,7 +1,50 @@
# Wave changelog
1.9.0 - 11 Jul 2024
- Add Typespec API definitions (#537) [32f7dd16]
- Add cache record-stats (#534) [229926e2]
- Add http 429 error to auth service retry condition [8282a492]
- Check and delete corrupted blobs cache uploads (#533) [b0c775a3]
- Deprecate the support for Spack and remove the support for it in the codebase (#550) [85a05196]
- Enable ECR authentication via AWS compute env credentials (#303) [ec895222]
- Fix Blob cache config for local dev [0d5413bf]
- Fix client cache deadlock (#547) [cc6012ff]
- Fix multiple s3clients in wave (#554) [45689500]
- Minor change in mail notification [0aba6997]
- Refactored metrics service (#549) [5e0d32ac]
- Remove buildlogs aws config to not initialize AwsS3Operations (#558) [d50e5b7a]
- Update metrics response (#536) [b6b36a97]
- Bump buildkit 0.14.0 (#528) [c54172d1]
- Bump buildkit 0.14.1 (#548) [37afb782]
- Bump trivy 0.53.0 [f27ff527]
- Bump version 1.8.3 [55b473e1]

1.8.3 - 29 Jun 2024
- Fix client cache deadlock (#547) [cc6012ff]
- Fix failing test [263b44d3]
- Add cache record-stats (#534) [229926e2]

1.8.2 - 14 Jun 2024
- Fix get image auth digest (#530) [df8ec041]

1.8.1 - 13 Jun 2024
- Fix digest warning (#526) [6e34ff0a]
- Fix image name strategy (#513) [3bd8ffb5]

1.8.0 - 10 Jun 2024
- Add breakdown per org on stats metrics when a date is specified (#517) [b24894a4]
- Replace Kaniko with Buildkit (#503) [a26f5dfe]
- Implement cache store for build records (#505) [dd195deb]
- Fix do not show null in build view [763ffe03]
- Fix type in Const [b1bdb948]
- Fix handling blob response headers (#504) [de97575e]
- Fix missing endpoint on patched JWT token [46bbcd77]
- Improve digest retrivial logs [5976967a]
- Excludes JWT records with no endpoint [c98db8fb]
- Bump Gradle 8.8 [2e4568da]

1.7.9 - 29 May 2024
- Improve JWT refresh handling (#512) [751edb03]
- Mark release as draft when ending with -Ax -Bx -RCx [ci skip] [66ba7ea7]
- Mark release as draft when ending with -Ax -Bx -RCx [66ba7ea7]
- Removed unused imports (#510) [182e3f0d]
- Fix Use atomic strategy for Cacheable ops [923ae67c]
- Fix failing build [8adb52ab]
Expand Down Expand Up @@ -69,7 +112,7 @@
- Fix Containerfile encoding (#441) [d742aa67]
- Improve error reporting for AWS ECR auth failure [06141219]
- Remove unused exception [bc5570b3]
- Fix syntax error repored by Intellij [343887a4]
- Fix syntax error reported by Intellij [343887a4]
- Fix Build pod name (#438) [4e54ce1a]
- Fix RedisTestContainer flaky test (#436) [a90b44e5]
- Update platform api endpoint to api.cloud.seqera.io (#434) [1e43e8b1]
Expand All @@ -87,7 +130,7 @@
- Add fixed executor to future store [9f61abe9]
- Add timeout retry limiter [0a98aa96]
- Fix failing tests [eeb9ddfe]
- Add thred pool monitor cron [a1cdcc13]
- Add thread pool monitor cron [a1cdcc13]
- Bump corretto-17.0.10-al2023-jemalloc as base image [7238a86d]
- Evict status redesigned (#419) [9cf07b56]
- Add API and UI to evict a wave request from token cache (#410) [5833c18d]
Expand Down Expand Up @@ -143,7 +186,7 @@ v1.1.7 - 19 Dec 2023
- Implements streaming client for large binary downloads (#358) [592ce522]
- Update failing tests [31edb5e7]
- Fix typo in comment [c10cc472]
- Remove unsused consts [24315f03]
- Remove unused consts [24315f03]
- Refactor build settings via BuildConfig class (#324) [f6924f4a]
- Bump trivy 0.47.0 [3ff4a89f]

Expand Down Expand Up @@ -463,7 +506,7 @@ v0.29.0 - 5 Apr 2023

v0.28.6 - 5 Apr 2023
- Add consumers list [7d561f6d]
- Use singleton websocket instace [c0390502]
- Use singleton websocket instance [c0390502]
- Add custom MN worker pool [be3cbe78]
- Remove redis session [b23c7225]
- Improve logs [0f29cef7]
Expand All @@ -482,7 +525,7 @@ v0.28.2 - 4 Apr 2023
- Improve future poll + refactor [53c6a335]

v0.28.1 - 4 Apr 2023
- Fix missing timeout exeception on redis future [a9d640a0]
- Fix missing timeout exception on redis future [a9d640a0]
- Minor logging changes [c81e78bf] [4943ba6f] [6768b7eb]
- Update application dev [db4ae108]

Expand Down Expand Up @@ -684,7 +727,7 @@ v0.21.6 - 17 Oct 2022 [BROKEN BASE IMAGE]
- Improve registry auth lookup error [0f696146]

v0.21.5 - 4 Oct 2022
- Rollback timestamp and fingerpint fields [466b3a46] <Paolo Di Tommaso>
- Rollback timestamp and fingerprint fields [466b3a46] <Paolo Di Tommaso>

v0.21.4 - 3 Oct 2022
- Count all manifest digest requests [02435bff] <Paolo Di Tommaso>
Expand Down Expand Up @@ -795,7 +838,7 @@ v0.14.2 - 7 Sep 2022

v0.14.1 - 5 Sep 2022
- Fix registry auth invalid cache key [15bd1a57]
- Fix retry policy for temportary IO exeception [15e2723f]
- Fix retry policy for temporary IO exception [15e2723f]
- Add support for Azure CR [cac5b661]
- Improve logging [7af3109f]

Expand Down
11 changes: 8 additions & 3 deletions configuration.md
Original file line number Diff line number Diff line change
Expand Up @@ -81,11 +81,11 @@ Below are the standard format for known registries, but you can change registry

- **`wave.build.timeout`**: the timeout for the build process. Its default value is `5m` (5 minutes), providing a reasonable time frame for the build operation. *Optional*.

- **`wave.build.workspace`**: defines the path to the directory used by Wave to store artifacts such as Dockerfiles, Trivy cache for scan, Kaniko context, authentication configuration files, etc. For example, `/efs/wave/build`*Mandatory*.
- **`wave.build.workspace`**: defines the path to the directory used by Wave to store artifacts such as Dockerfiles, Trivy cache for scan, Buildkit context, authentication configuration files, etc. For example, `/efs/wave/build`*Mandatory*.

- **`wave.build.cleanup`**: determines the cleanup strategy after the build process. Options include `OnSuccess`, meaning cleanup occurs only if the build is successful. *Optional*.

- **`wave.build.kaniko-image`**: specifies the [Kaniko](https://github.com/GoogleContainerTools/kaniko) Docker image used in the Wave build process. The default is `gcr.io/kaniko-project/executor:v1.19.2`*Optional*.
- **`wave.build.buildkit-image`**: specifies the [Buildkit](https://github.com/moby/buildkit) Docker image used in the Wave build process. The default is `moby/buildkit:v0.13.2-rootless`*Optional*.

- **`wave.build.singularity-image`**: sets the [Singularity](https://quay.io/repository/singularity/singularity?tab=tags) image used in the build process. The default is `quay.io/singularity/singularity:v3.11.4-slim`*Optional*.

Expand All @@ -101,11 +101,16 @@ Below are the standard format for known registries, but you can change registry

- **`wave.build.public`**: indicates whether the Docker container repository is public. If set to true, Wave freeze will prefer this public repository over `wave.build.repo`*Optional*.

- **`wave.build.compress-caching`**: determines whether to compress cache layers produced by the build process. The default is `true`, enabling compression for more efficient storage*Optional*.
- **`wave.build.oci-mediatypes`**: defines whether to use OCI mediatypes in exported manifests. its default value is `true`*Optional*.

- **`wave.build.compression`**: defines which type of compression will be applied to cache layers. its default value is `gzip` and other options are `uncompressed|estargz|zstd`*Optional*.

- **`wave.build.force-compression`**: determines whether to force the compression for each cache layers produced by the build process. The default is `false`, enabling compression for more efficient storage. *Optional*.

### Spack configuration for wave build process

**Note**: Spack support will be removed in future releases.

Spack configuration consists of the path of its secret file, the mount path for the secret file in the spack container, and the optional S3 bucket name for the spack binary cache.

**Note**: these configuration are mandatory to support Spack in a wave installation.
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading

0 comments on commit 2f0ce9d

Please sign in to comment.