-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat: Implement first version of the federated catalog connector (#2)
* poc federated catalog * finalisation of poc. TODO: propper e2e text * First check * Add config description * Cleanup --------- Co-authored-by: Yalz <[email protected]>
- Loading branch information
Showing
14 changed files
with
369 additions
and
19 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,6 @@ | ||
| edc.catalog.cache.execution.delay.seconds=5 | ||
| edc.catalog.cache.execution.period.seconds=5 | ||
| edc.catalog.cache.partition.num.crawlers=1 | ||
| edc.ids.id=urn:connector:fcc | ||
| edc.web.rest.cors.enabled=true | ||
| edc.web.rest.cors.headers="origin,content-type,accept,authorization,x-api-key" |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| [ | ||
| { | ||
| "name": "provider-connector", | ||
| "url": "http://provider-connector:19194/protocol", | ||
| "supportedProtocols": [ | ||
| "dataspace-protocol-http" | ||
| ] | ||
| } | ||
| ] |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| # Build the jar file | ||
| FROM openjdk:18-ea-bullseye AS build | ||
|
|
||
| WORKDIR /app | ||
| COPY ./ . | ||
| RUN ./gradlew clean build | ||
|
|
||
| # Run the jar file | ||
| FROM openjdk:18-ea-bullseye | ||
| WORKDIR /app | ||
| COPY --from=build /app/federated-catalog-connector/build/libs/federated-catalog-connector.jar . | ||
|
|
||
| # Specify the command to run your application | ||
| CMD java -Dedc.fs.config=$EDC_FS_CONFIG -Dfcc.directory.file=$FCC_DIRECTORY_FILE -jar /app/federated-catalog-connector.jar |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,9 @@ | ||
| # Federated catalog connector | ||
|
|
||
| Supported configuration: | ||
|
|
||
| | property | description | required | default | | ||
| |--------------------------------------------|------------------------------------------------------------------------------------------------------------------|----------|-----------------------------------------| | ||
| | edc.catalog.cache.execution.delay.seconds | The initial delay for the cache crawler engine. | no | N/A (no initial execution will be done) | | ||
| | edc.catalog.cache.execution.period.seconds | The time to elapse between two crawl runs. | no | 60 | | ||
| | edc.catalog.cache.partition.num.crawlers | The number of crawlers (execution threads) that should be used. The engine will re-use crawlers when necessary. | no | 2 | |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,50 @@ | ||
| /* | ||
| * Copyright (c) 2022 Microsoft Corporation | ||
| * | ||
| * This program and the accompanying materials are made available under the | ||
| * terms of the Apache License, Version 2.0 which is available at | ||
| * https://www.apache.org/licenses/LICENSE-2.0 | ||
| * | ||
| * SPDX-License-Identifier: Apache-2.0 | ||
| * | ||
| * Contributors: | ||
| * Microsoft Corporation - initial API and implementation | ||
| * | ||
| */ | ||
|
|
||
| plugins { | ||
| `java-library` | ||
| id("application") | ||
| alias(libs.plugins.shadow) | ||
| } | ||
|
|
||
| dependencies { | ||
| runtimeOnly(libs.edc.catalog.core) | ||
| runtimeOnly(libs.edc.catalog.api) | ||
| implementation(libs.edc.catalog.spi) | ||
| implementation(libs.edc.configuration.filesystem) | ||
|
|
||
| implementation(libs.edc.util) | ||
| runtimeOnly(libs.edc.spi.jsonld) | ||
|
|
||
| runtimeOnly(libs.bundles.edc.connector) | ||
| runtimeOnly(libs.edc.control.plane.core) | ||
| runtimeOnly(libs.edc.data.plane.selector.core) | ||
|
|
||
| // IDS stuff | ||
| runtimeOnly(libs.edc.dsp) | ||
| runtimeOnly(libs.edc.iam.mock) | ||
| } | ||
|
|
||
| application { | ||
| mainClass.set("org.eclipse.edc.boot.system.runtime.BaseRuntime") | ||
| } | ||
|
|
||
| var distTar = tasks.getByName("distTar") | ||
| var distZip = tasks.getByName("distZip") | ||
|
|
||
| tasks.withType<com.github.jengelman.gradle.plugins.shadow.tasks.ShadowJar> { | ||
| mergeServiceFiles() | ||
| archiveFileName.set("federated-catalog-connector.jar") | ||
| dependsOn(distTar, distZip) | ||
| } |
Oops, something went wrong.