Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade seatunnel to 2.3.1 #4673

Merged
merged 15 commits into from
Jun 20, 2023

Conversation

shixiutao
Copy link
Contributor

What is the purpose of the change

Upgrade the version of seatunnel from the previous version 2.1.2 to version 2.3.1. The spark version need 2.4.x,the flink version need between 1.12.x and 1.14.x

Related issues/PRs

Brief change log

  • Removed FlinkSQL related code;
  • Add seatunel native zeta engine.

Checklist

  • I have read the Contributing Guidelines on pull requests.
  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible (If not, please discuss on the Linkis mailing list first)
  • If this is a code change: I have written unit tests to fully verify the new behavior.

ahaoyao and others added 5 commits May 8, 2023 15:41
…metadata query/service/jdbc/com.clickhouse clickhouse jdbc 0.4.6 (apache#4580)

* Bump clickhouse-jdbc

Bumps [clickhouse-jdbc](https://github.com/ClickHouse/clickhouse-java) from 0.3.2-patch11 to 0.4.6.
- [Release notes](https://github.com/ClickHouse/clickhouse-java/releases)
- [Changelog](https://github.com/ClickHouse/clickhouse-java/blob/main/CHANGELOG.md)
- [Commits](ClickHouse/clickhouse-java@v0.3.2-patch11...v0.4.6)

---
updated-dependencies:
- dependency-name: com.clickhouse:clickhouse-jdbc
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>

* update known-dependencies.txt

---------

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…grade_seatunnel_2.3.1

# Conflicts:
#	linkis-engineconn-plugins/seatunnel/src/main/java/org/apache/seatunnel/core/flink/FlinkV2Starter.java
#	linkis-engineconn-plugins/seatunnel/src/main/java/org/apache/seatunnel/core/zeta/ZetaStarter.java
@peacewong peacewong changed the base branch from master to dev-1.4.0 June 19, 2023 11:40
shixiutao and others added 6 commits June 19, 2023 20:04
…grade_seatunnel_2.3.1

# Conflicts:
#	linkis-computation-governance/linkis-manager/linkis-label-common/src/main/java/org/apache/linkis/manager/label/entity/engine/RunType.scala
.filter(it -> it.getFileName().toString().endsWith(".jar"))
.collect(Collectors.toList());
} catch (IOException e) {
throw new RuntimeException(e);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use LinkisRuntimeException

.filter(it -> it.getFileName().toString().endsWith(".jar"))
.collect(Collectors.toList());
} catch (IOException e) {
throw new RuntimeException(e);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Use LinkisRuntimeException

import java.util.Objects;

/**
* @Author shixiutao
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need to remove author

<version>${seatunnel.version}</version>
</dependency>
<dependency>
<groupId>com.hazelcast</groupId>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need add license to dir linkis-dist/release-docs/licenses

Copy link
Contributor

@peacewong peacewong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@peacewong peacewong merged commit 3ef1758 into apache:dev-1.4.0 Jun 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants