Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added the spark etl document #4631

Closed
wants to merge 158 commits into from
Closed

Added the spark etl document #4631

wants to merge 158 commits into from

Commits on Feb 21, 2023

  1. [Bugfix] engine version support hyphen (apache#4246) 

    * EngineTypeLabel support "-"
    @GuoPhilipse
    GuoPhilipse committed Feb 21, 2023
    Configuration menu
    Copy the full SHA
    436f90d View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2023

  1. [feat] support different hive version (apache#4255) 

    * support different hive version

* fix code style

* log exception
    @GuoPhilipse
    GuoPhilipse committed Feb 23, 2023
    Configuration menu
    Copy the full SHA
    ee29de9 View commit details
    Browse the repository at this point in the history

Commits on Mar 2, 2023

  1. The abnormal class description information in the checkEngineConnDist… 

    …Home method supplements the path information (apache#4283)
    @binbinCheng
    binbinCheng committed Mar 2, 2023
    Configuration menu
    Copy the full SHA
    f1deaca View commit details
    Browse the repository at this point in the history

Commits on Mar 3, 2023

  1. mapper formatting

    @binbinCheng
    binbinCheng committed Mar 3, 2023
    Configuration menu
    Copy the full SHA
    2826602 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2023

  1. Beautify the sql style, clear and clear

    @binbinCheng
    binbinCheng committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    617dcf8 View commit details
    Browse the repository at this point in the history

  2. update LabelMapper.xml

    @binbinCheng
    binbinCheng committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    557f4fe View commit details
    Browse the repository at this point in the history

  3. [feat] upgrade hadoop\spark\hive default vertion to 3.x (apache#4263) 

    * upgrade hive\spark\hadoop to default 3.x
    @GuoPhilipse
    GuoPhilipse committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    eb55412 View commit details
    Browse the repository at this point in the history

  4. Beautify the sql style, clear and clear

    @binbinCheng
    binbinCheng committed Mar 6, 2023
    Configuration menu
    Copy the full SHA
    9990b9c View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. [feat] EngineConn no longer imports the dependencies of the underlyin… 

    …g engine (apache#4278)

* EngineConn no longer imports the dependencies of the underlying engine
    @GuoPhilipse
    GuoPhilipse committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    9563457 View commit details
    Browse the repository at this point in the history

  2. give more exception in CustomerDelimitedJSONSerDe.java (apache#4341)

    @GuoPhilipse
    GuoPhilipse committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    72d8404 View commit details
    Browse the repository at this point in the history

  3. [feat]Support spark3.3+ and spark2.2- compile (apache#4301) 

    * Support spark3.3+  and spark2.2- compile

* fix unknown dependency

* improve code

* remove unused dependency

* remove unused dependency for hive sink

---------

Co-authored-by: gf13871 <[email protected]>
    @GuoPhilipse @tclxgf13871
    GuoPhilipse and tclxgf13871 committed Mar 8, 2023
    Configuration menu
    Copy the full SHA
    2c5abd7 View commit details
    Browse the repository at this point in the history

Commits on Mar 14, 2023

  1. Optimization of upload file interface in FsRestfulApi.java (apache#4357)

    @binbinCheng
    binbinCheng committed Mar 14, 2023
    Configuration menu
    Copy the full SHA
    1d9c9a3 View commit details
    Browse the repository at this point in the history

Commits on Mar 16, 2023

  1. [fix bug] The s3a file cannot be written because FileSystem is closed… 

    … prematurely (apache#4375)

apache#4374
    @duhanmin
    duhanmin committed Mar 16, 2023
    Configuration menu
    Copy the full SHA
    581ce1e View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2023

  1. Improve exception information and add path information (apache#4351) 

    
Co-authored-by: casionone <[email protected]>
    @binbinCheng @casionone
    binbinCheng and casionone committed Mar 22, 2023
    Configuration menu
    Copy the full SHA
    e24da00 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2023

  1. support map string value (apache#4409)

    @GuoPhilipse
    GuoPhilipse committed Mar 27, 2023
    Configuration menu
    Copy the full SHA
    1e25954 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2023

  1. feat: HiveEngineConn supports concurrency.(apache#4175) (apache#4359) 

    * feat: HiveEngineConn supports concurrency.(apache#4175)
    @CharlieYan24
    CharlieYan24 committed Mar 29, 2023
    Configuration menu
    Copy the full SHA
    6d1eed1 View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2023

  1. Merge remote-tracking branch 'upstream/dev-1.3.2' into dev-1.3.2-merg… 

    …eto1.4.0

# Conflicts:
#	README.md
#	README_CN.md
#	linkis-computation-governance/linkis-computation-governance-common/src/main/scala/org/apache/linkis/governance/common/conf/GovernanceCommonConf.scala
#	linkis-computation-governance/linkis-manager/linkis-label-common/src/test/java/org/apache/linkis/manager/label/entity/engine/EngineTypeLabelTest.java
#	linkis-dist/package/conf/linkis.properties
#	linkis-engineconn-plugins/flink/pom.xml
#	linkis-engineconn-plugins/hive/src/main/resources/linkis-engineconn.properties
#	linkis-engineconn-plugins/hive/src/main/scala/org/apache/linkis/engineplugin/hive/conf/HiveEngineConfiguration.scala
#	linkis-engineconn-plugins/spark/src/main/scala/org/apache/linkis/engineplugin/spark/datacalc/sink/HiveSink.scala
#	linkis-public-enhancements/linkis-datasource/linkis-metadata-query/service/hive/pom.xml
#	pom.xml
#	tool/dependencies/known-dependencies.txt
    @peacewong
    peacewong committed Mar 30, 2023
    Configuration menu
    Copy the full SHA
    65381be View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2023

  1. update build to support spark and hadoop multi-version compilation

    @peacewong
    peacewong committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    b900b71 View commit details
    Browse the repository at this point in the history

  2. Merge pull request apache#4428 from WeDataSphere/dev-1.3.2-mergeto1.4.0

    @casionone
    casionone committed Mar 31, 2023
    Configuration menu
    Copy the full SHA
    67e4c0c View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2023

  1. Datasource code optimization (apache#4419)

    @ChengJie1053
    ChengJie1053 committed Apr 1, 2023
    Configuration menu
    Copy the full SHA
    a6e32ad View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2023

  1. Merge branch 'dev-1.4.0' into dev-1.3.3-mapper-finishing

    @casionone
    casionone committed Apr 2, 2023
    Configuration menu
    Copy the full SHA
    1b78c41 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. Merge pull request apache#4293 from binbinCheng/dev-1.3.3-mapper-fini… 

    …shing

Mybatis mapper formatting
    @casionone
    casionone committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    f18c0dc View commit details
    Browse the repository at this point in the history

  2. fix(common util)：fix getStringToMap function bug about ECResourceInfo… 

    …Utils
    @ahaoyao
    ahaoyao committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    2418948 View commit details
    Browse the repository at this point in the history

  3. [Feature] Change KIND to an optional way on kubernetes deployment (ap… 

    …ache#4427)

* feat: support kubernetes deploy ment without KIND dependency

* feat: support kubernetes deploy ment without KIND dependency

* feat: support kubernetes deploy ment without KIND dependency

* feat: support kubernetes deploy ment without KIND dependency
    @chenghuichen
    chenghuichen committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    5b321e0 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. feat：commons_fileupload Upgrade to 1.5

    @ahaoyao
    ahaoyao committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    f33f51a View commit details
    Browse the repository at this point in the history

  2. Fixed nohup startup bug (apache#4438)

    @waynecookie
    waynecookie committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    0786e9b View commit details
    Browse the repository at this point in the history

  3. feat : linkis-storage support OSS filesystem support write/read launc… 

    …h log and resultSet in OSS(apache#4185) (apache#4424)

* linkis-storge support oss filesystem(apache#4185)
    @CharlieYan24
    CharlieYan24 committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    f545197 View commit details
    Browse the repository at this point in the history

  4. Delete useless files (apache#4425) 

    * Delete useless files（RPCHttpContextClientConfig.java）
    @ChengJie1053
    ChengJie1053 committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    9d1ae92 View commit details
    Browse the repository at this point in the history

  5. Cpu load Average Usage bug (apache#4429)

    @ChengJie1053
    ChengJie1053 committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    9ee4a46 View commit details
    Browse the repository at this point in the history

  6. Merge pull request apache#4432 from WeDataSphere/dev-1.4.0-upgrade-de… 

    …pendencies

feat：commons_fileupload Upgrade to 1.5
    @casionone
    casionone committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    63118b5 View commit details
    Browse the repository at this point in the history

  7. Merge pull request apache#4430 from WeDataSphere/fix/fix-ECResourceIn… 

    …foUtils

fix(common util)：fix getStringToMap function bug about ECResourceInfo…
    @casionone
    casionone committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    6366265 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2023

  1. sync master to dev-1.4.0 

    sync master to dev-1.4.0
    @peacewong
    peacewong committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    6a4817a View commit details
    Browse the repository at this point in the history

  2. Revert "sync master to dev-1.4.0"

    @peacewong
    peacewong committed Apr 8, 2023
    Configuration menu
    Copy the full SHA
    9407924 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2023

  1. Merge pull request apache#4450 from apache/revert-4448-master

    @casionone
    casionone committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    341c632 View commit details
    Browse the repository at this point in the history

  2. Revert "Revert "sync master to dev-1.4.0""

    @peacewong
    peacewong committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    aa5ae1d View commit details
    Browse the repository at this point in the history

  3. Merge pull request apache#4451 from apache/revert-4450-revert-4448-ma… 

    …ster
    @casionone
    casionone committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    c81108b View commit details
    Browse the repository at this point in the history

  4. Change FileUtils readFileToString Deprecated (apache#4443) 

    * Change  FileUtils readFileToString Deprecated

* Change  FileUtils readFileToString Deprecated

* Change FileUtils readFileToString Deprecated
    @ChengJie1053
    ChengJie1053 committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    d77162e View commit details
    Browse the repository at this point in the history

  5. Port range 65534 alter 65535 (apache#4447) 

    * Port range 65534 alter 65535

* Port range 65534 alter 65535
    @ChengJie1053
    ChengJie1053 committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    784f151 View commit details
    Browse the repository at this point in the history

  6. LogCache code optimization and delete useless files (apache#4445) 

    * LogCache code optimization

* LogCache code optimization and delete useless files

* delete useless files

* LogCache code optimization and delete useless files

* delete useless files

* LogCache code optimization and delete useless files
    @ChengJie1053
    ChengJie1053 committed Apr 9, 2023
    Configuration menu
    Copy the full SHA
    7155aef View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. feat : linkis-storage support s3 filesystem support write/read launch… 

    … log and resultSet in s3(apache#4185) (apache#4435)

* linkis-storage support S3 filesystem

* format code

* add comment

* remove wds.

* 1. format code 2. add dependant license

* format linkis-storage.pom

* format linkis-storage.pom

* format code

---------

Co-authored-by: zyyBjtu <[email protected]>
    @sjgllgh @zyyBjtu
    sjgllgh and zyyBjtu committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    f0f6657 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. Bump snakeyaml from 1.33 to 2.0 (apache#4440) 

    Bumps [snakeyaml](https://bitbucket.org/snakeyaml/snakeyaml) from 1.33 to 2.0.
- [Commits](https://bitbucket.org/snakeyaml/snakeyaml/branches/compare/snakeyaml-2.0..snakeyaml-1.33)

---
updated-dependencies:
- dependency-name: org.yaml:snakeyaml
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
    @dependabot
    dependabot[bot] committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    1681800 View commit details
    Browse the repository at this point in the history

  2. fix: make property name consistent apache#4461 (apache#4462) 

    * fix: make property name consistent apache#4461

* fix: make property name consistent apache#4461
    @chenghuichen
    chenghuichen committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    78b7f79 View commit details
    Browse the repository at this point in the history

  3. [WIP] remove json4s from linkis (apache#4368) 

    * remove json4s from linkis

* use jsonpath to read json value

* fix unknown dependency

* improve jsonpath usage

* optimize code

* trigger rebuild

* trigger rebuild

* optimize code

* optimize code

* fix circular reference object

* remove unused jackson

---------

Co-authored-by: gf13871 <[email protected]>
    @GuoPhilipse @tclxgf13871
    GuoPhilipse and tclxgf13871 committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    3702d91 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. Revert "Bump snakeyaml from 1.33 to 2.0 (apache#4440)" (apache#4469) 

    This reverts commit 1681800.
    @jackxu2011
    jackxu2011 committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    a4662f1 View commit details
    Browse the repository at this point in the history

  2. update task cancel msg (apache#4454)

    @v-kkhuang
    v-kkhuang committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    8d05843 View commit details
    Browse the repository at this point in the history

  3. optimize engine log (apache#4455)

    @v-kkhuang
    v-kkhuang committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    0f1005c View commit details
    Browse the repository at this point in the history

  4. update log (apache#4456)

    @v-kkhuang
    v-kkhuang committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    a92146f View commit details
    Browse the repository at this point in the history

  5. fix config cache bug (apache#4457)

    @v-kkhuang
    v-kkhuang committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    35ff59b View commit details
    Browse the repository at this point in the history

  6. push tenant config code (apache#4453)

    @v-kkhuang
    v-kkhuang committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    899bb15 View commit details
    Browse the repository at this point in the history

  7. [issue-4467] update linkis version to 1.4.0 for docker and snapshot (a… 

    …pache#4468)

* update linkis version to 1.4.0 for docker and snapshot

* update SNAPSHOT version and workflow desc

---------

Co-authored-by: aiceflower <[email protected]>
    @aiceflower
    aiceflower and aiceflower committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    fb4aad3 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2023

  1. Fix test failed and remove some jars (apache#4471) 

    * fix(test): fix test error
    @jackxu2011
    jackxu2011 committed Apr 15, 2023
    Configuration menu
    Copy the full SHA
    af40a99 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2023

  1. ECM code optimization (apache#4449) 

    * ECM code optimization
    @ChengJie1053
    ChengJie1053 committed Apr 16, 2023
    Configuration menu
    Copy the full SHA
    c8d1512 View commit details
    Browse the repository at this point in the history

Commits on Apr 19, 2023

  1. Executor code optimization and Remove useless code (apache#4472) 

    * Executor code optimization and Remove useless code

* update AccessibleExecutor
    @ChengJie1053
    ChengJie1053 committed Apr 19, 2023
    Configuration menu
    Copy the full SHA
    415d5cd View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2023

  1. Translate engineconn-plugins-openlookeng service classes from Scala t… 

    …o Java (apache#4474)
    @ChengJie1053
    ChengJie1053 committed Apr 20, 2023
    Configuration menu
    Copy the full SHA
    91e648b View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. Updatethe volatile key for singleton (apache#4477) 

    * Updatethe volatile key for singleton
    @ChengJie1053
    ChengJie1053 committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    d67e6d1 View commit details
    Browse the repository at this point in the history

  2. feat: use up-to-date mysql ddl for k8s deployment apache#4426 (apache… 

    …#4475)
    @chenghuichen
    chenghuichen committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    8dc2725 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2023

  1. [Bug]: fix the bug that guice:4.1.0 dependency conflict during linkis… 

    …-engineconn-plugins compilation apache#4478 (apache#4479)
    @stdnt-xiao
    stdnt-xiao committed Apr 23, 2023
    Configuration menu
    Copy the full SHA
    63ea330 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2023

  1. add impala engineconn-plugin (apache#4458) 

    * add impala engine plugin
    @ws00428637
    ws00428637 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    265d5d3 View commit details
    Browse the repository at this point in the history

  2. EngineConnsHome Filters hidden files (apache#4481) 

    * EngineConnsHome Filters hidden files
    @ChengJie1053
    ChengJie1053 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    1ec76de View commit details
    Browse the repository at this point in the history

  3. feat: do not kill ec when ecm restart part-1 (apache#4184) (apache#4452) 

    * feat: do not kill ec when ecm restart(apache#4192)
    @CharlieYan24
    CharlieYan24 committed Apr 25, 2023
    Configuration menu
    Copy the full SHA
    d12a326 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. Support tidb dataSources (apache#4486) 

    * tidb support
    @ChengJie1053
    ChengJie1053 committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    734932a View commit details
    Browse the repository at this point in the history

  2. hive adaptive ranger (apache#4485) 

    * adaptive ranger

* hive adaptive ranger
    @MrFengqin
    MrFengqin committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    3e17fd8 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Translate engineconn-plugins-shell service classes from Scala to Java (… 

    …apache#4473)

* Remove useless code
    @ChengJie1053
    ChengJie1053 committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    db37eed View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. improve yarn resource requester (apache#4492) 

    Co-authored-by: gf13871 <[email protected]>
    @GuoPhilipse @tclxgf13871
    GuoPhilipse and tclxgf13871 committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    179abed View commit details
    Browse the repository at this point in the history

  2. Remove the default compilation of impala

    @peacewong @Alexkun
    peacewong authored and Alexkun committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    dca0762 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2023

  1. Fix front-end compilation exceptions (apache#4503)

    @jacktao007
    jacktao007 committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    41798ea View commit details
    Browse the repository at this point in the history

  2. fixed the front-end startup exception (apache#4505)

    @jacktao007
    jacktao007 committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    806d37a View commit details
    Browse the repository at this point in the history

  3. [Bugfix] update refresh time of providerCache is 30m (apache#4498) 

    * fix refresh time is 30m
close apache#4497

* Correct the word

* code format
    @guoshupei
    guoshupei committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    ba581c6 View commit details
    Browse the repository at this point in the history

  4. Upgrade node to version 16.0.0 (apache#4495) 

    Co-authored-by: ahaoyao <[email protected]>
    @ahaoyao
    ahaoyao and ahaoyao committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    6f4dad9 View commit details
    Browse the repository at this point in the history

  5. Support starrocks dataSources (apache#4496) 

    * Formatting code

* Modify sql
    @ChengJie1053
    ChengJie1053 committed Apr 29, 2023
    Configuration menu
    Copy the full SHA
    b3c105d View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2023

  1. Release refresh button (apache#4507)

    @jacktao007
    jacktao007 committed Apr 30, 2023
    Configuration menu
    Copy the full SHA
    bfde76c View commit details
    Browse the repository at this point in the history

  2. Engineplugin shell Code optimization (apache#4499)

    @ChengJie1053
    ChengJie1053 committed Apr 30, 2023
    Configuration menu
    Copy the full SHA
    a7e6ece View commit details
    Browse the repository at this point in the history

  3. fix: do not clean ec resource and service info when handler ecm close… 

    … event(apache#4184) (apache#4510)
    @CharlieYan24
    CharlieYan24 committed Apr 30, 2023
    Configuration menu
    Copy the full SHA
    4b787a4 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2023

  1. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 1, 2023
    Configuration menu
    Copy the full SHA
    be9d230 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2023

  1. optimize code (apache#4512)

    @GuoPhilipse
    GuoPhilipse committed May 2, 2023
    Configuration menu
    Copy the full SHA
    5e267df View commit details
    Browse the repository at this point in the history

  2. Datasource client bug fix (apache#4500) 

    * Fix datasource client query type conversion exception
    @zhangwejun
    zhangwejun committed May 2, 2023
    Configuration menu
    Copy the full SHA
    5137d3c View commit details
    Browse the repository at this point in the history

  3. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 2, 2023
    Configuration menu
    Copy the full SHA
    252a00d View commit details
    Browse the repository at this point in the history

  4. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 2, 2023
    Configuration menu
    Copy the full SHA
    7c98706 View commit details
    Browse the repository at this point in the history

  5. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 2, 2023
    Configuration menu
    Copy the full SHA
    4a1a413 View commit details
    Browse the repository at this point in the history

  6. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 2, 2023
    Configuration menu
    Copy the full SHA
    5c2269e View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    ab40b5d View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-mange#4192

    @CharlieYan24
    CharlieYan24 committed May 3, 2023
    Configuration menu
    Copy the full SHA
    ffe42ee View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. Support Gaussdb dataSources and Fixed pg bug (apache#4513)

    @ChengJie1053
    ChengJie1053 committed May 4, 2023
    Configuration menu
    Copy the full SHA
    7cab756 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    f1e7d8a View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    0f69de9 View commit details
    Browse the repository at this point in the history

  3. fix: FsPathTest should skip windows (apache#4517)

    @CharlieYan24
    CharlieYan24 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    a549dab View commit details
    Browse the repository at this point in the history

  4. Fixed the linkis-metadata-query-service-jdbc bug (apache#4508) 

    * Fixed the linkis-metadata-query-service-jdbc bug

* Fixed the linkis-metadata-query-service-jdbc bug

* Formatting code
    @ChengJie1053
    ChengJie1053 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    46c2bb2 View commit details
    Browse the repository at this point in the history

  5. Translate engineconn-plugins-python service classes from Scala to Java ( 

    apache#4482)
    @ChengJie1053
    ChengJie1053 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    ec9b2c6 View commit details
    Browse the repository at this point in the history

  6. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 5, 2023
    Configuration menu
    Copy the full SHA
    f4921b4 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2023

  1. feat: Reduce scala modules and publish jar packages with scala versio… 

    …ns at the same time(apache#4192) (apache#4459)
    @CharlieYan24
    CharlieYan24 committed May 6, 2023
    Configuration menu
    Copy the full SHA
    29cf010 View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 6, 2023
    Configuration menu
    Copy the full SHA
    5665641 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2023

  1. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 7, 2023
    Configuration menu
    Copy the full SHA
    7fa9be0 View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 7, 2023
    Configuration menu
    Copy the full SHA
    ca2fe91 View commit details
    Browse the repository at this point in the history

  3. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 7, 2023
    Configuration menu
    Copy the full SHA
    40fca22 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Translate engineconn-plugins-trino service classes from Scala to Java (… 

    …apache#4526)
    @ChengJie1053
    ChengJie1053 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    632191a View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    634fd03 View commit details
    Browse the repository at this point in the history

  3. Translate engineconn-plugins-presto service classes from Scala to Java ( 

    apache#4514)
    @ChengJie1053
    ChengJie1053 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    0fb148a View commit details
    Browse the repository at this point in the history

  4. metadata-query code optimization (apache#4523)

    @ChengJie1053
    ChengJie1053 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    04791ef View commit details
    Browse the repository at this point in the history

  5. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    cbff5fa View commit details
    Browse the repository at this point in the history

  6. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 10, 2023
    Configuration menu
    Copy the full SHA
    02b2dab View commit details
    Browse the repository at this point in the history

Commits on May 11, 2023

  1. feat(pom): fix build with jdk17 for default profiles (apache#4480)

    @jackxu2011
    jackxu2011 committed May 11, 2023
    Configuration menu
    Copy the full SHA
    a3aec9e View commit details
    Browse the repository at this point in the history

  2. feat: Reduce scala module: linkis-manage modify exception apache#4192

    @CharlieYan24
    CharlieYan24 committed May 11, 2023
    Configuration menu
    Copy the full SHA
    a99d3d7 View commit details
    Browse the repository at this point in the history

  3. Reduce mixed language module linkismange apache#4463 

    Reduce mixed language module linkismange apache#4463
    @peacewong
    peacewong committed May 11, 2023
    Configuration menu
    Copy the full SHA
    5b7fd7b View commit details
    Browse the repository at this point in the history

Commits on May 12, 2023

  1. ResponseTaskRunningInfo bug fix and remove useless code (apache#4533)

    @ChengJie1053
    ChengJie1053 committed May 12, 2023
    Configuration menu
    Copy the full SHA
    00a2975 View commit details
    Browse the repository at this point in the history

  2. properties values support the Chinese (apache#4521) 

    * properties values support the Chinese

---------

Co-authored-by: ahaoyao <[email protected]>
    @ahaoyao
    ahaoyao and ahaoyao committed May 12, 2023
    Configuration menu
    Copy the full SHA
    5a59e5b View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. fix init logger with wrong class apache#4537 (apache#4540) 

    * fix: init logger with wrong class apache#4537
    @CharlieYan24
    CharlieYan24 committed May 17, 2023
    Configuration menu
    Copy the full SHA
    e3e2035 View commit details
    Browse the repository at this point in the history

  2. feat: support multiple cluster PART-1 apache#4179 (apache#4460)

    @chenghuichen
    chenghuichen committed May 17, 2023
    Configuration menu
    Copy the full SHA
    f1ed1dd View commit details
    Browse the repository at this point in the history

  3. Translate engineconn-plugins-elasticsearch service classes from Scala… 

    … to Java (apache#4531)
    @ChengJie1053
    ChengJie1053 committed May 17, 2023
    Configuration menu
    Copy the full SHA
    3989b4d View commit details
    Browse the repository at this point in the history

Commits on May 18, 2023

  1. spark etl support excel and transformations can be null (apache#4539)

    @ChengJie1053
    ChengJie1053 committed May 18, 2023
    Configuration menu
    Copy the full SHA
    4767c5e View commit details
    Browse the repository at this point in the history

  2. spark etl support redis and jedis2.9.2 upgrade 3.9.0 (apache#4534)

    @ChengJie1053
    ChengJie1053 committed May 18, 2023
    Configuration menu
    Copy the full SHA
    7bf9c44 View commit details
    Browse the repository at this point in the history

  3. [Fix Bug]If the input script is json, the loop cannot be completed(ap… 

    …ache#4557) (apache#4558)

* If the input script is json, the loop cannot be completed(apache#4557)
    @duhanmin
    duhanmin committed May 18, 2023
    Configuration menu
    Copy the full SHA
    3346392 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2023

  1. fix(pom): fix the spark miss jetty-client, and remove the older jesery ( 

    apache#4562)

* fix(pom): fix the spark miss jetty-client, and remove the older jesery

* refactor: remove the guava's version in ecp-spark
    @jackxu2011
    jackxu2011 committed May 19, 2023
    Configuration menu
    Copy the full SHA
    af0b6e3 View commit details
    Browse the repository at this point in the history

  2. [Feature][Flink] Add task interceptor for FLink EC (apache#4556)

    @peacewong
    peacewong committed May 19, 2023
    Configuration menu
    Copy the full SHA
    a5e6991 View commit details
    Browse the repository at this point in the history

  3. spark etl support datalake and add scala-2.12 module (apache#4538)

    @ChengJie1053
    ChengJie1053 committed May 19, 2023
    Configuration menu
    Copy the full SHA
    e09e897 View commit details
    Browse the repository at this point in the history

  4. [Gateway]All backend caches should be cleared when the user logs out (a… 

    …pache#4548)

* Fix log out cookie not to clear

* Task progress exceeding 1 will give fake progress
    @peacewong
    peacewong committed May 19, 2023
    Configuration menu
    Copy the full SHA
    e4de7c9 View commit details
    Browse the repository at this point in the history

  5. [JDBC]Linkis JDBC-Driver optimization (apache#4545)

    @peacewong
    peacewong committed May 19, 2023
    Configuration menu
    Copy the full SHA
    9ad3d76 View commit details
    Browse the repository at this point in the history

  6. [Feature]Add MDC log format to Linkis for tracking JobID apache#4553 (a… 

    …pache#4554)
    @peacewong
    peacewong committed May 19, 2023
    Configuration menu
    Copy the full SHA
    7544426 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2023

  1. avoid unnecessary json exception (apache#4567)

    @GuoPhilipse
    GuoPhilipse committed May 20, 2023
    Configuration menu
    Copy the full SHA
    3b41d34 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. spark jdbc etl support dm and kingbase (apache#4568)

    @ChengJie1053
    ChengJie1053 committed May 22, 2023
    Configuration menu
    Copy the full SHA
    3544d39 View commit details
    Browse the repository at this point in the history

  2. spark etl support RocketMQ (apache#4564)

    @ChengJie1053
    ChengJie1053 committed May 22, 2023
    Configuration menu
    Copy the full SHA
    786751f View commit details
    Browse the repository at this point in the history

Commits on May 23, 2023

  1. spark etl support mongo and es (apache#4560)

    @ChengJie1053
    ChengJie1053 committed May 23, 2023
    Configuration menu
    Copy the full SHA
    42d070d View commit details
    Browse the repository at this point in the history

  2. [feate] Added support for postgresql based on dev-1.4.0 (apache#4524)

    @sjgllgh
    sjgllgh committed May 23, 2023
    Configuration menu
    Copy the full SHA
    3db237e View commit details
    Browse the repository at this point in the history

Commits on May 24, 2023

  1. fix s3 cant read logs and results (apache#4573)

    @sjgllgh
    sjgllgh committed May 24, 2023
    Configuration menu
    Copy the full SHA
    bb14592 View commit details
    Browse the repository at this point in the history

  2. spark etl support solr (apache#4569)

    @ChengJie1053
    ChengJie1053 committed May 24, 2023
    Configuration menu
    Copy the full SHA
    aa9e124 View commit details
    Browse the repository at this point in the history

  3. Fix serialization of number type parameters to double (apache#4571)

    @zhangwejun
    zhangwejun committed May 24, 2023
    Configuration menu
    Copy the full SHA
    7a8c2a6 View commit details
    Browse the repository at this point in the history

  4. web optimize for 1.4.0 (apache#4444) 

    * bug fix

* modify package.json

* close codequery entrance

* upd license
    @mayinrain
    mayinrain committed May 24, 2023
    Configuration menu
    Copy the full SHA
    6b2c4ee View commit details
    Browse the repository at this point in the history

Commits on May 25, 2023

  1. Security Work Order Upgrade (apache#4561)

    @ahaoyao
    ahaoyao committed May 25, 2023
    Configuration menu
    Copy the full SHA
    b0173ec View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. spark etl support kafka (apache#4563)

    @ChengJie1053
    ChengJie1053 committed May 26, 2023
    Configuration menu
    Copy the full SHA
    42c52b2 View commit details
    Browse the repository at this point in the history

  2. optimization for web 

    Fixing pages encoding issues
Fixing fetching timing issues
Ignoring whitespace when search ecm instances
Other optimization for web
    @mayinrain
    mayinrain committed May 26, 2023
    Configuration menu
    Copy the full SHA
    aee1e17 View commit details
    Browse the repository at this point in the history

  3. update workflows (apache#4579)

    @ahaoyao
    ahaoyao committed May 26, 2023
    Configuration menu
    Copy the full SHA
    42e3f1f View commit details
    Browse the repository at this point in the history

Commits on May 27, 2023

  1. Support oceanbase dataSources (apache#4581)

    @ChengJie1053
    ChengJie1053 committed May 27, 2023
    Configuration menu
    Copy the full SHA
    16d7e5e View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. [Feature][linkis-computation-client] Provide a method which can get C… 

    …reateEngineResult when submit a [once] job (apache#4583)
    @rarexixi
    rarexixi committed May 29, 2023
    Configuration menu
    Copy the full SHA
    427b2ff View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Generate spark sql based on the jdbc datasource and optimized code (a… 

    …pache#4570)
    @ChengJie1053
    ChengJie1053 committed May 30, 2023
    Configuration menu
    Copy the full SHA
    b5053af View commit details
    Browse the repository at this point in the history

Commits on May 31, 2023

  1. [Feature] Add pg check script (apache#4587) 

    * add check script for postgresql
    @sjgllgh
    sjgllgh committed May 31, 2023
    Configuration menu
    Copy the full SHA
    0e7a0f9 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2023

  1. Generate jdbc sql (apache#4589) 

    * Generate jdbc sql

* Modify generate jdbc sql
    @ChengJie1053
    ChengJie1053 committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    281e1b5 View commit details
    Browse the repository at this point in the history

  2. Generate spark sql from kafka es mongo (apache#4588) 

    * Generate spark sql from kafka es mongo

* Add DataSourceTypeEnum
    @ChengJie1053
    ChengJie1053 committed Jun 1, 2023
    Configuration menu
    Copy the full SHA
    f40bf6f View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2023

  1. support to initialize postgresql in install.sh (apache#4593)

    @sjgllgh
    sjgllgh committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    470159f View commit details
    Browse the repository at this point in the history

  2. Generate sql code optimization (apache#4594)

    @ChengJie1053
    ChengJie1053 committed Jun 2, 2023
    Configuration menu
    Copy the full SHA
    d554374 View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2023

  1. add jersey-apache-client4 dependency (apache#4599) 

    Co-authored-by: aiceflower <[email protected]>
    @aiceflower
    aiceflower and aiceflower committed Jun 5, 2023
    Configuration menu
    Copy the full SHA
    2f69900 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. Fix usage docs for Impala & Trino (apache#4597)

    @ws00428637
    ws00428637 committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    ffd386a View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2023

  1. Support integtation test git action (apache#4601) 

    * support integtation test git action

* support integtation test git action

* support integtation test git action

* add rat check ignore of .gitmodules file

* add description
    @casionone
    casionone committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    9bb6cd8 View commit details
    Browse the repository at this point in the history

  2. remove v prefix for impala and add default compile mode (apache#4609) 

    * remove v prefix

* impala is not compiled by default
    aiceflower committed Jun 7, 2023
    Configuration menu
    Copy the full SHA
    288a092 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. modify the scala packaging version (apache#4612)

    aiceflower committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    b4b294f View commit details
    Browse the repository at this point in the history

  2. fix: remove engine version pattern check apache#4610 (apache#4611) 

    * fix: remove engine version pattern check apache#4610

* fix: remove engine version pattern check apache#4610
    @CharlieYan24
    CharlieYan24 committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    a97a048 View commit details
    Browse the repository at this point in the history

  3. Fix ENGINE_TASK_EXPIRE_TIME ClassCastException bug (apache#4614)

    @ChengJie1053
    ChengJie1053 committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    1d1abfc View commit details
    Browse the repository at this point in the history

Commits on Jun 10, 2023

  1. ECM stateless feature optimization (apache#4608) 

    * Add TicketID to node and service_instance table

* Fixed ECM not cleaning up when starting EC exception

* move File to java dir

* Because the information needs to be pushed to createEngine, there is no need to stop here, because create will stop

* Fix build error

* Fix Integration Test

* Fix Integration Test

* code optimize
    @peacewong
    peacewong committed Jun 10, 2023
    Configuration menu
    Copy the full SHA
    ef3e2b9 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2023

  1. update check and install scripts (apache#4619)

    aiceflower committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    ec1eca0 View commit details
    Browse the repository at this point in the history

  2. Fix NPE bug apache#4621 (apache#4622)

    @peacewong
    peacewong committed Jun 13, 2023
    Configuration menu
    Copy the full SHA
    bc93a5e View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2023

  1. Added the spark etl document

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    0f518ad View commit details
    Browse the repository at this point in the history

  2. Added the spark etl document

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    3b20356 View commit details
    Browse the repository at this point in the history

  3. Added the spark etl document

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    03d4b0d View commit details
    Browse the repository at this point in the history

  4. Added the spark etl document

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    98b051c View commit details
    Browse the repository at this point in the history

  5. [Fix Bug]Fix spark mongo etl task execution failed

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    491e4fc View commit details
    Browse the repository at this point in the history

  6. Modify spark-etl.md

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    806582d View commit details
    Browse the repository at this point in the history

  7. Modify spark-etl.md

    @ChengJie1053
    ChengJie1053 committed Jun 15, 2023
    Configuration menu
    Copy the full SHA
    62a1731 View commit details
    Browse the repository at this point in the history

Commits on Jun 16, 2023

  1. Modify spark-etl.md

    @ChengJie1053
    ChengJie1053 committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    6140322 View commit details
    Browse the repository at this point in the history

  2. Modify spark-etl.md

    @ChengJie1053
    ChengJie1053 committed Jun 16, 2023
    Configuration menu
    Copy the full SHA
    b622a24 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2023

  1. Modify spark-etl.md

    @ChengJie1053
    ChengJie1053 committed Jun 27, 2023
    Configuration menu
    Copy the full SHA
    d3b138a View commit details
    Browse the repository at this point in the history