[kie-issues-249] Data index improvements #3241

elguardian · 2023-10-02T16:47:51Z

depends on apache/incubator-kie-drools#5529

elguardian · 2023-10-02T16:49:30Z

had to create new pr as the old one got stuck in the build

kie-ci3 · 2023-10-03T13:12:01Z

PR job #4 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/4/display/redirect

Test results:

PASSED: 3384
FAILED: 1

Those are the test failures:

org.kie.kogito.serverless.workflow.executor.StaticFluentWorkflowApplicationTest.testSwitchLoop

Process f6c8f278-11d9-49e0-b874-484f7e623c98 has not finished after PT2.5S

kie-ci3 · 2023-10-05T17:36:06Z

PR job #8 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/8/display/redirect

Test results:

PASSED: 3380
FAILED: 4

Those are the test failures:

org.kie.kogito.codegen.tests.PublishEventIT.testBasicUserTaskProcess

Expecting actual:
ProcessInstanceNodeDataEvent {specVersion=1.0, id='f34bdc18-d220-4dcd-8228-bab5561b6ed2', source=http://myhost/UserTasksProcess, type='ProcessInstanceNodeDataEvent', time=2023-10-05T13:19:20.632851Z, subject='null', dataContentType='application/json', dataSchema=null, data=ProcessInstanceNodeEventBody [eventDate=Thu Oct 05 13:19:20 UTC 2023, eventUser=null, eventType=1, processId=UserTasksProcess, processVersion=1.0, processInstanceId=2969d592-fa49-4489-bf19-c39e44382f94, connectionNodeInstanceId=null, nodeDefinitionId=EndEvent_1, nodeName=End Event 1, nodeType=EndNode, nodeInstanceId=c5f864fa-6529-4164-b84e-4551beb11b51, data={}], kogitoProcessInstanceId='2969d592-fa49-4489-bf19-c39e44382f94', kogitoRootProcessInstanceId='null', kogitoProcessId='UserTasksProcess', kogitoRootProcessId='null', kogitoAddons='test', kogitoIdentity='null', extensionAttributes={kogitoproctype=BPMN, kogitoprocinstanceid=2969d592-fa49-4489-bf19-c39e44382f94, kogitoprocist=1, kogitoprocversion=1.0, kogitoprocid=UserTasksProcess, kogitoaddons=test}}
to be an instance of:
org.kie.kogito.event.process.ProcessInstanceStateDataEvent
but was instance of:
org.kie.kogito.event.process.ProcessInstanceNodeDataEvent

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expected size: 1 but was: 3 in:
{"number"=6, "numberType"="even", "perfect"=false}

org.kie.kogito.quarkus.workflows.PojoServiceIT.testTypesPojo

Expected size: 9 but was: 3 in:
{"message"="my name is javierito and in my native language dog is translated to perro and the header pepe is pepa", "result"=4, "user"="anonymous"}

org.kie.kogito.quarkus.workflows.PojoServiceIT.testFilterPojo

Expected size: 1 but was: 3 in:
{"divisor"=2, "input"=[2, 4, 6, 8, 10], "output"=[2, 3, 4, 5, 6]}

kie-ci3 · 2023-10-06T18:30:40Z

PR job #9 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/9/display/redirect

Test results:

PASSED: 3383
FAILED: 3

Those are the test failures:

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expected size: 1 but was: 3 in:
{"number"=6, "numberType"="even", "perfect"=false}

org.kie.kogito.quarkus.workflows.PojoServiceIT.testTypesPojo

Expected size: 9 but was: 3 in:
{"message"="my name is javierito and in my native language dog is translated to perro and the header pepe is pepa", "result"=4, "user"="anonymous"}

org.kie.kogito.quarkus.workflows.PojoServiceIT.testFilterPojo

Expected size: 1 but was: 3 in:
{"divisor"=2, "input"=[2, 4, 6, 8, 10], "output"=[2, 3, 4, 5, 6]}

kie-ci3 · 2023-10-08T14:48:53Z

PR job #10 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/10/display/redirect

Test results:

PASSED: 3385
FAILED: 1

Those are the test failures:

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expecting value to be true but was false

kie-ci3 · 2023-10-08T20:26:19Z

PR job #11 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/11/display/redirect

Test results:

PASSED: 3311
FAILED: 1

Those are the test failures:

org.kie.kogito.quarkus.workflows.AsyncAPIIT.testConsumer

java.lang.RuntimeException: io.quarkus.builder.BuildException: Build failure: Build failed due to errors
[error]: Build step io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor#launchDatabases threw an exception: java.lang.RuntimeException: org.testcontainers.containers.ContainerLaunchException: Container startup failed
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:345)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.launchDatabases(DevServicesDatasourceProcessor.java:136)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at io.quarkus.deployment.ExtensionLoader$3.execute(ExtensionLoader.java:909)
at io.quarkus.builder.BuildContext.run(BuildContext.java:281)
at org.jboss.threads.ContextHandler$1.runWith(ContextHandler.java:18)
at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2449)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1478)
at java.base/java.lang.Thread.run(Thread.java:829)
at org.jboss.threads.JBossThread.run(JBossThread.java:501)
Caused by: org.testcontainers.containers.ContainerLaunchException: Container startup failed
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:349)
at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:322)
at io.quarkus.devservices.postgresql.deployment.PostgresqlDevServicesProcessor$1.startDatabase(PostgresqlDevServicesProcessor.java:65)
at io.quarkus.datasource.deployment.devservices.DevServicesDatasourceProcessor.startDevDb(DevServicesDatasourceProcessor.java:282)
... 12 more
Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88)
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:334)
... 15 more
Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:542)
at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:344)
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81)
... 16 more
Caused by: org.testcontainers.containers.ContainerLaunchException: Container startup failed
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:349)
at org.testcontainers.containers.GenericContainer.start(GenericContainer.java:322)
at org.testcontainers.utility.RyukResourceReaper.maybeStart(RyukResourceReaper.java:78)
at org.testcontainers.utility.RyukResourceReaper.register(RyukResourceReaper.java:68)
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:423)
... 18 more
Caused by: org.rnorth.ducttape.RetryCountExceededException: Retry limit hit with exception
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:88)
at org.testcontainers.containers.GenericContainer.doStart(GenericContainer.java:334)
... 22 more
Caused by: org.testcontainers.containers.ContainerLaunchException: Could not create/start container
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:542)
at org.testcontainers.containers.GenericContainer.lambda$doStart$0(GenericContainer.java:344)
at org.rnorth.ducttape.unreliables.Unreliables.retryUntilSuccess(Unreliables.java:81)
... 23 more
Caused by: com.github.dockerjava.api.exception.NotFoundException: Status 404: {"message":"No such image: testcontainers/ryuk:0.3.4"}

at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.execute(DefaultInvocationBuilder.java:241)
at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.post(DefaultInvocationBuilder.java:124)
at org.testcontainers.shaded.com.github.dockerjava.core.exec.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:37)
at org.testcontainers.shaded.com.github.dockerjava.core.exec.CreateContainerCmdExec.execute(CreateContainerCmdExec.java:13)
at org.testcontainers.shaded.com.github.dockerjava.core.exec.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:21)
at org.testcontainers.shaded.com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35)
at org.testcontainers.shaded.com.github.dockerjava.core.command.CreateContainerCmdImpl.exec(CreateContainerCmdImpl.java:608)
at org.testcontainers.containers.GenericContainer.tryStart(GenericContainer.java:427)
... 25 more

kie-ci3 · 2023-10-09T23:17:55Z

PR job #2 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/test/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/2/display/redirect

Test results:

PASSED: 3372
FAILED: 3

Those are the test failures:

org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure

Argument(s) are different! Wanted:
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceStateDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure(MongoDBEventPublisherTest.java:129)
Actual invocations have different arguments:
mongoDatabase.withCodecRegistry(
ProvidersCodecRegistry{codecProviders=[ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.Jep395RecordCodecProvider@22014338]}, ProvidersCodecRegistry{codecProviders=[org.kie.kogito.events.mongodb.codec.EventMongoDBCodecProvider@22ecee76, org.bson.codecs.pojo.PojoCodecProvider@905e189]}]}
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:69)
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:70)
mongoDatabase.getCollection(
"testTECollection",
class org.kie.kogito.event.usertask.UserTaskInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:71)

org.kie.kogito.tracing.QuarkusTracingAddonDevServicesIT.testEvaluateLoanEligibility

java.lang.RuntimeException: Failed to start quarkus

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expecting value to be true but was false

kie-ci3 · 2023-10-09T23:17:55Z

PR job #13 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/13/display/redirect

Test results:

PASSED: 3370
FAILED: 5

Those are the test failures:

org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure

Argument(s) are different! Wanted:
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceStateDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure(MongoDBEventPublisherTest.java:129)
Actual invocations have different arguments:
mongoDatabase.withCodecRegistry(
ProvidersCodecRegistry{codecProviders=[ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.Jep395RecordCodecProvider@22014338]}, ProvidersCodecRegistry{codecProviders=[org.kie.kogito.events.mongodb.codec.EventMongoDBCodecProvider@22ecee76, org.bson.codecs.pojo.PojoCodecProvider@905e189]}]}
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:69)
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:70)
mongoDatabase.getCollection(
"testTECollection",
class org.kie.kogito.event.usertask.UserTaskInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:71)

org.kie.kogito.process.definitions.ProcessDefinitionsResourceTest.testAddDefinition

java.lang.RuntimeException: Failed to start quarkus

org.kie.kogito.quarkus.serverless.workflow.deployment.livereload.LiveReloadProcessorTest.testGrpc

java.lang.RuntimeException: Failed to start quarkus

org.kie.kogito.quarkus.serverless.workflow.deployment.livereload.LiveReloadProcessorTest.testAsyncApi

java.lang.RuntimeException: Failed to start quarkus

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expecting value to be true but was false

kie-ci3 · 2023-10-10T12:49:22Z

PR job #15 was: UNSTABLE
Possible explanation: This should be test failures

Reproducer

build-chain build full_downstream -f 'https://raw.githubusercontent.com/${AUTHOR:apache}/incubator-kie-kogito-pipelines/${BRANCH:main}/.ci/buildchain-config-pr-cdb.yaml' -o 'bc' -p apache/incubator-kie-kogito-runtimes -u #3241 --skipParallelCheckout

NOTE: To install the build-chain tool, please refer to https://github.com/kiegroup/github-action-build-chain#local-execution

Please look here: https://ci-builds.apache.org/job/KIE/job/kogito/job/main/job/pullrequest_jobs/job/kogito-runtimes-pr/job/PR-3241/15/display/redirect

Test results:

PASSED: 3373
FAILED: 2

Those are the test failures:

org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure

Argument(s) are different! Wanted:
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceStateDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisherTest.configure(MongoDBEventPublisherTest.java:129)
Actual invocations have different arguments:
mongoDatabase.withCodecRegistry(
ProvidersCodecRegistry{codecProviders=[ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.Jep395RecordCodecProvider@42775280]}, ProvidersCodecRegistry{codecProviders=[org.kie.kogito.events.mongodb.codec.EventMongoDBCodecProvider@1cce2194, org.bson.codecs.pojo.PojoCodecProvider@51645204]}]}
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:69)
mongoDatabase.getCollection(
"testPICollection",
class org.kie.kogito.event.process.ProcessInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:70)
mongoDatabase.getCollection(
"testTECollection",
class org.kie.kogito.event.usertask.UserTaskInstanceDataEvent
);
-> at org.kie.kogito.events.mongodb.MongoDBEventPublisher.configure(MongoDBEventPublisher.java:71)

org.kie.kogito.quarkus.workflows.PojoServiceIT.testPojo

Expecting value to be true but was false

* [kie-issues-249] Data index improvements * fix pojo it kafka dirty streams * fix mongodb debezium * fix for codecs registry * fix for mongodb publisher

elguardian requested review from porcelli and pefernan October 2, 2023 16:49

elguardian force-pushed the kie-issues-249 branch from 7eb486a to 8649d2a Compare October 4, 2023 13:12

ricardozanini requested a review from krisv October 6, 2023 12:10

elguardian force-pushed the kie-issues-249 branch from 8649d2a to b1593f7 Compare October 6, 2023 13:33

elguardian added 4 commits October 10, 2023 09:44

[kie-issues-249] Data index improvements

9c02cda

fix pojo it kafka dirty streams

877d88c

fix mongodb debezium

1149ae6

fix for codecs registry

a518cb8

elguardian force-pushed the kie-issues-249 branch from 8347dec to a518cb8 Compare October 10, 2023 07:44

fix for mongodb publisher

8df1d1c

pefernan approved these changes Oct 13, 2023

View reviewed changes

martinweiler approved these changes Oct 18, 2023

View reviewed changes

porcelli approved these changes Oct 18, 2023

View reviewed changes

porcelli merged commit 70af322 into apache:main Oct 18, 2023
0 of 5 checks passed

elguardian deleted the kie-issues-249 branch October 19, 2023 06:42

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[kie-issues-249] Data index improvements #3241

[kie-issues-249] Data index improvements #3241

elguardian commented Oct 2, 2023

elguardian commented Oct 2, 2023

kie-ci3 commented Oct 3, 2023

kie-ci3 commented Oct 5, 2023

kie-ci3 commented Oct 6, 2023

kie-ci3 commented Oct 8, 2023

kie-ci3 commented Oct 8, 2023

kie-ci3 commented Oct 9, 2023

kie-ci3 commented Oct 9, 2023

kie-ci3 commented Oct 10, 2023

[kie-issues-249] Data index improvements #3241

[kie-issues-249] Data index improvements #3241

Conversation

elguardian commented Oct 2, 2023

elguardian commented Oct 2, 2023

kie-ci3 commented Oct 3, 2023

kie-ci3 commented Oct 5, 2023

kie-ci3 commented Oct 6, 2023

kie-ci3 commented Oct 8, 2023

kie-ci3 commented Oct 8, 2023

kie-ci3 commented Oct 9, 2023

kie-ci3 commented Oct 9, 2023

kie-ci3 commented Oct 10, 2023