Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration test #49

Conversation

dada-dell-emc
Copy link
Contributor

Change log description
Added end to end integration test case for PSC.
Purpose of the change
Test PSC functionality end to end integrating with Pravega using ingestion files no mock.
What the code does
It start pravega related services at the start of test setup, after that as a part of test case testRawFile it copies test ingestion files into respective directory from where PSC reads it and sends data to pravega. Test case checks that after 40-50 secs from start does database updates with completed files, if it does, then it waits another 50 secs to execute delete completed files tasks, once that wait is over test case checks completed files records from DB got deleted or not. This tests end to end PSC functionality.
How to verify it
Run all or particular test case(i.e. PravegaSensorCollectorIntegrationTests.testRawFile), it passes every time with in 1.5-2 mins.
What tests you have run. (Manually, automated whatever). How can someone else test this?
Follow steps mentioned above.

Copy link
Contributor

@sachin-j-joshi sachin-j-joshi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good overall. Left some comments regarding the order and sleeps.

Copy link
Contributor

@sachin-j-joshi sachin-j-joshi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

long getDeleteCompletedFilesIntervalInMinutes() {
return Long.parseLong(getProperty(DELETE_COMPLETED_FILES_INTERVAL_IN_MINUTES_KEY, "720"));
long getDeleteCompletedFilesIntervalInSeconds() {
return Long.parseLong(getProperty(DELETE_COMPLETED_FILES_INTERVAL_IN_SECONDS_KEY, "43200"));

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it like are we trying to delete completed file every 12 hours? @dada-dell-emc

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes

@@ -13,11 +13,12 @@ commonsCLIVersion=1.4
commonsCSVVersion=1.8
commonsCodecVersion=1.14
commonsMath3Version=3.6.1
grizzlyVersion=3.1.3
grizzlyVersion=2.35

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why we are going to lower version here @dada-dell-emc ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because of higher version there is conflicting versions dependency on glassfish library.

Copy link
Contributor

@abhinb abhinb left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@abhinb abhinb merged commit 028f47f into pravega:stability-improvements-v2 Feb 13, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants