Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature improve wind turbine #74

Open
wants to merge 7 commits into
base: develop
Choose a base branch
from
Open

Feature improve wind turbine #74

wants to merge 7 commits into from

Conversation

erdincka
Copy link
Collaborator

@erdincka erdincka commented Oct 6, 2023 •
edited
Loading

  • Updated section "Create a Spark Interactive Session" within the notebook with instructions to use SSO rather than Basic Auth.
  • Updated section "Training a GBT Regressor" within the notebook to use the running user's folder (that gets mounted to the pods) to avoid permission errors or to avoid overwriting other user's models.

Closes #73

Checklist:

  • I have checked that my enhancements are not duplicates of existing content changes or additions.
  • I have tested the changes in a working environment to ensure they function as intended.
  • I have followed the style guide
    outlined in the contribution guidelines.

Reviewer's Tasks (for maintainers reviewing this PR):

  • Verify that the tutorial functions correctly in a live environment.
  • Verify that the updated content aligns with the style guide
    in the contribution guidelines.
  • Check for consistency, grammar, and clarity throughout the updated content.
  • Check that the related GitHub issue is up-to-date.

Dimitris Poulopoulos and others added 6 commits October 3, 2023 17:30
@dpoulopoulos
feast: Add a README File
eb8fd0d 
Add a fresh README that:
- Describes the tutorial's focus.
- Outlines prerequisites for getting started.
- Guides users on execution.
- Includes a references section.

Signed-off-by: Dimitris Poulopoulos <[email protected]>
wind-turbine: Enhance the Notebook user experience
da01d6a 
Enhance the Notebook user experience by:
- Introducing a code cell to upload the dataset to its appropriate path
  prior to its use inside the Spark interactive session. This fixes the
  error where Spark tries to load the dataset from a location that does
  not exist.
- Refining Notebook annotations for a clearer tutorial flow.

Closes #64

Signed-off-by: Dimitris Poulopoulos <[email protected]>
wind-turbine: Remove the redundant Python script
39c0429 
Eliminate the reduntant Python script that duplicates the code from the
notebook, offering no additional value to this tutorial.

Signed-off-by: Dimitris Poulopoulos <[email protected]>
wind-turbine: Enhance the README File
1756611 
Enhance the README file by:
- Introducing a 'Procedure' section that walks the user through the
  necessary steps for a successful run.
- Incorporating a "How it Works" section that elucidates what Livy and
  Sparkmagic are, and how they collaboratively streamline interactions
  with a Spark cluster.
- Including a 'References' section, providing links for extended
  reading.

Signed-off-by: Dimitris Poulopoulos <[email protected]>
@erdincka
improve README
e288854
@erdincka
wind-turbine: update notebook for SSO and user
65091b2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Improve wind-turbine for multi-user run
2 participants
@erdincka @prasadadireddi