Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-1305528 : Adding lineage.trace API #1383

Closed
wants to merge 33 commits into from
Closed
Show file tree
Hide file tree
Changes from 24 commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
231d953
adding docs for df.analytics
sfc-gh-rsureshbabu Mar 23, 2024
ece5e7a
happy path working
sfc-gh-rsureshbabu Apr 12, 2024
c3fa088
changes
sfc-gh-rsureshbabu Apr 12, 2024
ad84276
merge from main
sfc-gh-rsureshbabu Apr 12, 2024
09b86df
new changes
sfc-gh-rsureshbabu Apr 13, 2024
daa8bf0
new changes
sfc-gh-rsureshbabu Apr 13, 2024
5a8dce9
add more tests
sfc-gh-rsureshbabu Apr 15, 2024
4f490fc
fix file header
sfc-gh-rsureshbabu Apr 15, 2024
ec73bac
updating documentation
sfc-gh-rsureshbabu Apr 16, 2024
f8cc6a0
cosmetic
sfc-gh-rsureshbabu Apr 16, 2024
1c2b307
add unit tests
sfc-gh-rsureshbabu Apr 18, 2024
8e36a54
change enum to class
sfc-gh-rsureshbabu Apr 18, 2024
5fcd532
add more tests
sfc-gh-rsureshbabu Apr 24, 2024
774286f
change node terminal logic
sfc-gh-rsureshbabu Apr 25, 2024
c8e140a
fix test
sfc-gh-rsureshbabu Apr 25, 2024
68949f1
fix function commnets
sfc-gh-rsureshbabu Apr 25, 2024
2390a3e
fix comment
sfc-gh-rsureshbabu Apr 25, 2024
1c4bbce
Merge branch 'main' into rsureshbabu-SNOW-1305528-apichanges
sfc-gh-rsureshbabu Apr 25, 2024
b8ceed2
support change in parent Name
sfc-gh-rsureshbabu Apr 25, 2024
d44068d
fix looping in graph
sfc-gh-rsureshbabu Apr 26, 2024
9969d30
changes
sfc-gh-rsureshbabu Apr 29, 2024
cc266b4
switch to BFS
sfc-gh-rsureshbabu Apr 29, 2024
8aac228
marking it as private preview
sfc-gh-rsureshbabu Apr 29, 2024
25e2da0
making default a macro
sfc-gh-rsureshbabu Apr 29, 2024
c47e1b9
fix docstring
sfc-gh-rsureshbabu Apr 30, 2024
54c903e
fix docstring
sfc-gh-rsureshbabu Apr 30, 2024
0fad8a8
test check
sfc-gh-rsureshbabu Apr 30, 2024
fa4f191
new changes
sfc-gh-rsureshbabu May 1, 2024
7500a1a
merge from main
sfc-gh-rsureshbabu May 1, 2024
4e08eee
tests
sfc-gh-rsureshbabu May 1, 2024
ad15023
fixted test
sfc-gh-rsureshbabu May 1, 2024
bd79e77
Revert "merge from main"
sfc-gh-rsureshbabu May 1, 2024
ffe6311
merge from main
sfc-gh-rsureshbabu May 1, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,6 +4,7 @@

### New Features
- Support stored procedure register with packages given as Python modules.
- Added snowflake.snowpark.Session.lineage.trace to explore data lineage of snowfake objects.

## 1.15.0 (2024-04-24)

Expand Down
1 change: 1 addition & 0 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,6 +27,7 @@ information, see the `Snowpark Developer Guide for Python <https://docs.snowflak
udtf
observability
files
lineage
context
exceptions

Expand Down
28 changes: 28 additions & 0 deletions docs/source/lineage.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
================
LINEAGE
================

.. automodule:: snowflake.snowpark.lineage
:noindex:


.. currentmodule:: snowflake.snowpark.lineage





.. rubric:: Classes

.. autosummary::
:toctree: api/

Lineage
LineageDirection

.. rubric:: Methods

.. autosummary::
:toctree: api/

~Lineage.trace
3 changes: 2 additions & 1 deletion docs/source/session.rst
Original file line number Diff line number Diff line change
Expand Up @@ -80,11 +80,12 @@ Snowpark Session
Session.custom_package_usage_config
Session.file
Session.query_tag
Session.lineage
Session.read
Session.sproc
Session.sql_simplifier_enabled
Session.telemetry_enabled
Session.udf
Session.udtf
Session.session_id
Session.connection
Session.connection
7 changes: 7 additions & 0 deletions src/snowflake/snowpark/_internal/error_message.py
Original file line number Diff line number Diff line change
Expand Up @@ -379,6 +379,13 @@ def SERVER_FAILED_FETCH_PANDAS(message: str) -> SnowparkFetchDataException:
error_code="1406",
)

@staticmethod
def SERVER_FAILED_FETCH_LINEAGE(message: str) -> SnowparkFetchDataException:
return SnowparkFetchDataException(
f"Failed to fetch a lineage information. The error is: {message}",
error_code="1406",
)

@staticmethod
def SERVER_UDF_UPLOAD_FILE_STREAM_CLOSED(
dest_filename: str,
Expand Down
Loading
Loading