-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Too many positional arguments #139
Open
apurvabanka
wants to merge
9
commits into
duneanalytics:v2
Choose a base branch
from
apurvabanka:too-many-positional-arguments
base: v2
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from 5 commits
Commits
Show all changes
9 commits
Select commit
Hold shift + click to select a range
a8780ff
.venv in gitignore
apurvabanka def7152
removing too-many-positional-arguments
apurvabanka 2afbf0e
changing function params
apurvabanka b07157d
Implemented classes for common params
apurvabanka 9d59e08
test cases updated
apurvabanka c168c60
requested changes
apurvabanka a919f61
removing build params
apurvabanka a88310f
too-many-positional-arguments
apurvabanka fd32e14
typo
apurvabanka File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -5,6 +5,7 @@ dist | |
_version.py | ||
.idea/ | ||
venv/ | ||
.venv/ | ||
tmp/ | ||
.vscode/ | ||
build/ | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,4 +1,4 @@ | ||
[MASTER] | ||
disable=fixme,logging-fstring-interpolation,too-many-positional-arguments | ||
disable=fixme,logging-fstring-interpolation | ||
[DESIGN] | ||
max-args=10 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -4,7 +4,7 @@ | |
""" | ||
|
||
from __future__ import annotations | ||
from typing import List, Optional | ||
from typing import Dict, Optional, Any | ||
|
||
from dune_client.api.base import BaseRouter | ||
from dune_client.models import ( | ||
|
@@ -25,12 +25,7 @@ def get_custom_endpoint_result( | |
self, | ||
handle: str, | ||
endpoint: str, | ||
limit: Optional[int] = None, | ||
offset: Optional[int] = None, | ||
columns: Optional[List[str]] = None, | ||
sample_count: Optional[int] = None, | ||
filters: Optional[str] = None, | ||
sort_by: Optional[List[str]] = None, | ||
params: Optional[Dict[str, Any]] = None, | ||
) -> ResultsResponse: | ||
""" | ||
Custom endpoints allow you to fetch and filter data from any | ||
|
@@ -48,17 +43,28 @@ def get_custom_endpoint_result( | |
filters (str, optional): The filters to apply. | ||
sort_by (List[str], optional): The columns to sort by. | ||
""" | ||
params = self._build_parameters( | ||
columns=columns, | ||
sample_count=sample_count, | ||
filters=filters, | ||
sort_by=sort_by, | ||
limit=limit, | ||
offset=offset, | ||
if params is None: | ||
params = {} | ||
limit = params.get("limit", None) | ||
offset = params.get("offset", None) | ||
columns = params.get("columns", None) | ||
sample_count = params.get("sample_counts", None) | ||
filters = params.get("filters", None) | ||
sort_by = params.get("sort_by", None) | ||
|
||
build_params = self._build_parameters( | ||
params={ | ||
"columns": columns, | ||
"sample_count": sample_count, | ||
"filters": filters, | ||
"sort_by": sort_by, | ||
"limit": limit, | ||
"offset": offset, | ||
} | ||
) | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. All of this should become unnecessary and all we will need to do is |
||
response_json = self._get( | ||
route=f"/endpoints/{handle}/{endpoint}/results", | ||
params=params, | ||
params=build_params, | ||
) | ||
try: | ||
return ResultsResponse.from_dict(response_json) | ||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -7,7 +7,7 @@ | |
""" | ||
|
||
from io import BytesIO | ||
from typing import Any, Dict, List, Optional | ||
from typing import Any, Dict, List, NamedTuple, Optional | ||
|
||
from deprecated import deprecated | ||
|
||
|
@@ -27,6 +27,19 @@ | |
from dune_client.query import QueryBase | ||
|
||
|
||
class GetExecutionResultsParams(NamedTuple): | ||
""" | ||
Parameters for get execution result functions | ||
""" | ||
|
||
limit: Optional[int] = None | ||
columns: Optional[List[str]] = None | ||
sample_count: Optional[int] = None | ||
filters: Optional[str] = None | ||
sort_by: Optional[List[str]] = None | ||
offset: Optional[int] = None | ||
|
||
|
||
class ExecutionAPI(BaseRouter): | ||
""" | ||
Query execution and result fetching functions. | ||
|
@@ -75,38 +88,30 @@ def get_execution_status(self, job_id: str) -> ExecutionStatusResponse: | |
def get_execution_results( | ||
self, | ||
job_id: str, | ||
limit: Optional[int] = None, | ||
offset: Optional[int] = None, | ||
columns: Optional[List[str]] = None, | ||
sample_count: Optional[int] = None, | ||
filters: Optional[str] = None, | ||
sort_by: Optional[List[str]] = None, | ||
params: Optional[GetExecutionResultsParams] = None, | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Hey, ya you did it here. |
||
allow_partial_results: str = "true", | ||
) -> ResultsResponse: | ||
"""GET results from Dune API for `job_id` (aka `execution_id`)""" | ||
params = self._build_parameters( | ||
columns=columns, | ||
sample_count=sample_count, | ||
filters=filters, | ||
sort_by=sort_by, | ||
limit=limit, | ||
offset=offset, | ||
allow_partial_results=allow_partial_results, | ||
) | ||
build_params = None | ||
if params is not None: | ||
build_params = self._build_parameters( | ||
allow_partial_results=allow_partial_results, | ||
params={ | ||
"columns": params.columns, | ||
"sample_count": params.sample_count, | ||
"filters": params.filters, | ||
"sort_by": params.sort_by, | ||
"limit": params.limit, | ||
"offset": params.offset, | ||
}, | ||
) | ||
|
||
route = f"/execution/{job_id}/results" | ||
url = self._route_url(route) | ||
return self._get_execution_results_by_url(url=url, params=params) | ||
return self._get_execution_results_by_url(url=url, params=build_params) | ||
|
||
def get_execution_results_csv( | ||
self, | ||
job_id: str, | ||
limit: Optional[int] = None, | ||
offset: Optional[int] = None, | ||
columns: Optional[List[str]] = None, | ||
filters: Optional[str] = None, | ||
sample_count: Optional[int] = None, | ||
sort_by: Optional[List[str]] = None, | ||
self, job_id: str, params: Optional[GetExecutionResultsParams] = None | ||
) -> ExecutionResultCSV: | ||
""" | ||
GET results in CSV format from Dune API for `job_id` (aka `execution_id`) | ||
|
@@ -115,18 +120,22 @@ def get_execution_results_csv( | |
use this method for large results where you want lower CPU and memory overhead | ||
if you need metadata information use get_results() or get_status() | ||
""" | ||
params = self._build_parameters( | ||
columns=columns, | ||
sample_count=sample_count, | ||
filters=filters, | ||
sort_by=sort_by, | ||
limit=limit, | ||
offset=offset, | ||
) | ||
build_params = None | ||
if params is not None: | ||
build_params = self._build_parameters( | ||
params={ | ||
"columns": params.columns, | ||
"sample_count": params.sample_count, | ||
"filters": params.filters, | ||
"sort_by": params.sort_by, | ||
"limit": params.limit, | ||
"offset": params.offset, | ||
} | ||
) | ||
bh2smith marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
||
route = f"/execution/{job_id}/results/csv" | ||
url = self._route_url(route) | ||
return self._get_execution_results_csv_by_url(url=url, params=params) | ||
return self._get_execution_results_csv_by_url(url=url, params=build_params) | ||
|
||
def _get_execution_results_by_url( | ||
self, url: str, params: Optional[Dict[str, Any]] = None | ||
|
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
A good way to start here would be, create the proposed data class and put it here as optional.
See how the function needs to be changed because of the replacement...
Actually, I just noticed this is _build_parameters... This will likely be replaces with a method like
to_dict
on the class itself. The data class can implement bothto_dict
andfrom_dict
(this might come for free with the @DataClass decorator although I can't remember).Nit: It looks like you forgot to include
allow_partial_results
here, but I really think this_build_parameters
function will no longer be necessary once this class is in place.