Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read_parquet err handling + examples #438

Closed
wants to merge 5 commits into from
Closed

Conversation

sorhawell
Copy link
Collaborator

No description provided.

@sorhawell sorhawell changed the title WIP: read_parquet err handling + examples read_parquet err handling + examples Oct 23, 2023
@@ -73,9 +96,26 @@ pl$read_parquet = function(
row_count_name = NULL,
row_count_offset = 0L,
low_memory = FALSE) {

#construct a derived call
mc = match.call()
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@etiennebacher Interesting using quote + eval instead ..., I have not thought of that. What would be the pros and cons?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I agree scan_parquet needs a bigger overhaul. I would try to do that in separate PR.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This quote + eval() was already done in $read_csv(), so I just took it there but I'm not the one who implemented it. I can't think of cons for now

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@eitsupi what do you think pros and cons of using ... vs match/eval ?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't really understand the intent of your question, but I think match.call is more convenient here since using ... as a function argument has the disadvantage that auto-complete cannot be used.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sry my bad, I blame the fever :)

@@ -14,7 +14,23 @@
#' @name scan_parquet
#' @rdname IO_scan_parquet
#' @examples
#' # TODO write parquet example
#' #write example file
#' my_parquet = tempfile(fileext = ".parquet")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Isn't it necessary to add processing to delete temporary files?
Also, is an extension necessary?

@sorhawell
Copy link
Collaborator Author

superseded by #492

@sorhawell sorhawell closed this Nov 9, 2023
@eitsupi eitsupi deleted the read_parquet_rpolarserr branch November 18, 2023 10:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants