Skip to content

Commit

Permalink
changes based on feedback
Browse files Browse the repository at this point in the history
  • Loading branch information
r-brink committed Jan 22, 2024
1 parent 753891d commit 6ed0e96
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/user-guide/misc/comparison.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,9 @@ In contrast, Polars is optimised for high-performance multithreaded computing on

Dask extends Pandas' capabilities to large, distributed datasets. Dask mimics Pandas' API, offering a familiar environment for Pandas users, but with the added benefit of parallel and distributed computing.

While Dask excels in scaling Pandas workflows across clusters, Polars offers superior performance for data processing tasks that can be handled within the constraints of a single node. The choice between Dask and Polars often hinges on the familiarity with the Pandas API and the need for distributed processing for extremely large datasets versus the need for speed and efficiency in a vertical scaled environment.
While Dask excels at scaling Pandas workflows across clusters, it only supports a subset of the Pandas API and therefore cannot be used for all use cases. Polars offers a more versatile API that delivers strong performance within the constraints of a single node.

The choice between Dask and Polars often comes down to familiarity with the Pandas API and the need for distributed processing for extremely large datasets versus the need for efficiency and speed in a vertically scaled environment for a wide range of use cases.

### Modin

Expand Down

0 comments on commit 6ed0e96

Please sign in to comment.