Skip to content

[Python] Pyarrow csv reader : ability to specify a max number of rows to read #48695

@simonaubertbd

Description

@simonaubertbd

Describe the enhancement requested

Exactly as in the title :
The ability for Pyarrow csv reader to specify a max number of rows to read.

it's possible with other engines on Pandas but not with pyarrow. (see nrows)
https://pandas.pydata.org/docs/dev/reference/api/pandas.read_csv.html

And as a general enhancement, covering all the pandas option would be great

Edit : note that also exists on Polars : https://docs.pola.rs/api/python/dev/reference/api/polars.read_csv.html

Best regards,

Simon

Component(s)

Python

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions