Skip to content

[FEA]: Use rapidsmpf's streaming read_parquet node in cudf-polars #20338

@TomAugspurger

Description

@TomAugspurger

Is your feature request related to a problem? Please describe.

rapidsai/rapidsmpf#574 is adding a dedicated streaming read_parquet node. Currently, #20161 requires a Python node to drive the pylibcudf read_parquet calls. We ought to be able to drop in the rapidsmpf node once it's availble.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions