Best practices for bulk queries

[betolink]

For cases where the results could potentially be in the 100s of thousands of items, what would be the recommended way of using rustac? in the normal API we could iterate over pages and deal with them one at the time to help with the memory footprint, with rustac I see a search_to_arrow, would this be more memory efficient that getting the results with the normal search? I'm not sure if a Python generator for "lazy loading" the results would be possible with the current architecture.

Thanks for the help!!

[gadomski]

Makes sense to me! No reason we can't provide that, we just haven't yet. I've opened #148 to track.

[gadomski]

Added iter_search in #151