Use asv instead of pytest-benchmark

[ricardoV94]

Description

Seems more powerful and well maintained

https://asv.readthedocs.io/en/latest/using.html

[ricardoV94]

Here is a github job that fails the CI when performance degrades too much: https://github.com/datalad/datalad/blob/f6de2f22612f29868a6e2067f83b1f7753e52d4d/.github/workflows/benchmarks.yml

[ricardoV94]

Would be great to setup the gh-pages to visualize performance over time

[williambdean]

Heard about this https://docs.codspeed.io/benchmarks/python
Free for opensource and would have a web interface
Maybe similar thing to codecov

[ricardoV94]

Heard about this https://docs.codspeed.io/benchmarks/python Free for opensource and would have a web interface Maybe similar thing to codecov

How does the interface look like?