[BUG-REPORT] Missing *py3*.whl in PyPI blocks use of vaex with pyodide

[enageshwari]

Hi, Missing py3.whl in PyPI blocking the use of vaex with pyodide. Pls check below references and assist. Thanks.

Ref
[1] https://pypi.org/project/vaex-core/#files
[2] https://pypi.org/project/numpy/#files
[3] https://pyodide.org/en/stable/usage/faq.html#micropip-can-t-find-a-pure-python-wheel

[enageshwari]

To build a whl/wheel pkg

https://packaging.python.org/en/latest/tutorials/packaging-projects/#generating-distribution-archives

[enageshwari]

Getting below error while generating whl

In file included from src/vaexfast.cpp:31:
In file included from /private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/lib/python3.9/site-packages/numpy/core/include/numpy/arrayobject.h:5:
In file included from /private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/lib/python3.9/site-packages/numpy/core/include/numpy/ndarrayobject.h:12:
In file included from /private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/lib/python3.9/site-packages/numpy/core/include/numpy/ndarraytypes.h:1929:
/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/lib/python3.9/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: "Using deprecated NumPy API, disable it with " "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-W#warnings]
17 | #warning "Using deprecated NumPy API, disable it with "
| ^
src/vaexfast.cpp:743:2: warning: '/*' within block comment [-Wcomment]
743 | /**/
| ^
src/vaexfast.cpp:665:12: warning: unused variable 'i_x' [-Wunused-variable]
665 | long long i_x = offset_x;
| ^~~
src/vaexfast.cpp:666:12: warning: unused variable 'i_y' [-Wunused-variable]
666 | long long i_y = offset_y;
| ^~~
4 warnings generated.
clang++ -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -Wno-error=unreachable-code -bundle -undefined dynamic_lookup -arch arm64 -arch x86_64 build/temp.macosx-10.9-universal2-cpython-39/src/vaexfast.o -o build/lib.macosx-10.9-universal2-cpython-39/vaex/vaexfast.cpython-39-darwin.so
building 'vaex.superstrings' extension
clang++ -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -iwithsysroot/System/Library/Frameworks/System.framework/PrivateHeaders -iwithsysroot/Applications/Xcode.app/Contents/Developer/Library/Frameworks/Python3.framework/Versions/3.9/Headers -arch arm64 -arch x86_64 -Werror=implicit-function-declaration -Wno-error=unreachable-code -I/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/lib/python3.9/site-packages/numpy/core/include -Ivendor/pybind11/include -Ivendor/pybind11/include -Ivendor/string-view-lite/include -Ivendor/boost -I/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/include -I/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/Library/include -I/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-via-sdist-uxywj_wv/vaex_core-4.18.1/vendor/pcre/Library/include -I/private/var/folders/24/bd_x1h4938s19605xl2w70nr0000gr/T/build-env-0vsgepat/include -I/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.9/include/python3.9 -c src/string_utils.cpp -o build/temp.macosx-10.9-universal2-cpython-39/src/string_utils.o -std=c++11 -O3 -funroll-loops -Werror=return-type -Wno-unused-parameter -g -DNDEBUG -mmacosx-version-min=10.9
In file included from src/string_utils.cpp:3:
src/string_utils.hpp:2:10: fatal error: 'nonstd/string_view.hpp' file not found
2 | #include <nonstd/string_view.hpp>
| ^~~~~~~~~~~~~~~~~~~~~~~~
1 error generated.
error: command '/usr/bin/clang++' failed with exit code 1

ERROR Backend subprocess exited when trying to invoke build_wheel

[enageshwari]

As vaex is not a pure python pakage (See language distribution in vaex's github page), we may need to follow different strategy for building wheel. Explore bdist_wheel, cibuildwheel next.

[ddelange]

vaex-core uses cibuildwheel: https://github.com/vaexio/vaex/blob/core-v4.18.1/.github/workflows/wheel.yml

see wheels here: https://pypi.org/project/vaex-core/4.18.1/#files

the other packages (vaex, vaex-ml, etc) have pure python wheels.