Python path dependency crashing on NixOS

[niftynei]

I compile, build, and deploy CLN from NixOS. Updating to the latest version crashes, as there's no python3 system runtime available on NixOS.

Kinda assuming this is related to us now packaging a python plugin with the project? /usr/bin/env doesn't work for NixOS systems (i'm using fetchFromGithub to compile and build the latest version).

Having a dependency on a system available python path at runtime is really hard to accommodate on NixOS fwiw, we might need to rethink how we're packaging/distributing this plugin to make it compatible (or find a Nix expert).

Fixed by: disabling clnrest eg. disable-plugin=clnrest.py

Aug 29 16:53:40 citrine lightningd[1193376]: /usr/bin/env: 'python3': No such file or directory
Aug 29 16:53:40 citrine lightningd[1193356]: lightningd: lightningd/plugin.c:1912: plugins_init: Assertion `ret == plugins' failed.
Aug 29 16:53:40 citrine lightningd[1193356]: lightningd: FATAL SIGNAL 6 (version v23.08)
Aug 29 16:53:40 citrine lightningd[1193356]: 0x47e3f9 send_backtrace
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x47e493 crashdump
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a3dbef ???
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a8abc7 __pthread_kill_implementation
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a3db45 gsignal
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a284b4 abort
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a283d8 __assert_fail_base.cold.0
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a367b5 __assert_fail
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x450cec plugins_init
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x406182 main
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a2924d __libc_start_call_main
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x7f88c7a29308 __libc_start_main_impl
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0x408cb4 _start
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0
Aug 29 16:53:40 citrine lightningd[1193356]: 0xffffffffffffffff ???
Aug 29 16:53:40 citrine lightningd[1193356]:         ???:0

[vincenzopalazzo]

OK I reproduced also on the fedimint CI, we should fix this

This is the nix conf and to me looks good https://raw.githubusercontent.com/NixOS/nixpkgs/nixos-23.05/pkgs/applications/blockchains/clightning/default.nix

[vincenzopalazzo]

OK this should be the one that will go to fix it NixOS/nixpkgs#253310

[chrisguida]

Made a patch here that fixes NixOS/nixpkgs#253539

clnrest still doesn't start, but at least it doesn't take down your whole node.

we need to convert clnrest to poetry so we can use https://github.com/nix-community/poetry2nix

otherwise the dependencies are very difficult to install, especially pyln-client and its dependencies which aren't packaged for nix