macOS Catalina 10.15.6 install from source leaves missing lightningd exec

[Fonta1n3]

Building from source on macOS Catalina 10.15.6 seems to compile fine but in lightning/lightningd no exec binaries are present and everything else is.

After building c-lightning (as per below log and install.md guide) when I run lightning/lightningd ls -laG it outputs:

drwxr-xr-x  81 user  staff   2592 Sep 25 18:20 .
drwxr-xr-x  94 user  staff   3008 Sep 25 18:20 ..
-rw-r--r--   1 user  staff    159 Sep 25 18:20 .gitignore
-rw-r--r--   1 user  staff   3911 Sep 25 18:20 Makefile
-rw-r--r--   1 user  staff  26421 Sep 25 18:20 bitcoind.c
-rw-r--r--   1 user  staff   5208 Sep 25 18:20 bitcoind.h
-rw-r--r--   1 user  staff  35913 Sep 25 18:20 chaintopology.c
-rw-r--r--   1 user  staff   7037 Sep 25 18:20 chaintopology.h
-rw-r--r--   1 user  staff  15173 Sep 25 18:20 channel.c
-rw-r--r--   1 user  staff   8691 Sep 25 18:20 channel.h
-rw-r--r--   1 user  staff  26434 Sep 25 18:20 channel_control.c
-rw-r--r--   1 user  staff   1185 Sep 25 18:20 channel_control.h
-rw-r--r--   1 user  staff    857 Sep 25 18:20 channel_state.h
-rw-r--r--   1 user  staff   9802 Sep 25 18:20 closing_control.c
-rw-r--r--   1 user  staff    414 Sep 25 18:20 closing_control.h
-rw-r--r--   1 user  staff   2382 Sep 25 18:20 coin_mvts.c
-rw-r--r--   1 user  staff   1116 Sep 25 18:20 coin_mvts.h
-rw-r--r--   1 user  staff  10819 Sep 25 18:20 connect_control.c
-rw-r--r--   1 user  staff    630 Sep 25 18:20 connect_control.h
-rw-r--r--   1 user  staff  30277 Sep 25 18:20 dual_open_control.c
-rw-r--r--   1 user  staff    302 Sep 25 18:20 dual_open_control.h
-rw-r--r--   1 user  staff  20678 Sep 25 18:20 gossip_control.c
-rw-r--r--   1 user  staff    508 Sep 25 18:20 gossip_control.h
-rw-r--r--   1 user  staff   7190 Sep 25 18:20 gossip_msg.c
-rw-r--r--   1 user  staff   1805 Sep 25 18:20 gossip_msg.h
-rw-r--r--   1 user  staff   4656 Sep 25 18:20 hsm_control.c
-rw-r--r--   1 user  staff    691 Sep 25 18:20 hsm_control.h
-rw-r--r--   1 user  staff   9419 Sep 25 18:20 htlc_end.c
-rw-r--r--   1 user  staff   4954 Sep 25 18:20 htlc_end.h
-rw-r--r--   1 user  staff   6199 Sep 25 18:20 htlc_set.c
-rw-r--r--   1 user  staff   1607 Sep 25 18:20 htlc_set.h
-rw-r--r--   1 user  staff  45963 Sep 25 18:20 invoice.c
-rw-r--r--   1 user  staff   1205 Sep 25 18:20 invoice.h
-rw-r--r--   1 user  staff   1126 Sep 25 18:20 io_loop_with_timers.c
-rw-r--r--   1 user  staff    251 Sep 25 18:20 io_loop_with_timers.h
-rw-r--r--   1 user  staff   3350 Sep 25 18:20 json.c
-rw-r--r--   1 user  staff   1582 Sep 25 18:20 json.h
-rw-r--r--   1 user  staff  37560 Sep 25 18:20 jsonrpc.c
-rw-r--r--   1 user  staff   6567 Sep 25 18:20 jsonrpc.h
-rw-r--r--   1 user  staff  40178 Sep 25 18:20 lightningd.c
-rw-r--r--   1 user  staff   8066 Sep 25 18:20 lightningd.h
-rw-r--r--   1 user  staff  23823 Sep 25 18:20 log.c
-rw-r--r--   1 user  staff   3138 Sep 25 18:20 log.h
-rw-r--r--   1 user  staff   1283 Sep 25 18:20 log_status.c
-rw-r--r--   1 user  staff    384 Sep 25 18:20 log_status.h
-rw-r--r--   1 user  staff   8736 Sep 25 18:20 memdump.c
-rw-r--r--   1 user  staff    663 Sep 25 18:20 memdump.h
-rw-r--r--   1 user  staff  15349 Sep 25 18:20 notification.c
-rw-r--r--   1 user  staff   3172 Sep 25 18:20 notification.h
-rw-r--r--   1 user  staff  22562 Sep 25 18:20 onchain_control.c
-rw-r--r--   1 user  staff    536 Sep 25 18:20 onchain_control.h
-rw-r--r--   1 user  staff  11615 Sep 25 18:20 onion_message.c
-rw-r--r--   1 user  staff    359 Sep 25 18:20 onion_message.h
-rw-r--r--   1 user  staff   4159 Sep 25 18:20 opening_common.c
-rw-r--r--   1 user  staff   2692 Sep 25 18:20 opening_common.h
-rw-r--r--   1 user  staff  36756 Sep 25 18:20 opening_control.c
-rw-r--r--   1 user  staff    762 Sep 25 18:20 opening_control.h
-rw-r--r--   1 user  staff  47223 Sep 25 18:20 options.c
-rw-r--r--   1 user  staff    602 Sep 25 18:20 options.h
-rw-r--r--   1 user  staff  50123 Sep 25 18:20 pay.c
-rw-r--r--   1 user  staff   1306 Sep 25 18:20 pay.h
-rw-r--r--   1 user  staff  73958 Sep 25 18:20 peer_control.c
-rw-r--r--   1 user  staff   3060 Sep 25 18:20 peer_control.h
-rw-r--r--   1 user  staff  78153 Sep 25 18:20 peer_htlcs.c
-rw-r--r--   1 user  staff   3343 Sep 25 18:20 peer_htlcs.h
-rw-r--r--   1 user  staff   3617 Sep 25 18:20 ping.c
-rw-r--r--   1 user  staff    241 Sep 25 18:20 ping.h
-rw-r--r--   1 user  staff  49450 Sep 25 18:20 plugin.c
-rw-r--r--   1 user  staff  10413 Sep 25 18:20 plugin.h
-rw-r--r--   1 user  staff   7201 Sep 25 18:20 plugin_control.c
-rw-r--r--   1 user  staff    605 Sep 25 18:20 plugin_control.h
-rw-r--r--   1 user  staff  11665 Sep 25 18:20 plugin_hook.c
-rw-r--r--   1 user  staff   7957 Sep 25 18:20 plugin_hook.h
-rw-r--r--   1 user  staff   3646 Sep 25 18:20 routehint.c
-rw-r--r--   1 user  staff   1367 Sep 25 18:20 routehint.h
-rw-r--r--   1 user  staff   8574 Sep 25 18:20 signmessage.c
-rw-r--r--   1 user  staff  22660 Sep 25 18:20 subd.c
-rw-r--r--   1 user  staff   7519 Sep 25 18:20 subd.h
drwxr-xr-x   7 user  staff    224 Sep 25 18:20 test
-rw-r--r--   1 user  staff   7883 Sep 25 18:20 watch.c
-rw-r--r--   1 user  staff   2949 Sep 25 18:20 watch.h

Full log output:

Cloning into 'lightning'...
Note: switching to 'tags/v0.9.1'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at 817a7533d Ready for release!
Requirement already up-to-date: pip in /usr/local/lib/python3.8/site-packages (20.2.3)
Requirement already satisfied: mako in /usr/local/lib/python3.8/site-packages (1.1.3)
Requirement already satisfied: MarkupSafe>=0.9.2 in /usr/local/lib/python3.8/site-packages (from mako) (1.1.1)
-n Compiling ccan/tools/configurator/configurator...
done
Making autoconf users comfortable... yes
checking for off_t is 32 bits... no
checking for __alignof__ support... yes
checking for asprintf() declaration... yes
checking for __attribute__((cold)) support... yes
checking for __attribute__((const)) support... yes
checking for __attribute__((deprecated)) support... no
checking for __attribute__((nonnull)) support... yes
checking for __attribute__((sentinel)) support... yes
checking for __attribute__((pure)) support... yes
checking for __attribute__((may_alias)) support... yes
checking for __attribute__((noreturn)) support... yes
checking for __attribute__ format printf support... yes
checking for __attribute__((unused)) support... yes
checking for __attribute__((used)) support... yes
checking for backtrace() in <execinfo.h>... yes
checking for big endian... no
checking for <byteswap.h>... no
checking for __builtin_choose_expr support... yes
checking for __builtin_clz support... yes
checking for __builtin_clzl support... yes
checking for __builtin_clzll support... yes
checking for __builtin_ctz support... yes
checking for __builtin_ctzl support... yes
checking for __builtin_ctzll support... yes
checking for __builtin_constant_p support... yes
checking for __builtin_expect support... yes
checking for __builtin_ffs support... yes
checking for __builtin_ffsl support... yes
checking for __builtin_ffsll support... yes
checking for __builtin_popcount support... yes
checking for __builtin_popcountl support... yes
checking for __builtin_popcountll support... yes
checking for __builtin_types_compatible_p support... yes
checking for <intrinsics.h>... no
checking for struct timespec declaration... yes
checking for clock_gettime() declaration... yes
checking for compound literal support... yes
checking for fchdir support... yes
checking for <err.h>... yes
checking for for loop declaration support... yes
checking for flexible array member support... yes
checking for getpagesize() in <unistd.h>... yes
checking for isblank() in <ctype.h>... yes
checking for little endian... yes
checking for memmem in <string.h>... yes
checking for memrchr in <string.h>... no
checking for mmap() declaration... yes
checking for /proc/self/maps exists... no
checking for qsort_r cmp takes trailing arg... no
checking for __attribute__((section)) and __start/__stop... no
checking for stack grows upwards... no
checking for statement expression support... yes
checking for <sys/filio.h>... yes
checking for <sys/termios.h>... yes
checking for <sys/unistd.h>... yes
checking for __typeof__ support... yes
checking for unaligned access to int... yes
checking for utime() declaration... yes
checking for __attribute__((warn_unused_result))... yes
checking for #pragma omp and -fopenmp support... no
checking for <valgrind/memcheck.h>... no
checking for working <ucontext.h... no
checking for __builtin_cpu_supports()... yes
checking for libsodium with IETF chacha20 variants... yes
checking for sqlite3_expanded_sql... yes
checking for sqlite3... yes
checking for postgres... no
checking for compiler is GCC... no
checking for GCC version is 7 or above... no
checking for pwritev() defined... no
Writing variables to config.vars.89103... yes
Writing header to ccan/config.h... yes
-n checking for python3-mako...
found
Setting PREFIX... /usr/local
Setting CC... cc
Setting CONFIGURATOR_CC... cc
Setting CWARNFLAGS... -Wall -Wundef -Wmissing-prototypes -Wmissing-declarations -Wstrict-prototypes -Wold-style-definition -Werror
Setting CDEBUGFLAGS... -std=gnu11 -g -fstack-protector
Setting COPTFLAGS... -Og
SQLITE3_CFLAGS not found
Setting SQLITE3_LDLIBS... -lsqlite3
POSTGRES_INCLUDE not found
POSTGRES_LDLIBS not found
Setting VALGRIND... 0
Setting DEVELOPER... 0
Setting EXPERIMENTAL_FEATURES... 0
Setting COMPAT... 1
PYTEST not found
Setting STATIC... 0
Setting ASAN... 0
Setting TEST_NETWORK... regtest
Setting HAVE_PYTHON3_MAKO... 1
CC: cc -I/usr/local/opt/sqlite/include -DBINTOPKGLIBEXECDIR="../libexec/c-lightning" -Wall -Wundef -Wmissing-prototypes -Wmissing-declarations -Wstrict-prototypes -Wold-style-definition -Werror -std=gnu11 -g -fstack-protector -Og -I ccan -I external/libwally-core/include/ -I external/libwally-core/src/secp256k1/include/ -I external/jsmn/ -I external/libbacktrace/ -I external/gheap/ -I external/x86_64-apple-darwin19.6.0/libbacktrace-build -I . -I/usr/local/include      -DSHACHAIN_BITS=48 -DJSMN_PARENT_LINKS  -DCOMPAT_V052=1 -DCOMPAT_V060=1 -DCOMPAT_V061=1 -DCOMPAT_V062=1 -DCOMPAT_V070=1 -DCOMPAT_V072=1 -DCOMPAT_V073=1 -DCOMPAT_V080=1 -DCOMPAT_V081=1 -DCOMPAT_V082=1 -DCOMPAT_V090=1 -DBUILD_ELEMENTS=1 -c -o
LD: cc -L/usr/local/opt/sqlite/lib   -Og  config.vars  -Lexternal/x86_64-apple-darwin19.6.0 -lwallycore -lsecp256k1 -ljsmn -lbacktrace -L/usr/local/lib -lm -lgmp -lsqlite3 -lz  -lsodium -o
/bin/sh: sha256sum: command not found
wiregen hsmd/hsmd_wiregen.h
/bin/sh: sha256sum: command not found
cc ccan/ccan/cdump/tools/cdump-enumstr.c
cc ccan/ccan/cdump/cdump.c
cc ccan/ccan/strmap/strmap.c
cc ccan/ccan/asort/asort.c
cc ccan/ccan/autodata/autodata.c
cc ccan/ccan/bitmap/bitmap.c
cc ccan/ccan/bitops/bitops.c
cc ccan/ccan/breakpoint/breakpoint.c
cc ccan/ccan/crc32c/crc32c.c
cc ccan/ccan/crypto/hmac_sha256/hmac_sha256.c
cc ccan/ccan/crypto/hkdf_sha256/hkdf_sha256.c
cc ccan/ccan/crypto/ripemd160/ripemd160.c
cc ccan/ccan/crypto/sha256/sha256.c
cc ccan/ccan/crypto/shachain/shachain.c -DSHACHAIN_BITS=48
cc ccan/ccan/crypto/siphash24/siphash24.c
cc ccan/ccan/err/err.c
cc ccan/ccan/fdpass/fdpass.c
cc ccan/ccan/htable/htable.c
cc ccan/ccan/ilog/ilog.c
cc ccan/ccan/io/io.c
cc ccan/ccan/intmap/intmap.c
cc ccan/ccan/io/poll.c
cc ccan/ccan/io/fdpass/fdpass.c
cc ccan/ccan/isaac/isaac.c
cc ccan/ccan/isaac/isaac64.c
cc ccan/ccan/json_escape/json_escape.c
cc ccan/ccan/json_out/json_out.c
cc ccan/ccan/list/list.c
cc ccan/ccan/mem/mem.c
cc ccan/ccan/membuf/membuf.c
cc ccan/ccan/noerr/noerr.c
cc ccan/ccan/opt/helpers.c
cc ccan/ccan/opt/parse.c
cc ccan/ccan/opt/usage.c
cc ccan/ccan/opt/opt.c
cc ccan/ccan/pipecmd/pipecmd.c
cc ccan/ccan/ptr_valid/ptr_valid.c
cc ccan/ccan/rbuf/rbuf.c
cc ccan/ccan/read_write_all/read_write_all.c
cc ccan/ccan/str/base32/base32.c
cc ccan/ccan/str/hex/hex.c
cc ccan/ccan/str/str.c
cc ccan/ccan/take/take.c
cc ccan/ccan/tal/grab_file/grab_file.c
cc ccan/ccan/tal/link/link.c
cc ccan/ccan/tal/path/path.c
cc ccan/ccan/tal/str/str.c
cc ccan/ccan/tal/tal.c
cc ccan/ccan/time/time.c
cc ccan/ccan/timer/timer.c
cc ccan/ccan/utf8/utf8.c
Reinitializing submodules external/libsodium external/libwally-core external/gheap external/jsmn external/libbacktrace ...
Submodule 'external/gheap' (https://github.com/valyala/gheap) registered for path 'external/gheap'
Submodule 'daemon/jsmn' (https://github.com/zserge/jsmn) registered for path 'external/jsmn'
Submodule 'external/libbacktrace' (https://github.com/ianlancetaylor/libbacktrace.git) registered for path 'external/libbacktrace'
Submodule 'libsodium' (https://github.com/jedisct1/libsodium.git) registered for path 'external/libsodium'
Submodule 'external/libwally-core' (https://github.com/ElementsProject/libwally-core.git) registered for path 'external/libwally-core'
Cloning into '/Users/christophera/.standup/lightning/external/gheap'...
Cloning into '/Users/christophera/.standup/lightning/external/jsmn'...
Cloning into '/Users/christophera/.standup/lightning/external/libbacktrace'...
Cloning into '/Users/christophera/.standup/lightning/external/libsodium'...
Cloning into '/Users/christophera/.standup/lightning/external/libwally-core'...
Submodule path 'external/gheap': checked out '67fc83bc953324f4759e52951921d730d7e65099'
Submodule path 'external/jsmn': checked out '18e9fe42cbfe21d65076f5c77ae2be379ad1270f'
Submodule path 'external/libbacktrace': checked out '5a99ff7fed66b8ea8f09c9805c138524a7035ece'
Submodule path 'external/libsodium': checked out '675149b9b8b66ff44152553fb3ebf9858128363d'
Submodule path 'external/libwally-core': checked out 'b8d7ea91049c3d5522768c77c8bfe4936cbabbd7'
cd external/libwally-core && ./tools/autogen.sh
glibtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, 'build-aux'.
glibtoolize: copying file 'build-aux/ltmain.sh'
glibtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'build-aux/m4'.
glibtoolize: copying file 'build-aux/m4/libtool.m4'
glibtoolize: copying file 'build-aux/m4/ltoptions.m4'
glibtoolize: copying file 'build-aux/m4/ltsugar.m4'
glibtoolize: copying file 'build-aux/m4/ltversion.m4'
glibtoolize: copying file 'build-aux/m4/lt~obsolete.m4'
configure.ac:10: installing 'build-aux/compile'
configure.ac:5: installing 'build-aux/config.guess'
configure.ac:5: installing 'build-aux/config.sub'
configure.ac:9: installing 'build-aux/install-sh'
configure.ac:9: installing 'build-aux/missing'
Makefile.am: installing 'build-aux/depcomp'
parallel-tests: installing 'build-aux/test-driver'
glibtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, 'tools/build-aux'.
glibtoolize: copying file 'tools/build-aux/ltmain.sh'
glibtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'tools/build-aux/m4'.
glibtoolize: copying file 'tools/build-aux/m4/libtool.m4'
glibtoolize: copying file 'tools/build-aux/m4/ltoptions.m4'
glibtoolize: copying file 'tools/build-aux/m4/ltsugar.m4'
glibtoolize: copying file 'tools/build-aux/m4/ltversion.m4'
glibtoolize: copying file 'tools/build-aux/m4/lt~obsolete.m4'
configure.ac:24: installing 'tools/build-aux/compile'
configure.ac:7: installing 'tools/build-aux/config.guess'
configure.ac:7: installing 'tools/build-aux/config.sub'
configure.ac:23: installing 'tools/build-aux/install-sh'
configure.ac:23: installing 'tools/build-aux/missing'
src/Makefile.am: installing 'tools/build-aux/depcomp'
parallel-tests: installing 'tools/build-aux/test-driver'
mkdir -p external/x86_64-apple-darwin19.6.0/libwally-core-build
cd external/x86_64-apple-darwin19.6.0/libwally-core-build && PYTHON_VERSION=3 CFLAGS=-std=c99 ../../libwally-core/configure CC="cc" --enable-static=yes  --enable-module-recovery --enable-elements --enable-shared=no --prefix=/ --libdir=/ --enable-debug && /Applications/Xcode.app/Contents/Developer/usr/bin/make
checking build system type... x86_64-apple-darwin19.6.0
checking host system type... x86_64-apple-darwin19.6.0
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ../../libwally-core/tools/build-aux/install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking how to print strings... printf
checking whether make supports the include directive... yes (GNU style)
checking for gcc... cc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether cc accepts -g... yes
checking for cc option to accept ISO C89... none needed
checking whether cc understands -c and -o together... yes
checking dependency style of cc... gcc3
checking for a sed that does not truncate output... /usr/local/bin/gsed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by cc... /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld
checking if the linker (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld) is GNU ld... no
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 196608
checking how to convert x86_64-apple-darwin19.6.0 file names to x86_64-apple-darwin19.6.0 format... func_convert_file_noop
checking how to convert x86_64-apple-darwin19.6.0 file names to toolchain format... func_convert_file_noop
checking for /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @FILE support... no
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from cc object... ok
checking for sysroot... no
checking for a working dd... /bin/dd
checking how to truncate binary pipes... /bin/dd bs=4096 count=1
checking for mt... no
checking if : is a manifest tool... no
checking for dsymutil... dsymutil
checking for nmedit... nmedit
checking for lipo... lipo
checking for otool... otool
checking for otool64... no
checking for -single_module linker flag... yes
checking for -exported_symbols_list linker flag... yes
checking for -force_load linker flag... yes
checking how to run the C preprocessor... cc -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if cc supports -fno-rtti -fno-exceptions... yes
checking for cc option to produce PIC... -fno-common -DPIC
checking if cc PIC flag -fno-common -DPIC works... yes
checking if cc static flag -static works... no
checking if cc supports -c -o file.o... yes
checking if cc supports -c -o file.o... (cached) yes
checking whether the cc linker (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld) supports shared libraries... yes
checking dynamic linker characteristics... darwin19.6.0 dyld
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... no
checking whether to build static libraries... yes
checking whether make supports nested variables... (cached) yes
checking for gcc... (cached) cc
checking whether we are using the GNU C compiler... (cached) yes
checking whether cc accepts -g... (cached) yes
checking for cc option to accept ISO C89... (cached) none needed
checking whether cc understands -c and -o together... (cached) yes
checking dependency style of cc... (cached) gcc3
checking for libtool... /usr/bin/libtool
checking for ar... (cached) /usr/bin/libtool
checking for ranlib... /usr/bin/ranlib
checking for gsed... yes
checking whether byte ordering is bigendian... no
checking for inline... inline
checking for size_t... yes
checking for uint64_t... yes
checking for uint32_t... yes
checking for uint16_t... yes
checking for uint8_t... yes
checking whether C compiler accepts -O0... yes
checking whether C compiler accepts -ggdb... yes
checking whether the linker accepts -O0... yes
checking whether the linker accepts -ggdb... yes
checking whether C compiler accepts -DBUILD_ELEMENTS=1... yes
checking whether C compiler accepts -flax-vector-conversions... yes
checking whether C compiler accepts -fno-strict-aliasing... yes
checking whether C compiler accepts -Wformat-nonliteral... yes
checking whether C compiler accepts -Wformat-security... yes
checking whether C compiler accepts -Wformat... yes
checking whether C compiler accepts -Wstrict-prototypes... yes
checking whether C compiler accepts -Wshadow... yes
checking whether C compiler accepts -Wnested-externs... yes
checking whether C compiler accepts -Wcast-align... yes
checking whether C compiler accepts -Wpedantic... yes
checking whether C compiler accepts -Wextra... yes
checking whether C compiler accepts -Wall... yes
checking whether C compiler accepts -D_DEFAULT_SOURCE=1... yes
checking whether C compiler accepts -Wno-unused-function... yes
checking whether C compiler accepts -Wno-long-long... yes
checking whether C compiler accepts -Wno-overlength-strings... yes
checking whether C compiler accepts -Wno-variadic-macros... yes
checking whether C compiler accepts -Wno-shadow... yes
checking whether C compiler accepts -Wno-self-assign... yes
checking whether C compiler accepts -Wno-missing-field-initializers... yes
checking whether C compiler accepts -fvisibility=hidden... yes
checking for memset_s... yes
checking for explicit_bzero... no
checking for explicit_memset... no
checking whether we can use inline asm code... yes
checking byteswap.h, usability... no
checking byteswap.h, presence... no
checking for byteswap.h,... no
checking sys/mman.h usability... yes
checking sys/mman.h presence... yes
checking for sys/mman.h... yes
checking whether cc is Clang... yes
checking whether Clang needs flag to prevent "argument unused" warning when linking with -pthread... no
checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE
checking whether more special flags are required for pthreads... no
checking for PTHREAD_PRIO_INHERIT... yes
checking asm/page.h usability... no
checking asm/page.h presence... no
checking for asm/page.h... no
checking for python3... /usr/local/bin/python3
checking for a version of Python >= '2.1.0'... yes
checking for a version of Python >= '2.7.0'... yes
checking for the distutils Python package... yes
checking for Python include path... -I/usr/local/Cellar/python@3.8/3.8.5/Frameworks/Python.framework/Versions/3.8/include/python3.8
checking for Python library path... -L/usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/lib -lpython3.8
checking for Python site-packages path... /usr/local/Cellar/python@3.8/3.8.5/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages
checking python extra libraries... -ldl   -framework CoreFoundation
checking python extra linking flags... -Wl,-stack_size,1000000  -framework CoreFoundation /usr/local/opt/python@3.8/Frameworks/Python.framework/Versions/3.8/Python
checking consistency of all components of python development environment... yes
checking for swig... no
configure: WARNING: cannot find 'swig' program. You should look at http://www.swig.org
checking for java... java
checking for javac... javac
checking for jar... jar
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating src/Makefile
config.status: creating src/wallycore.pc
config.status: creating src/config.h
config.status: executing depfiles commands
config.status: executing libtool commands
=== configuring in src/secp256k1 (/Users/christophera/.standup/lightning/external/x86_64-apple-darwin19.6.0/libwally-core-build/src/secp256k1)
configure: running /bin/sh ../../../../libwally-core/src/secp256k1/configure --disable-option-checking '--prefix=/'  'CC=cc' '--enable-static=yes' '--enable-module-recovery' '--enable-elements' '--enable-shared=no' '--libdir=/' '--enable-debug' 'CFLAGS=-std=c99' 'LDFLAGS=-L/usr/local/opt/sqlite/lib   -Og' 'CPPFLAGS=-I/usr/local/opt/sqlite/include -DBINTOPKGLIBEXECDIR="\"../libexec/c-lightning\""' 'PYTHON_VERSION=3' '--disable-shared' '--disable-jni' '--with-pic' '--with-bignum=no' '--enable-experimental' '--enable-module-ecdh' '--enable-module-recovery' '--enable-module-rangeproof' '--enable-module-surjectionproof' '--enable-module-whitelist' '--enable-module-generator' '--enable-openssl-tests=no' '--enable-tests=no' '--enable-exhaustive-tests=no' '--enable-benchmark=no' '--disable-dependency-tracking' --cache-file=/dev/null --srcdir=../../../../libwally-core/src/secp256k1
checking build system type... x86_64-apple-darwin19.6.0
checking host system type... x86_64-apple-darwin19.6.0
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ../../../../libwally-core/src/secp256k1/build-aux/install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking how to print strings... printf
checking whether make supports the include directive... yes (GNU style)
checking for gcc... cc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether cc accepts -g... yes
checking for cc option to accept ISO C89... none needed
checking whether cc understands -c and -o together... yes
checking dependency style of cc... none
checking for a sed that does not truncate output... /usr/local/bin/gsed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by cc... /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld
checking if the linker (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld) is GNU ld... no
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 196608
checking how to convert x86_64-apple-darwin19.6.0 file names to x86_64-apple-darwin19.6.0 format... func_convert_file_noop
checking how to convert x86_64-apple-darwin19.6.0 file names to toolchain format... func_convert_file_noop
checking for /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for archiver @FILE support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from cc object... ok
checking for sysroot... no
checking for a working dd... /bin/dd
checking how to truncate binary pipes... /bin/dd bs=4096 count=1
checking for mt... no
checking if : is a manifest tool... no
checking for dsymutil... dsymutil
checking for nmedit... nmedit
checking for lipo... lipo
checking for otool... otool
checking for otool64... no
checking for -single_module linker flag... yes
checking for -exported_symbols_list linker flag... yes
checking for -force_load linker flag... no
checking how to run the C preprocessor... cc -E
checking for ANSI C header files... yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if cc supports -fno-rtti -fno-exceptions... yes
checking for cc option to produce PIC... -fno-common -DPIC
checking if cc PIC flag -fno-common -DPIC works... yes
checking if cc static flag -static works... no
checking if cc supports -c -o file.o... yes
checking if cc supports -c -o file.o... (cached) yes
checking whether the cc linker (/Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/ld) supports shared libraries... yes
checking dynamic linker characteristics... darwin19.6.0 dyld
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... no
checking whether to build static libraries... yes
checking whether make supports nested variables... (cached) yes
checking for pkg-config... /usr/local/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking for ar... /usr/bin/libtool
checking for ranlib... /usr/bin/ranlib
checking for strip... /usr/bin/strip
checking for gcc... gcc
checking whether we are using the GNU C compiler... (cached) yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... (cached) none needed
checking whether gcc understands -c and -o together... (cached) yes
checking dependency style of gcc... (cached) none
checking how to run the C preprocessor... gcc -E
checking for cc option to accept ISO C89... (cached) none needed
checking dependency style of cc... none
checking for brew... /usr/local/bin/brew
checking if cc supports -std=c89 -pedantic -Wall -Wextra -Wcast-align -Wnested-externs -Wshadow -Wstrict-prototypes -Wno-unused-function -Wno-long-long -Wno-overlength-strings... yes
checking if cc supports -fvisibility=hidden... yes
checking for __int128... yes
checking for __builtin_popcount... yes
checking if native gcc supports -Wall -Wextra -Wno-unused-function... yes
checking for working native compiler: gcc... yes
checking for  __builtin_clzll... yes
checking for x86_64 assembly availability... yes
checking whether byte ordering is bigendian... no
configure: ******
configure: WARNING: experimental build
configure: Experimental features do not have stable APIs or properties, and may not be safe for production use.
configure: Building ECDH module: yes
configure: Building NUMS generator module: yes
configure: Building range proof module: yes
configure: Building key whitelisting module: yes
configure: Building surjection proof module: yes
configure: Building schnorrsig module: no
configure: Building MuSig module: no
configure: ******
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating libsecp256k1.pc
config.status: creating src/libsecp256k1-config.h
config.status: executing depfiles commands
config.status: executing libtool commands

Build Options:
  with endomorphism       = no
  with ecmult precomp     = yes
  with external callbacks = no
  with jni                = no
  with benchmarks         = no
  with coverage           = no
  module ecdh             = yes
  module recovery         = yes
  module schnorrsig       = no

  asm                     = x86_64
  bignum                  = no
  field                   = 64bit
  scalar                  = 64bit
  ecmult window size      = 15

  CC                      = cc
  CFLAGS                  = -O2 -std=c99 -W -std=c89 -pedantic -Wall -Wextra -Wcast-align -Wnested-externs -Wshadow -Wstrict-prototypes -Wno-unused-function -Wno-long-long -Wno-overlength-strings -fvisibility=hidden
  CPPFLAGS                = -I/usr/local/opt/sqlite/include -DBINTOPKGLIBEXECDIR="\"../libexec/c-lightning\""
  LDFLAGS                 = -L/usr/local/opt/sqlite/lib   -Og

Making all in src
/Applications/Xcode.app/Contents/Developer/usr/bin/make  all-recursive
Making all in secp256k1
gcc -I../../../../libwally-core/src/secp256k1 -g -O2 -Wall -Wextra -Wno-unused-function -c ../../../../libwally-core/src/secp256k1/src/gen_context.c -o gen_context.o
gcc -g -O2 -Wall -Wextra -Wno-unused-function  gen_context.o -o gen_context
./gen_context
  CC       src/libsecp256k1_la-secp256k1.lo
  CCLD     libsecp256k1.la
  CC       ctest/test_bech32-test_bech32.o
  CC       libwallycore_la-address.lo
  CC       libwallycore_la-aes.lo
  CC       libwallycore_la-base58.lo
  CC       libwallycore_la-bip32.lo
  CC       libwallycore_la-bip38.lo
  CC       libwallycore_la-bip39.lo
  CC       libwallycore_la-bech32.lo
  CC       libwallycore_la-ecdh.lo
  CC       libwallycore_la-elements.lo
  CC       libwallycore_la-blech32.lo
  CC       libwallycore_la-hex.lo
  CC       libwallycore_la-hmac.lo
In file included from ../../../libwally-core/src/hmac.c:16:
../../../libwally-core/src/hmac.inl:54:37: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    struct SHA_T *sha_p = aligned ? (struct SHA_T *)bytes_out : &sha;
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~
In file included from ../../../libwally-core/src/hmac.c:28:
../../../libwally-core/src/hmac.inl:54:37: warning: cast from 'unsigned char *' to 'struct sha512 *' increases required alignment from 1 to 8 [-Wcast-align]
    struct SHA_T *sha_p = aligned ? (struct SHA_T *)bytes_out : &sha;
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~
2 warnings generated.
  CC       libwallycore_la-internal.lo
../../../libwally-core/src/internal.c:81:22: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256(aligned ? (struct sha256 *)bytes_out : &sha, bytes, bytes_len);
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:110:37: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256_midstate(&ctx, aligned ? (struct sha256 *)bytes_out : &sha);
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:130:22: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256(aligned ? (struct sha256 *)bytes_out : &sha_2, &sha_1, sizeof(sha_1));
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:148:22: warning: cast from 'unsigned char *' to 'struct sha512 *' increases required alignment from 1 to 8 [-Wcast-align]
    sha512(aligned ? (struct sha512 *)bytes_out : &sha, bytes, bytes_len);
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:171:25: warning: cast from 'unsigned char *' to 'struct ripemd160 *' increases required alignment from 1 to 4 [-Wcast-align]
    ripemd160(aligned ? (struct ripemd160 *)bytes_out : &ripemd, &buff, sizeof(buff));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:190:5: error: implicit declaration of function 'memset_s' is invalid in C99 [-Werror,-Wimplicit-function-declaration]
    memset_s(dest, len, 0, len);
    ^
../../../libwally-core/src/internal.c:190:5: note: did you mean 'memset'?
/Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/string.h:74:7: note: 'memset' declared here
void    *memset(void *__b, int __c, size_t __len);
         ^
5 warnings and 1 error generated.
make[4]: *** [libwallycore_la-internal.lo] Error 1
make[3]: *** [all-recursive] Error 1
make[2]: *** [all] Error 2
make[1]: *** [all-recursive] Error 1
make: *** [external/x86_64-apple-darwin19.6.0/libwally-core-build/src/libwallycore.la] Error 2
rm external/x86_64-apple-darwin19.6.0/libwally-core-build/src/secp256k1/libsecp256k1.la

Any ideas what is going wrong?

cc @ChristopherA

[cdecker]

This seems to be a duplicate of #4096

[Fonta1n3]

Well I can build 0.9.X just fine on Catalina 10.15.4

[cdecker]

Is there a real difference between the two patch levels? The error looks identical.

From the trace it seems like this is an upstream issue with libwally-core

[Fonta1n3]

Is there a real difference between the two patch levels? The error looks identical.

From the trace it seems like this is an upstream issue with libwally-core

I do not know what the difference is between the two patches, there is obviously a lot of variables at play here..

The only reason I raised it as a separate issue is bc I can successfully compile lightningd even though I get the same types of warnings about Libwally.

Which makes me feel like its not a Libwally issue. Having said that I have compiled Libwally on my machine many times for different projects in different ways.

This log output is from OSX Catalina 10.15.4 which results in a successful install of C-Lightning 0.9.1:

(let me know if you want the entire output)

In file included from ../../../libwally-core/src/hmac.c:16:
../../../libwally-core/src/hmac.inl:54:37: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    struct SHA_T *sha_p = aligned ? (struct SHA_T *)bytes_out : &sha;
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~
In file included from ../../../libwally-core/src/hmac.c:28:
../../../libwally-core/src/hmac.inl:54:37: warning: cast from 'unsigned char *' to 'struct sha512 *' increases required alignment from 1 to 8 [-Wcast-align]
    struct SHA_T *sha_p = aligned ? (struct SHA_T *)bytes_out : &sha;
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~
2 warnings generated.
  CC       libwallycore_la-internal.lo
../../../libwally-core/src/internal.c:81:22: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256(aligned ? (struct sha256 *)bytes_out : &sha, bytes, bytes_len);
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:110:37: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256_midstate(&ctx, aligned ? (struct sha256 *)bytes_out : &sha);
                                    ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:130:22: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
    sha256(aligned ? (struct sha256 *)bytes_out : &sha_2, &sha_1, sizeof(sha_1));
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:148:22: warning: cast from 'unsigned char *' to 'struct sha512 *' increases required alignment from 1 to 8 [-Wcast-align]
    sha512(aligned ? (struct sha512 *)bytes_out : &sha, bytes, bytes_len);
                     ^~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:171:25: warning: cast from 'unsigned char *' to 'struct ripemd160 *' increases required alignment from 1 to 4 [-Wcast-align]
    ripemd160(aligned ? (struct ripemd160 *)bytes_out : &ripemd, &buff, sizeof(buff));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
../../../libwally-core/src/internal.c:190:5: warning: implicit declaration of function 'memset_s' is invalid in C99 [-Wimplicit-function-declaration]
    memset_s(dest, len, 0, len);
    ^
6 warnings generated.
  CC       libwallycore_la-mnemonic.lo
  CC       libwallycore_la-pbkdf2.lo
In file included from ../../../libwally-core/src/pbkdf2.c:19:
../../../libwally-core/src/pbkdf2.inl:44:18: warning: cast from 'unsigned char *' to 'struct sha256 *' increases required alignment from 1 to 4 [-Wcast-align]
        sha_cp = (struct SHA_T *)bytes_out;
                 ^~~~~~~~~~~~~~~~~~~~~~~~~
In file included from ../../../libwally-core/src/pbkdf2.c:33:
../../../libwally-core/src/pbkdf2.inl:44:18: warning: cast from 'unsigned char *' to 'struct sha512 *' increases required alignment from 1 to 8 [-Wcast-align]
        sha_cp = (struct SHA_T *)bytes_out;
                 ^~~~~~~~~~~~~~~~~~~~~~~~~
2 warnings generated.
  CC       libwallycore_la-psbt.lo
  CC       libwallycore_la-pullpush.lo
  CC       libwallycore_la-script.lo
  CC       libwallycore_la-scrypt.lo
  CC       libwallycore_la-sign.lo
  CC       libwallycore_la-symmetric.lo
  CC       libwallycore_la-transaction.lo
  CC       libwallycore_la-wif.lo
  CC       libwallycore_la-wordlist.lo
  CC       ccan/ccan/base64/libwallycore_la-base64.lo
../../../libwally-core/src/ccan/ccan/base64/base64.c:196:11: warning: comparison of integers of different signs: 'size_t' (aka 'unsigned long') and 'int' [-Wsign-compare]
        if (more == -1) {
            ~~~~ ^  ~~
1 warning generated.
  CC       ccan/ccan/crypto/ripemd160/libwallycore_la-ripemd160.lo
../../../libwally-core/src/ccan/ccan/crypto/ripemd160/ripemd160.c:290:22: warning: cast from 'const unsigned char *' to 'const uint32_t *' (aka 'const unsigned int *') increases required alignment from 1 to 4 [-Wcast-align]
                        Transform(ctx->s, (const uint32_t *)data);
                                          ^~~~~~~~~~~~~~~~~~~~~~
1 warning generated.
  CC       ccan/ccan/crypto/sha256/libwallycore_la-sha256.lo
../../../libwally-core/src/ccan/ccan/crypto/sha256/sha256.c:213:22: warning: cast from 'const unsigned char *' to 'const uint32_t *' (aka 'const unsigned int *') increases required alignment from 1 to 4 [-Wcast-align]
                        Transform(ctx->s, (const uint32_t *)data, blocks);
                                          ^~~~~~~~~~~~~~~~~~~~~~
1 warning generated.
  CC       ccan/ccan/crypto/sha512/libwallycore_la-sha512.lo
../../../libwally-core/src/ccan/ccan/crypto/sha512/sha512.c:205:22: warning: cast from 'const unsigned char *' to 'const uint64_t *' (aka 'const unsigned long long *') increases required alignment from 1 to 8 [-Wcast-align]
                        Transform(ctx->s, (const uint64_t *)data);
                                          ^~~~~~~~~~~~~~~~~~~~~~
1 warning generated.
  CC       ccan/ccan/str/hex/libwallycore_la-hex.lo
  CCLD     libwallycore.la

*** Warning: Linking the shared library libwallycore.la against the
*** static library secp256k1/.libs/libsecp256k1.a is not portable!

[cdecker]

I think I see what the issue is: we compile c-lightning with very paranoid options (-Werror which turns all warnings into errors). When we then call make in libwally-core it inherits that paranoid config, making normally innocuous warnings errors that abort the compilation. Notice how the memset_s warning in the second output is turned into an error in the first. So we need to adjust our makefile slightly.

[cdecker]

Seems the only change we did since v0.8.1 (which according to #4096 still compiled correctly) is this 6e86022, where we set the standard version to c99. But I don't quite understand why it is a warning in one case, and an error in the other.

Can you share the output of clang --version and try to compile v0.8.1 to confirm that still works?

Definitely out of my depth here, paging our resident Makefile magician @rustyrussell :-)

[niftynei]

@Fonta1n3 do you have an update on this issue?

[Fonta1n3]

@Fonta1n3 do you have an update on this issue?

This was an issue raised by one of my users who does not seem to be interested in helping to debug it.

[sr-gi]

I can help you debugging it if you need help with this one, given I raised #4096

Haven't tried to compile it again in a while, so feel free to let me know were to start from.