Only do backtrace builds on stable to fix MSRV break in CI