Avoid double-panic in ChannelManager when tests fail