Avoid panicking on wallclock time going backwards across restart