I wanted to test with a native theme and noticed that Offroad is missing a ton of font files in preview. I am not sure if this is related to 8.1 or not.
Thanks for reporting this, @joeworkman. As another example of “look, we do this too!”, the fonts directory was missing from the theme’s RWCopyFiles array