Switching themes updates the edit view instantly. But it does not update in the browser preview until something on the page is changed.
Not caching (in the browser) :
Develop > Empty Cache
Has no effect. Only changing something in the page allows the browser preview to use the newly selected theme.
Ah-yes, this has also been bugging me 
It’s on the list to fix!
2 Likes