(#12891) Make features reloadable

This removes a non-functioning check to prevent reloading features and makes
reloading work correctly. Prior to this an old cached value of a feature could
be incorrectly returned. This makes sure the cache is cleared when a new
version is loaded.