IMO unsafe is unnecessary, using the wrong target feature here is no less unsafe than passing the wrong target feature on the command line or even compiling for the wrong target.
What I think the compiler should do though, is disallow any features that aren’t additive to the default target features (on the command line and as an attribute), that would stop @burntsushi’s -sse2.