Well, it would help a build server configuration, where the building machine doesn’t actually also run the built application. I can imagine scenarios where you might want to infect the building machine, but not necessarily inject yourself into every built binary. Maybe you just want your build script to steal GitHub creds or something.
But anyway, your point still stands that at some point you are putting trust in the code published on crates.io in the final binary.