For some relevant prior discussions, see Numeric .into() should not require everyone to support 16-bit and 128-bit usize.
Tangentially related, there have also been discussions around allowing some traits that operate on usize (like Index) to take other integer types, which would reduce the need for conversions.