Here is the data I might expect to have before turning it on:
- Runtime of all test suites on crates.io, all nmatsakis’s test cases
- Compiletime of all rustc-perf benchmarks, all crates on crates.io
- Code size of all crates on crates.io
The averages of these three (aggregated) numbers should be as good or better than oldtrans, and there should be no obviously horrible outliers. This seems to be a pretty reasonable and easy set of data to acquire.