Crater changelog

pietroalbini · 2018-09-27T08:25:20.063Z

This topic contains the changelog of Crater, our tool to run experiments across parts of the Rust ecosystem. You can subscribe to it if you want to be notified when something changes.

Please avoid posting comments to this topic, to keep it clean. Thanks!

pietroalbini · 2018-09-27T08:29:28.786Z

Crater is now testing 23k new GitHub repositories, going from 21k tested projects to 44k! This will increase coverage, but also the execution time for Crater runs.

Pull request - GitHub repositories scraper

ZerothLaw · 2018-09-27T19:04:32.099Z

Is there anywhere we can find the crater reports?

pietroalbini · 2018-09-27T19:22:50.995Z

ZerothLaw:

Is there anywhere we can find the crater reports?

There is not an UI for that, but you can see all the places where craterbot was invoked with a GitHub search query.

PS: let’s try keeping this thread only for the changelog! If you want to ask questions/leave feedback there is the Crater channel on Discord.

pietroalbini · 2018-10-03T21:18:49.062Z

Craterbot will now post a link to the queue and the experiment’s details when a new experiment is created! Thanks to xd009642 for implementing this feature!

Screenshot%20from%202018-10-03%2023-12-54

Screenshot from 2018-10-03 23-12-54.png786×298 32.6 KB

Pull request

pietroalbini · 2018-10-07T21:50:35.675Z

Network access is now disabled while building and testing crates, to prevent abuse from malicious crates (nothing ever happened yet, but better be safe than sorry). Thanks to AndrewSpeed for implementing this feature!

Pull request

pietroalbini · 2018-10-11T21:52:20.773Z

When you create multiple experiments on the same PR, Crater will now automatically generate names for all of them (like pr-123, pr-123-1, pr-123-2…). Thanks to @iox for implementing this feature!

Pull request

pietroalbini · 2018-11-10T14:14:36.458Z

Crater will now automatically detect timeouts and OOMs, showing them in a new spurious failures category when they cause a regression!

Screenshot%20from%202018-11-10%2010-58-03

Screenshot from 2018-11-10 10-58-03.png1181×197 9 KB

Screenshot%20from%202018-11-10%2012-23-23

Screenshot from 2018-11-10 12-23-23.png1156×186 11.4 KB

Pull request

pietroalbini · 2018-11-17T11:11:30.761Z

Crater now has support to run cargo doc runs! You can start one with:

@craterbot run start=stable end=beta mode=rustdoc

Pull Request

pietroalbini · 2018-12-04T18:42:15.954Z

Crater will now post the regressions count in the GitHub comment when a run finishes! Thanks to @Zeegomo for implementing this feature!

Pull request

pietroalbini · 2018-12-19T22:48:17.079Z

Crater is now using a new Docker build environment based on the docs.rs one, so more crates should now be able to compile inside Crater!
Pull request

Build logs will now also include log entries generated during the prepare step.
Pull request

Crater will now strip examples and tests declared in Cargo.toml but not present in the crate archive. Those missing examples and tests prevented some crates to build at all in the past. Thanks @Zeegomo for implementing this!
Pull request

pietroalbini · 2019-01-24T14:40:37.693Z

Crater now posts a comment on the issue/PR when a run fails. Thanks @Zeegomo for implementing this! Pull request

pietroalbini · 2019-01-27T12:47:27.459Z

It’s now possible to run cargo clippy in Crater experiments! Thanks to ecstatic-morse for implementing this!
Pull request

pietroalbini · 2019-03-06T18:35:23.423Z

Crater will now automatically keep track of try builds on a PR and default to the last one when you don’t specify the toolchains manually!
Pull request

53890036-bec51500-4027-11e9-8642-d8c6ab0a67ed.png804×466 49.5 KB