- Feature Name: cargo-script
- Start Date: 2023-03-31
- Source (edit history)
- Demo
Summary
This adds support for so called single-file
packages in cargo. Single-file packages are .rs files with an embedded
manifest. These will be accepted with just like Cargo.toml files with
--manifest-path. cargo will be modified to accept cargo <file>.rs as a
short-cut to cargo run --manifest-path <file>.rs. This allows placing
cargo in a #! line for directly running these files.
Example:
#!/usr/bin/env cargo
//! ```cargo
//! [dependencies]
//! clap = { version = "4.2", features = ["derive"] }
//! ```
use clap::Parser;
#[derive(Parser, Debug)]
#[clap(version)]
struct Args {
#[clap(short, long, help = "Path to config")]
config: Option<std::path::PathBuf>,
}
fn main() {
let args = Args::parse();
println!("{:?}", args);
}
$ ./prog --config file.toml
Args { config: Some("file.toml") }
See cargo-script-mvs for a demo.
Motivation
Collaboration:
When sharing reproduction cases, it is much easier when everything exists in a single code snippet to copy/paste. Alternatively, people will either leave off the manifest or underspecify the details of it.
This similarly makes it easier to share code samples with coworkers or in books / blogs when teaching.
Interoperability:
One angle to look at including something is if there is a single obvious solution. While there isn't in the case for single-file packages, there is enough of a subset of one. By standardizing that subset, we allow greater interoperability between solutions (e.g. playground could gain support ). This would make it easier to collaborate..
Prototyping:
Currently to prototype or try experiment with APIs or the language, you need to either
- Use the playground
- Can't access local resources
- Limited in the crates supported
- Note: there are alternatives to the playground that might have fewer restrictions but are either less well known or have additional complexities.
- Find a place to do
cargo new, editCargo.tomlandmain.rsas necessary, andcargo runit, then delete it- This is a lot of extra steps, increasing the friction to trying things out
- This will fail if you create in a place that
cargowill think it should be a workspace member
By having a single-file project,
- It is easier to setup and tear down these experiments, making it more likely to happen
- All crates will be available
- Local resources are available
One-Off Utilities:
It is fairly trivial to create a bunch of single-file bash or python scripts into a directory and add it to the path. Compare this to rust where
-
cargo neweach of the "scripts" into individual directories - Create wrappers for each so you can access it in your path, passing
--manifest-pathtocargo run
Guide-level explanation
Creating a New Package
(Adapted from the cargo book)
To start a new package with Cargo, create a file named hello_world.rs:
#!/usr/bin/env cargo
fn main() {
println!("Hello, world!");
}
Let's run it
$ chmod +x hello_world.rs
$ ./hello_world.rs
Hello, world!
Dependencies
(Adapted from the cargo book)
crates.io is the Rust community's central package registry
that serves as a location to discover and download
packages. cargo is configured to use it by default to find
requested packages.
Adding a dependency
To depend on a library hosted on crates.io, you modify hello_world.rs:
#!/usr/bin/env cargo
//! ```cargo
//! [dependencies]
//! time = "0.1.12"
//! ```
fn main() {
println!("Hello, world!");
}
The cargo section is called a manifest, and it contains all of the
metadata that Cargo needs to compile your package. This is written in the
TOML format (pronounced /tΙmΙl/).
time = "0.1.12" is the name of the crate and a SemVer version
requirement. The specifying
dependencies docs have more
information about the options you have here.
If we also wanted to add a dependency on the regex crate, we would not need
to add [dependencies] for each crate listed. Here's what your whole
hello_world.rs file would look like with dependencies on the time and regex
crates:
#!/usr/bin/env cargo
//! ```cargo
//! [dependencies]
//! time = "0.1.12"
//! regex = "0.1.41"
//! ```
fn main() {
let re = Regex::new(r"^\d{4}-\d{2}-\d{2}$").unwrap();
println!("Did our date match? {}", re.is_match("2014-01-01"));
}
You can then re-run this and Cargo will fetch the new dependencies and all of their dependencies. You can see this by passing in --verbose:
$ cargo eval --verbose ./hello_world.rs
Updating crates.io index
Downloading memchr v0.1.5
Downloading libc v0.1.10
Downloading regex-syntax v0.2.1
Downloading memchr v0.1.5
Downloading aho-corasick v0.3.0
Downloading regex v0.1.41
Compiling memchr v0.1.5
Compiling libc v0.1.10
Compiling regex-syntax v0.2.1
Compiling memchr v0.1.5
Compiling aho-corasick v0.3.0
Compiling regex v0.1.41
Compiling hello_world v0.1.0 (file:///path/to/package/hello_world)
Did our date match? true
Package Layout
(Adapted from the cargo book)
When a single file is not enough, you can separately define a Cargo.toml file along with the src/main.rs file. Run
$ cargo new hello_world --bin
Weβre passing --bin because weβre making a binary program: if we
were making a library, weβd pass --lib. This also initializes a new git
repository by default. If you don't want it to do that, pass --vcs none.
Letβs check out what Cargo has generated for us:
$ cd hello_world
$ tree .
.
βββ Cargo.toml
βββ src
βββ main.rs
1 directory, 2 files
Unlike the hello_world.rs, a little more context is needed in Cargo.toml:
[package]
name = "hello_world"
version = "0.1.0"
edition = "2021"
[dependencies]
Cargo uses conventions for file placement to make it easy to dive into a new Cargo package:
.
βββ Cargo.lock
βββ Cargo.toml
βββ src/
β βββ lib.rs
β βββ main.rs
β βββ bin/
β βββ named-executable.rs
β βββ another-executable.rs
β βββ multi-file-executable/
β βββ main.rs
β βββ some_module.rs
βββ benches/
β βββ large-input.rs
β βββ multi-file-bench/
β βββ main.rs
β βββ bench_module.rs
βββ examples/
β βββ simple.rs
β βββ multi-file-example/
β βββ main.rs
β βββ ex_module.rs
βββ tests/
βββ some-integration-tests.rs
βββ multi-file-test/
βββ main.rs
βββ test_module.rs
-
Cargo.tomlandCargo.lockare stored in the root of your package (package root). - Source code goes in the
srcdirectory. - The default library file is
src/lib.rs. - The default executable file is
src/main.rs.- Other executables can be placed in
src/bin/.
- Other executables can be placed in
- Benchmarks go in the
benchesdirectory. - Examples go in the
examplesdirectory. - Integration tests go in the
testsdirectory.
If a binary, example, bench, or integration test consists of multiple source
files, place a main.rs file along with the extra [modules][def-module]
within a subdirectory of the src/bin, examples, benches, or tests
directory. The name of the executable will be the directory name.
You can learn more about Rust's module system in the book.
See Configuring a target for more details on manually configuring targets. See Target auto-discovery for more information on controlling how Cargo automatically infers target names.
Reference-level explanation
Single-file packages
In addition to today's multi-file packages (Cargo.toml file with other .rs
files), we are adding the concept of single-file packages which may contain an
embedded manifest. There is no required distinguishment for a single-file
.rs package from any other .rs file.
A single-file package may contain an embedded manifest. An embedded manifest
is stored using TOML in a markdown code-fence with cargo at the start of the
infostring inside a target-level doc-comment. It is an error to have multiple
cargo code fences in the target-level doc-comment. We can relax this later,
either merging the code fences or ignoring later code fences.
Supported forms of embedded manifest are:
//! ```cargo
//! ```
/*!
```cargo
```
*/
/*!
* ```cargo
* ```
*/
Inferred / defaulted manifest fields:
package.name = <slugified file stem>-
package.version = "0.0.0"to call attention to this crate being used in unexpected places -
package.publish = falseto avoid accidental publishes, particularly if we later add support for including them in a workspace. -
package.edition = <current>to avoid always having to add an embedded manifest at the cost of potentially breaking scripts on rust upgrades- Warn when
editionis unspecified. While with single-file packages this will be silenced by default, users wanting stability are also likely to be using other commands, likecargo testand will see it.
- Warn when
Disallowed manifest fields:
-
[workspace],[lib],[[bin]],[[example]],[[test]],[[bench]] -
package.workspace,package.build,package.links,package.autobins,package.autoexamples,package.autotests,package.autobenches
As the primary role for these files is exploratory programming which has a high
edit-to-run ratio, building should be fast. Therefore CARGO_TARGET_DIR will
be shared between single-file packages to allow reusing intermediate build
artifacts.
A single-file package is accepted by cargo commands as a --manifest-path
- This is distinguished by the file extension (
.rs) and that it is a file. - This allows running
cargo test --manifest-path single.rs -
cargo package/cargo publishwill normalize this into a multi-file package -
cargo addandcargo removemay not support editing embedded manifests initially - Path-dependencies may not refer to single-file packages at this time (they don't have a
libtarget anyways)
The lockfile for single-file packages will be placed in CARGO_TARGET_DIR. In
the future, when workspaces are supported, that will allow a user to have a
persistent lockfile.
cargo <file>.rs
cargo is intended for putting in the #! for single-file packages:
#!/usr/bin/env cargo
fn main() {
println!("Hello world");
}
This command will have the same behavior as running
$ RUST_BACKTRACE=1 cargo run --quiet --manifest-path <file.rs> -- <args>`.
-
--releaseis not passed in because the primary use case is for exploratory programming, so the emphasis will be on build-time performance, rather than runtime performance -
RUST_BACKTRACE=1will be enabled by default (allowing the caller to override it) to help exploratory programming by making it quicker to debug panics. -
--quietis enabled by default so as to not mix cargo and user output. On success,cargowill print nothing while error messages will be shown on failure. In the future, we can explore showing progress bars ifstdoutis interactive but they will be cleared by the time cargo is done. A single--verbosewill restore normal output and subsequent--verboses will act l ike normal.
Most other flags and behavior will be similar to cargo run.
Drawbacks
At the moment, the doc-comment parsing is brittle, relying on regexes, to extract it and then requires a heavy dependency (a markdown parser) to get the code fence.
The implicit content of the manifest will be unclear for users. We can patch over this as best we can in documentation but the result won't be ideal.
The bin.name assigned to the script included a hash as an implementation
detail of the shared cache (for improving build times). This makes
programmatic choices off of argv[0] not work like normal (e.g. multi-call
binaries). We could settings
argv[0] on unix-like systems
but could not find something similar for Windows.
This increases the maintenance and support burden for the cargo team, a team that is already limited in its availability.
Like with all cargo packages, the target/ directory grows unbounded. Some
prior art include a cache GC but that is also to clean up the temp files stored
in other locations (our temp files are inside the target/ dir and should be
rarer).
Syntax is not reserved for build.rs, [lib] support, proc-maros, or other
functionality to be added later with the assumption that if these features are
needed, a user should be using a multi-file package.
Rationale and alternatives
Guidelines used in design decision making include
- Single-file packages should have a first-class experience
- Provides a higher quality of experience (doesn't feel like a hack or tacked on)
- Transferable knowledge, whether experience, stackoverflow answers, etc
- Easier unassisted migration between single-file and multi-file packages
- The more the workflows deviate, the higher the maintenance and support costs for the cargo team
- Example implications:
- Workflows, like running tests, should be the same as multi-file packages rather than being bifurcated
- Manifest formats should be the same rather than using a specialized schema or data format
- Friction for starting a new single-file package should be minimal
- Easy to remember, minimal syntax so people are more likely to use it in one-off cases, experimental or prototyping use cases without tool assistance
- Example implications:
- Embedded manifest is optional which also means we can't require users specifying
edition - See also the implications for first-class experience
- Workspaces for single-file packages should not be auto-discovered as that will break unless the workspaces also owns the single-file package which will break workflows for just creating a file anywhere to try out an idea.
- Embedded manifest is optional which also means we can't require users specifying
- Cargo/rustc diagnostics and messages (including
cargo metadata) should be in terms of single-file packages and not any temporary files- Easier to understand the messages
- Provides a higher quality of experience (doesn't feel like a hack or tacked on)
- Example implications:
- Most likely, we'll need single-file packages to be understood directly by
rustc so cargo doesn't have to split out the
.rscontent into a temp file that gets passed to cargo which will cause errors to point to the wrong file - Most likely, we'll want to muck with the errors returned by
toml_editso we render manifest errors based on the original source code which will require accurate span information.
- Most likely, we'll need single-file packages to be understood directly by
rustc so cargo doesn't have to split out the
Embedded Manifest Format
Considerations for embedded manifest include
- How obvious it is for new users when they see it
- How easy it is for newer users to remember it and type it out
- How machine editable it is for
cargo addand friends - Needs to be valid Rust code based on the earlier stated design guidelines
- Lockfiles might also need to reuse how we attach metadata to the file
Option 1: Doc-comment
#!/usr/bin/env cargo
//! ```cargo
//! [package]
//! edition = "2018"
//! ```
fn main() {
}
- This has the advantage of using existing, familiar syntax both to read and write.
- Could use
synto parse to get the syntax correct - Might be a bit complicated to do edits (translating between location within
toml_editspans to the location withinsynspans) - Requires pulling in a full markdown parser to extract the manifest
Option 2: Macro
#!/usr/bin/env cargo
cargo! {
[package]
edition = "2018"
}
fn main() {
}
- The
cargomacro would need to come from somewhere (std?) which means it is taking oncargo-specific knowledge - A lot of tools/IDEs have problems in dealing with macros
- Free-form rust code makes it harder for cargo to make edits to the manifest
Option 3: Attribute
#!/usr/bin/env cargo
#![cargo(manifest = r#"
[package]
edition = "2018"
"#)]
fn main() {
}
-
cargocould register this attribute orrustccould get a genericmetadataattribute - I posit that this syntax is more intimidating to read and write for newer users
- As an alternative,
manifestcould a less stringly-typed format but that makes it harder for cargo to parse and edit, makes it harder for users to migrate between single and multi-file packages, and makes it harder to transfer knowledge and experience
Option 4: Presentation Streams
YAML allows several documents to be concatenated together variant presentation streams which might seem familiar as this is frequently used in static-site generators for adding frontmatter to pages. What if we extended Rust's syntax to allow something similar?
#!/usr/bin/env cargo
fn main() {
}
---Cargo.toml
[package]
edition = "2018"
- Easiest for machine parsing and editing
- Flexible for manifest, lockfile, and other content
- Being new syntax, there would be a lot of details to work out, including
- How to delineate and label documents
- How to allow escaping to avoid conflicts with content in a documents
- Potentially an API for accessing the document from within Rust
- Unfamiliar, new syntax, unclear how it will work out for newer users
Option 5: Regular Comment
The manifest can be a regular comment with a header. If we were to support multiple types of content (manifest, lockfile), we could either use multiple comments or HEREDOC.
Open questions
- Which syntax to use
- Which comment types would be supported
Simple header:
#!/usr/bin/env cargo
/* Cargo.toml:
[package]
edition = "2018"
*/
fn main() {
}
HEREDOC:
#!/usr/bin/env cargo
/* Cargo.TOML >>>
[package]
edition = "2018"
<<<
*/
fn main() {
}
- Unfamiliar syntax
- New style of structured comment for the ecosystem to support with potential compatibility issues
- Assuming it can't be parsed with
synand either we need to write a sufficiently compatible comment parser or pull in a much larger rust parser to extract and update comments.
Lockfile
Lockfiles
record the exact version used for every possible dependency to ensure
reproducibility. In particular, this protects against upgrading to broken
versions and allows continued use of a yanked version. As this time, the
recommendation is for
bins to persist their lockfile while libs do not.
With multi-file packages, cargo writes a Cargo.lock file to the package
directory. As there is no package directory for single-file packages, we need
to decide how to handle locking dependencies.
Considerations
- Sharing of single-file projects should be easy
- In "copy/paste" scenarios, like reproduction cases in issues, how often have lockfiles been pertinent for reproduction?
- There is an expectation of a reproducible Rust experience
- Dropping of additional files might be frustrating for users to deal with (in addition to making it harder to share it all)
- We would need a way to store the lockfile for
stdinwithout conflicting with parallel runs -
cargoalready makes persisting ofCargo.lockoptional for multi-file packages, encouraging not persisting it in some cases - Newer users should feel comfortable reading and writing single-file packages
- A future possibility is allowing single-file packages to belong to a
workspace at which point they would use the workspace's
Cargo.lockfile. This limits the scope of the conversation and allows an alternative to whatever is decided here. - Read-only single-file packages (e.g. running
/usr/bin/package.rswithout root privileges)
Location 1: In CARGO_TARGET_DIR
The path would include a hash of the manifest to avoid conflicts.
- Transient location, lost with a
cargo clean --manifest-path foo.rs - Hard to find for sharing on issues, if needed
Location 2: In $CARGO_HOME
The path would include a hash of the manifest to avoid conflicts.
- Transient location though not lost with
cargo clean --manifest-path foo.rs - No garbage collection to help with temporary source files, especially
stdin
Location 3: As <file-stem>.lock
Next to <file-stem>.rs, we drop a <file-stem>.lock file. We could add a
_ or . prefix to distinguish this from the regular files in the directory.
- Users can discover this file location
- Users can persist this file to the degree of their choosing
- Users might not appreciate file "droppings" for transient cases
- When sharing, this is a separate file to copy though its unclear how often that would be needed
- A policy is needed when the location is read-only
- Fallback to a user-writeable location
- Always re-calculate the lockfile
- Error
Location 4: Embedded in the source
Embed in the single-file package the same way we do the manifest. Resolving would insert/edit the lockfile entry. Editing the file should be fine, in terms of rebuilds, because this would only happen in response to an edit.
- Users can discover the location
- Users are forced to persist the lock content if they are persisting the source
- This will likely be intimidating for new users to read
- This will be more awkward to copy/paste and browse in bug reports as just a
serde_jsonlockfile is 89 lines long - This makes it harder to resolve conflicts (users can't just checkout the old file and have it re-resolved)
- A policy is needed when the location is read-only
- Fallback to a user-writeable location
- Always re-calculate the lockfile
- Error
Location 5: Minimal Versions
Instead of tracking a distinct lockfile, we can get most of the benefits with
[-Zminimal-versions](JEP 330: Launch Single-File Source-Code Programs).
- Consistent runs across machines without a lockfile
- More likely to share versions across single-file packages, allowing more reuse within the shared build cache
- Deviates from how resolution typically happens, surprising people
- Not all transitive dependencies have valid version requirements
Configuration 1: Hardcoded
Unless as a fallback due to a read-only location, the user has no control over the lockfile location.
Configuration 2: Command-line flag
cargo generate-lockfile --manifest-path <file>.rs would be special-cased to
write the lockfile to the persistent location and otherwise we fallback to a
no-visible-lockfile solution.
- Passing flags in a
#!doesn't work cross-platform
Configuration 3: A new manifest field
We could add a workspace.lock field to control some lockfile location
behavior, what that is depends on the location on what policies we feel
comfortable making. This means we would allow limited access to the
[workspace] table (currently the whole table is verboten).
- Requires manifest design work that is likely specialized to just this feature
Configuration 4: Exitence Check
cargo can check if the lockfile exists in the agreed-to location and use
it / update it and otherwise we fallback to a no-visible-lockfile solution. To
initially opt-in, a user could place an empty lockfile in that location
edition
A policy on this needs to balance
- Matching the expectation of a reproducible Rust experience
- Users wanting the latest experience, in general
- Boilerplate runs counter to experimentation and prototyping
- There might not be a backing file if we read from
stdin
Option 1: Fixed Default
Multi-file packages default the edition to 2015, effectively requiring every
project to override it for a modern rust experience. People are likely to get
this by running cargo new and could easily forget it otherwise.
#!/usr/bin/env cargo
//! ```cargo
//! [package]
//! edition = "2018"
//! ```
fn main() {
}
Option 2: Latest as Default
Default to the edition for the current cargo version, assuming single-file
packages will be transient in nature and users will want the current edition.
Longer-lived single-file packages are likely to be used with
- other cargo commands, like
cargo test, so warning wheneditionis defaulted can raise awareness - workspaces (future possibility), where single-file packages will implicitly inherit
workspace.edition
#!/usr/bin/env cargo
fn main() {
}
Option 3: No default
It is invalid for an embedded manifest to be missing edition, erroring when it is missing.
The minimal single-package file would end up being:
#!/usr/bin/env cargo
//! ```cargo
//! [package]
//! edition = "2018"
//! ```
fn main() {
}
This dramatically increases the amount of boilerplate to get a single-file package going.
Option 4: Auto-insert latest
When the edition is unspecified, we edit the source to contain the latest edition.
#!/usr/bin/env cargo
fn main() {
}
is automatically converted to
#!/usr/bin/env cargo
//! ```cargo
//! [package]
//! edition = "2018"
//! ```
fn main() {
}
This won't work for the stdin case.
Option 5: cargo --edition <YEAR>
Users can do:
#!/usr/bin/env -S cargo --edition 2018
fn main() {
}
The problem is this does not work on all platforms that support #!
Option 6: cargo-<edition> variants
Instead of an extra flag, we embed it in the binary name like:
#!/usr/bin/env -S cargo-2018
fn main() {
}
single-file packages will fail if used by cargo-<edition> and package.edition are both specified.
On unix-like systems, these could be links to cargo can
parse argv[0] to extract the edition.
However, on Windows the best we can do is a proxy to redirect to cargo.
Over the next 40 years, we'll have dozen editions which will bloat the directory, both in terms of the number of files (which can slow things down) and in terms of file size on Windows.
Scope
The cargo-script family of tools has a single command
- Run
.rsfiles with embedded manifests - Evaluate command-line arguments (
--expr,--loop)
This behavior (minus embedded manifests) mirrors what you might expect from a scripting environment, minus a REPL. We could design this with the future possibility of a REPL.
However
- The needs of
.rsfiles and REPL / CLI args are different, e.g. where they get their dependency definitions - A REPL is a lot larger of a problem, needing to pull in a lot of interactive behavior that is unrelated to
.rsfiles - A REPL for Rust is a lot more nebulous of a future possibility, making it pre-mature to design for it in mind
Therefore, this RFC proposes we limit the scope of the new command to cargo run for single-file rust packages.
Naming
Considerations:
- The name should tie it back to
cargoto convey that relationship - The command that is run in a
#!line should not require arguments (e.g. not#!/usr/bin/env cargo <something>) because it will fail.envtreats the rest of the line as the bin name, spaces included. You need to useenv -Sbut that wasn't supported on macOS at least, last I tested. - Either don't have a name that looks like a cargo-plugin (e.g. not
cargo-<something>) to avoid confusion or make it work (by default,cargo somethingtranslates tocargo-something somethingwhich would be ambiguous of whethersomethingis a script or subcommand)
Candidates
-
cargo-script:- Out of scope
- Verb preferred
-
cargo-shell:- Out of scope
- Verb preferred
-
cargo-run:- This would be shorthand for
cargo run --manifest-path <script>.rs - Might be confusing to have slightly different CLI between
cargo-runandcargo run - Could add a positional argument to
cargo runbut those are generally avoided in cargo commands
- This would be shorthand for
-
cargo-eval:- Currently selected proposal
- Might convey REPL behavior
- How do we describe the difference between this and
cargo-run?
-
cargo-exec- How do we describe the difference between this and
cargo-run?
- How do we describe the difference between this and
-
cargo:- Mirror Haskell's
cabal - Could run into confusion with subcommands but only
- the script is in the
PATH - the script doesn't have a file extension
- You are trying to run it as
cargo <script>(at least on my machine,#!invocations canonicalize the file name)
- the script is in the
- Might affect the quality of error messages for invalid subcommands unless we just assume
- Restricts access to more complex compiler settings unless a user switches
over to
cargo runwhich might have different defaults (e.g. settingRUST_BACKTRACE=1) - Forces us to have all commands treat these files equally (e.g.
--<edition>solution would need to be supported everywhere). - Avoids the risk of overloading a
cargo-script-like command to do everything special for single-file packages, whether its running them, expanding them into multi-file packages, etc.
- Mirror Haskell's
First vs Third Party
As mentioned, a reason for being first-party is to standardize the convention for this which also allows greater interop.
A default implementation ensures people will use it. For example, clap
received an issue with a reproduction case using a cargo-play script that
went unused because it just wasn't worth installing yet another, unknown tool.
This also improves the overall experience as you do not need the third-party command to replicate support for every potential feature including:
-
cargo testand other built-in cargo commands -
cargo expandand other third-party cargo commands -
rust-analyzerand other editor/IDE integration
While other third-party cargo commands might not immediately adopt single-file packages, first-party support for them will help encourage their adoption.
This still leaves room for third-party implementations, either differentiating themselves or experimenting with
- Alternative caching mechanisms for lower overhead
- Support for implicit
main, like doc-comment examples - Template support for implicit
mainfor customizinguse,extern,#[feature], etc - Short-hand dependency syntax (e.g.
//# serde_json = "*") - Prioritizing other workflows, like runtime performance
File association on Windows
We would add a non-default association to run the file. We don't want it to be a default, by default, to avoid unintended harm and due to the likelihood someone is going to want to edit these files.
File extension
Should these files use .rs or a custom file extension?
Reasons for a unique file type
- Semantics are different than a normal
.rsfile- Except already a normal
.rsfile has context-dependent semantics (rest of project,Cargo.toml, etc), so this doesn't seem too far off
- Except already a normal
- Different file associations for Windows
- Better detection by tools for the new semantics (particularly
rust-analyzer)
Downsides to a custom extension
- Limited support by different tools (rust-analyzer, syntax highlighting, non-LSP editor actions) as adoptin rolls out
At this time, we do not see enough reason to use a custom extension when facing the downsides to a slow roll out.
While rust-analyzer needs to be able to distinguish regular .rs files from
single-file packages to look up the relevant manifest to perform operations, we
propose that be through checking the #! line (e.g.
how perl detects perl in the #!.
While this adds boilerplate for Windows developers, this helps encourage
cross-platform development.
If we adopted a unique file extensions, some options include:
-
.crs(used bycargo-script) -
.ers(used byrust-script)- No connection back to cargo
-
.rss- No connection back to cargo
- Confused with RSS
-
.rsscript- No connection back to cargo
- Unwieldy
-
.rspkg- No connection back to cargo but conveys its a single-file package
Prior art
Rust, same space
-
cargo-script- Single-file (
.crsextension) rust code- Partial manifests in a
cargodoc comment code fence or dependencies in a comment directive -
run-cargo-scriptfor she-bangs and setting up file associations on Windows
- Partial manifests in a
- Performance: Shares a
CARGO_TARGET_DIR, reusing dependency builds -
--expr <expr>for expressions as args (wraps in a block and prints blocks value as{:?})-
--depflags since directives don't work as easily
-
-
--loop <expr>for a closure to run on each line -
--test, etc flags to make up for cargo not understanding thesefiles -
--forceto rebuildand--clear-cache` - Communicates through scrpts through some env variables
- Single-file (
-
cargo-scripter- See above with 8 more commits
-
cargo-eval- See above with a couple more commits
-
rust-script- See above
- Changed extension to
.ers/.rs - Single binary without subcommands in primary case for ease of running
- Implicit main support, including
async main(different implementation than rustdoc) -
--toolchain-versionflag
-
cargo-play- Allows multiple-file scripts, first specified is the
main - Dependency syntax
//# serde_json = "*" - Otherwise, seems like it has a subset of
cargo-scripts functionality
- Allows multiple-file scripts, first specified is the
-
cargo-wop-
cargo wopis to single-file rust scripts ascargois to multi-file rust projects - Dependency syntax is a doc comment code fence
-
Rust, related space
-
Playground
- Includes top 100 crates
-
Rust Explorer
- Uses a comment syntax for specifying dependencies
-
runner- Global
Cargo.tomlwith dependencies added viarunner --add <dep>and various commands / args to interact with the shared crate - Global, editable prelude / template
-
-e <expr>support -
-i <expr>support for consuming and printing iterator values -
-n <expr>runs per line
- Global
-
evcxr- Umbrella project which includes a REPL and Jupyter kernel
- Requires opting in to not ending on panics
- Expressions starting with
:are repl commands - Limitations on using references
-
irust- Rust repl
- Expressions starting with
:are repl commands - Global, user-editable prelude crate
-
papyrust
- Not single file; just gives fast caching for a cargo package
D
-
rdmd
- More like
rustc, doesn't support package-manager dependencies? -
--eval=<code>flag -
--loop=<code>flag -
--forceto rebuild -
--mainfor adding an emptymain, e.g. when running a file with tests
- More like
-
dub
-
dub hello.dis shorthand fordub run --single hello.d - Regular nested block comment (not doc-comment) at top of file with
dub.sdl:header
-
Java
- JEP 330: Launch Single-File Source-Code Programs
-
jbang
-
jbang initw/ templates -
jbang editsupport, setting up a recommended editor w/ environment - Discourages
#!and instead encourages looking like shell code with///usr/bin/env jbang "$0" "$@" ; exit $? - Dependencies and compiler flags controlled via comment-directives, including
-
//DEPS info.picocli:picocli:4.5.0(gradle-style locators)- Can declare one dependency as the source of versions for other dependencies (bom-pom)
//COMPILE_OPTIONS <flags>//NATIVE_OPTIONS <flags>//RUNTIME_OPTIONS <flags>
-
- Can run code blocks from markdown
-
--codeflag to execute code on the command-line - Accepts scripts from
stdin
-
Kotlin
-
kscript (subset is now supported in Kotlin)
- Uses an annotation/attribute-like syntqx
.NET
-
dotnet-script
-
#repl directives can appear on lines following#!
-
Haskell
-
runghc/runhaskell- Users can use the file stem (ie leave off the extension) when passing it in
-
cabal's single-file haskel script
- Command is just
cabal, which could run into weird situations if a file has the same name as a subcommand - Manifest is put in a multi-line comment that starts with
cabal: - Scripts are run with
--quiet, regardless of which invocation is used - Documented in their "Getting Started" and then documented further under
cabal run.
- Command is just
-
stack script-
stackacts as a shortcut for use in#! - Delegates resolver information but can be extended on the command-line
- Command-line flags may be specified in a multi-line comment starting with
stack script
-
Bash
-
bashto get an interactive way of entering code -
bash filewill run the code infile,searching inPATHif it isn't available locally -
./filewith#!/usr/bin/env bashto make standalone executables -
bash -c <expr>to try out an idea right now - Common configuration with rc files,
--rcfile <path>
Python
-
pythonto get an interactive way of entering code -
python -i ...to make other ways or running interactive -
python <file>will run the file -
./filewith#!/usr/bin/env pythonto make standalone executables -
python -c <expr>to try out an idea right now - Can run any file in a project (they can have their own "main") to do whitebox exploratory programming and not just blackblox
Go
-
gorunattempts to bring that experience to a compiled language, go in this case-
gorun <file>to build and run a file - Implicit garbage collection for build cache
- Project metadata is specified in HEREDOCs in regular code comments
-
Perl
Ruby
-
bundler/inline- Uses a code-block to define dependencies, making them available for use
Cross-language
-
scriptisto- Supports any compiled language
- Comment-directives give build commands
-
nix-script
- Nix version of scriptisto, letting you use any Nix dependency
See also Single-file scripts that download their dependencies
Unresolved questions
- Can we have both script stability and make it easy to be on the latest edition?
- Could somehow "lock" to what is currently in the shared script cache to avoid
each script getting the latest version of a crate, causing churn in
target/? - Since single-file packages cannot be inferred and require an explicit
--manifest-path, is there an alternative shorthand we should provide, like a short-flag for--manifest-path?-
pis taken by--package -
-m,-M, and-Pare available, but are the meanings clear enough?
-
- Is there a way we could track what dependency versions have been built in the
CARGO_TARGET_DIRand give preference to resolve to them, if possible. -
.cargo/config.tomland rustup-toolchain behavior- These are "environment" config files
- Should
cargorun likecargo runand use the current environment or likecargo installand use a consistent environment from run-to-run of the target? - It would be relatively easy to get this with
.cargo/config.tomlbut doing so for rustup would require a new proxy that understandscargo <file.rs>CLI. - This would also reduce unnecessary rebuilds when running a personal script
(from
PATH) in a project that has an unrelated.cargo/config.toml
Future possibilities
Executing <stdin>
We could extend this to allow accepting single-file packages from stdin, either
explicitly with - or implicitly when <stdin> is not interactive.
Implicit main support
Like with doc-comment examples, we could support an implicit main.
Ideally, this would be supported at the language level
- Ensure a unified experience across the playground,
rustdoc, andcargo -
cargocan directly run files rather than writing to intermediate files- This gets brittle with top-level statements like
extern(more historical) or bin-level attributes
- This gets brittle with top-level statements like
Behavior can be controlled through editions
A REPL
See the REPL exploration
In terms of the CLI side of this, we could name this cargo shell where it
drops you into an interactive shell within your current package, loading the
existing dependencies (including dev). This would then be a natural fit to also have a --eval <expr> flag.
Ideally, this repl would also allow the equivalent of python -i <file>, not
to run existing code but to make a specific file's API items available for use
to do interactive whitebox testing of private code within a larger project.
Workspace Support
Allow scripts to be members of a workspace.
The assumption is that this will be opt-in, rather than implicit, so you can
easily drop one of these scripts anywhere without it failing because the
workspace root and the script don't agree on workspace membership. To do this,
we'd expand package.workspace to also be a bool to control whether a
workspace lookup is disallowed or whether to auto-detect the workspace
- For
Cargo.toml,package.workspace = trueis the default - For cargo-script,
package.workspace = falseis the default
When a workspace is specified
- Use its target directory
- Use its lock file
- Be treated as any other workspace member for
cargo <cmd> --workspace - Check what
workspace.packagefields exist and automatically apply them over default manifest fields - Explicitly require
workspace.dependenciesto be inherited- I would be tempted to auto-inherit them but then
cargo rms gc will remove them because there is no way to know they are in use
- I would be tempted to auto-inherit them but then
- Apply all
profileandpatchsettings
This could serve as an alternative to
cargo xtask with scripts sharing
the lockfile and target/ directory.
Scaling up
We provide a workflow for turning a single-file package into a multi-file
package, on cargo-new / cargo-init. This would help smooth out the
transition when their program has outgrown being in a single-file.