We'll explore how we can leverage all cores on a machine with rustc using many crates to speed up compilation.

Instead of emitting one giant crate containing everything, we tweaked our SQL-to-Rust compiler to split the output into many smaller crates. Each one encapsulating just a portion of the logic, neatly depending on each other, with a single top-level main crate pulling them all in.

  • sga@lemmings.worldEnglish
    1·
    5 hours ago

    i don’t really know how much could they optimise more, but they can predict it by fitting the number of cores with the amount of time taken, that is amdahl’s law.