I realize that the current naming is confusing, so while writing a tutorial I opened https://github.com/NixOS/nixpkgs/issues/126949 that hopefully gets us to a naming scheme that's more consistent with the triplets in cross compilation world.

As for the binaries, you need to compile them once and then you can use http://cachix.org/ for free to cache them.