test passes for me locally now, but v2-v3 can be flakey

maybe we can move some of these to the nightly since they shouldn't be changing

Originally posted by @evan-forbes in #5496 (comment)

we should move all but the most recent upgrade to the nightlies to save time in PRs. Assuming no changes to the multiplexer, the binaries that are being used are the same each time, so there's no reason to run them on each PR.