Closing, looks like there's already a PR for this https://github.com/facebook/create-react-app/pull/10652