TODO: Revert https://github.com/pandas-dev/pandas/pull/24591 once pyarrow is released