When the backend service returns an HTTP 500, the object store panics

[yinbo3]

Describe the bug

object_store version: 0.12.1

HTTP Response:

Error performing PUT http://192.168.1.120:9000/test/2t.parquet?partNumber=2&uploadId=OTQ1NTJiMzMtODllZi00OTk1LWFhNjUtMjQyNDNjODdmNjIyLjI3ZjRlZjY3LTViMz
ctNDEzZi1iMTg4LWQ4OTVhZTg2ZGZjY3gxNzUwMjk4NjEwNjE2MDAxNjA4 in 563.033234ms, after 2 retries, max_retries: 2, retry_timeout: 5s  - Server returned non-2xx status code: 500 Internal Server Error

 Error performing PUT http://192.168.1.120:9000/ct.parquet?partNumber=2&uploadId=OTQ1NTJiMzMtODllZi00OTk1LWFhNjUtMjQyNDNjODdmNjIyLjdlOTNhNTQxLTg4ZTctNDc0My05YTZhLTYwNjYwOWQxMjcwOXgxNzUwMjk4NjEzNzM2MDQ4NTEy in 51.1055ms - Server returned non-2xx status code: 400 Bad Request: <?xml version="1.0" encoding="UTF-8"?>
<Error><Code>IncompleteBody</Code><Message>You did not provide the number of bytes specified by the Content-Length HTTP header.</Message><Key>ct.parquet</Key><BucketName>benchmark</BucketName><Resource>ct.parquet</Resource><RequestId>184A4F50D37513EA</RequestId><HostId>dd9025bab4ad464b049177c95eb6ebf374d3b3fd1af9251148b658df7ac2e3e8</HostId></Error>

Panic occurred in file '/root/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/object_store-0.12.1/src/buffered.rs' at line 406
"""
cause = "`async fn` resumed after completion"
method = "Panic"

To Reproduce

Expected behavior

Additional context

[alamb]

This certainly looks not great -- if anyone can get a reproducer that would likely be the first place to start