Description
Describe the feature
Add document upload support to AWS Bedrock's InvokeModel and InvokeModelWithResponseStream APIs to match functionality available in Anthropic's direct API.
Use Case
Background:
We're migrating from Anthropic's direct API to AWS Bedrock while maintaining our existing system architecture that uses Anthropic's message format ({"type":..., "text":...}) stored in RDS.
Issue:
- Cannot use AWS Bedrock's ConverseAPI due to incompatible message structure that would require extensive system rewrites
- Need document upload capabilities (like Anthropic's official API) for our RAG system.
- Need citation for our documents so that it's reduce hallucination.
- Users require support for multiple document types.
Impact:
This would enable seamless migration to Bedrock without breaking existing database schemas, streaming implementations, or Pub/Sub services.
Proposed Solution
Implements documents upload API and Citation to InvokeModelWithResponseStream and InvokeModel endpoint
Other Information
It should have the functional like documents chat for ConverseAPI or match functionality available in Anthropic's direct Document Upload API.
Acknowledgements
- I may be able to implement this feature request
- This feature might incur a breaking change
SDK version used
1.38.23
Environment details (OS name and version, etc.)
AmazonLinux 2023