Custom destination namespace and stream prefix for S3 destination #64112
Unanswered
ypubalan
asked this question in
Connector Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to create a custom prefix so that I can enable partitioning in S3 during replication.
For example, I want the data to be replicated in S3 in this structure 'folder/sub_folder/stream_name/partition=1/' . However the stream name always ends up at the end like 'folder/sub_folder/stream_name/partition=1/stream_name/'. I tried using 'folder/sub_folder/${SOURCE_NAMESPACE}/partition=1/' and 'folder/sub_folder/${STREAM_NAME}/partition=1/' but it's not working. Please advice if there is any workaround.
Beta Was this translation helpful? Give feedback.
All reactions