Storage Cleanup is not working for another cloud S3 Provider

[crazyfrogspb]

Just updated to the newest ClearML Server and trying to set up Yandex Cloud S3 clean up, this feature is potentially amazing

S3 uploading works fine as usual, this is my record in the config
{
host: "storage.yandexcloud.net"
key: "KEY"
secret: "SECRET",
secure: true
}

in the tasks I can see this in the Execution section
OUTPUT
DESTINATION
s3://storage.yandexcloud.net/clearml-models/breastcancer/models

In the logs of the cleaning service I see:
[2025-06-06 13:54:57,215] [1] [WARNING] [clearml.JOB-async_urls_delete.py] Error resolving base url for s3://storage.yandexcloud.net/BUCKET_NAME/breastcancer/models/MMG/Spring 2025/No Attention Experiment.c9b74abdac38493ab5c4d260a263fc90/models/attention_37.pth: Invalid host 's3://storage.yandexcloud.net'. Host strings must have at least one non-period character, can't contain any of '!@#$%^&'"*()+=:;/', and can't have adjacent periods

[ainoam]

@crazyfrogspb Just to make sure, access credentials for storage service cleanup were also added to the cleanup settings (/settings/storage-credentials)?

[crazyfrogspb]

yes, I added them in UI

I assume cleanup service expects host to be in the format "storage.yandexcloud.net", but in the experiments it's logged as "s3://storage.yandexcloud.net"

[evg-allegro]

@crazyfrogspb If in AWS Storage Credentials you specify the host like this "s3://storage.yandexcloud.net:443" does it make any difference?

[crazyfrogspb]

that's actually the only option that worked. before that cleanup service was trying to go to AWS bucket, not Yandex Cloud. after I specified it like this, I started getting different error related to invalid host string

[jkhenning]

@crazyfrogspb can you please try:

host: "storage.yandexcloud.net:443"

In the server configuration, and:

s3://storage.yandexcloud.net:443/clearml-models/breastcancer/models

when setting the output destination?

[crazyfrogspb]

what do you mean by host part? aws.s3.credentials.host?

it's currently set only in ClearML Agents clearml.conf files