s3 backup in non aws s3 storages #4203

Citrullin · 2022-07-04T07:39:56Z

Citrullin
Jul 4, 2022

I am confused how to backup into non aws s3. I added the s3 endpoint to the endpoint field of longhorn, but I get an error message that https is not supported. The documentation states to use s3://backupbucket@us-east-1/ for minio. That doesn't seem right.
Can someone tell me where to put the endpoint and what endpoint is expected. The secret config looks straight forward though.
When I only configure it without endpoint, I get the error backup target URL is empty.
The secret is already available under the namespace onghorn-system, but it also doesn't work without UI config.

Answered by c3y1huang

Jul 6, 2022

Ref #4205 (comment)

View full answer

mantissahz · 2022-07-04T09:04:05Z

mantissahz
Jul 4, 2022
Collaborator

I think you had followed this doc set-up-aws-s3-backupstore to setup the s3 backup store.
s3://backupbucket@us-east-1/ is the correct format for longhorn to use the AWS s3 as a backup target.

4 replies

Citrullin Jul 4, 2022
Author

I think you had followed this doc set-up-aws-s3-backupstore to setup the s3 backup store. s3://backupbucket@us-east-1/ is the correct format for longhorn to use the AWS s3 as a backup target.

It doesn't matter if this endpoint doesn't exist?

Citrullin Jul 4, 2022
Author

I think you had followed this doc set-up-aws-s3-backupstore to setup the s3 backup store.
s3://backupbucket@us-east-1/ is the correct format for longhorn to use the AWS s3 as a backup target.

error listing backup volume names: failed to execute: /var/lib/longhorn/engine-binaries/longhornio-longhorn-engine-v1.3.0/longhorn [backup ls --volume-only s3://k8-backups@fr-par/], output failed to list objects with param: { Bucket: "k8-backups", Delimiter: "/", Prefix: "/" } error: AWS Error: NoSuchKey The specified key does not exist. <nil> 404 tx547183728cad4db9a80c5-0062c3714e , stderr, time="2022-07-04T23:01:34Z" level=error msg="Fail to list s3: failed to list objects with param: {\n Bucket: \"k8-backups\",\n Delimiter: \"/\",\n Prefix: \"/\"\n} error: AWS Error: NoSuchKey The specified key does not exist. <nil>\n404 tx547183728cad4db9a80c5-0062c3714e\n" pkg=s3 time="2022-07-04T23:01:34Z" level=error msg="failed to list objects with param: {\n Bucket: \"k8-backups\",\n Delimiter: \"/\",\n Prefix: \"/\"\n} error: AWS Error: NoSuchKey The specified key does not exist. <nil>\n404 tx547183728cad4db9a80c5-0062c3714e\n" , error exit status 1

Well, it doesn't work.

mantissahz Jul 5, 2022
Collaborator

It doesn't matter if this endpoint doesn't exist?

Yes, your endpoint should exist.

s3://k8-backups@fr-par/

Could you check this "<your-bucket-name>/*" is set for permissions at set-up-aws-s3-backupstore?

mantissahz Jul 5, 2022
Collaborator

Another ref: issues-3333 for you.
Is your s3 server minio?

c3y1huang · 2022-07-06T10:55:01Z

c3y1huang
Jul 6, 2022
Maintainer

Ref #4205 (comment)

0 replies

angelocorreia27 · 2023-10-21T17:23:52Z

angelocorreia27
Oct 21, 2023

I wonder when we can have this functionality. it would be very useful. I've been trying some solutions like: #4205 (comment)
But it just doesn't work.

0 replies

spuxx1701 · 2024-12-21T09:21:08Z

spuxx1701
Dec 21, 2024

Hetzner recently released an AWS-S3-compatible object storage. The actual endpoints look like this: https://name.region.your-objectstorage.com. For example, a bucket named foo at region nbg1 would be: https://foo.nbg1.your-objectstorage.com/ (clickable)

I tried a couple of conbinations to set this up with longhorn but couldnt get it to work. @mantissahz would you happen to know how I'd need to set up the URLs in longhorn?

/ Edit: I got it to work. See here: #4205 (comment)

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

s3 backup in non aws s3 storages #4203

{{title}}

Replies: 4 comments 4 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Select a reply

s3 backup in non aws s3 storages #4203

Citrullin Jul 4, 2022

Replies: 4 comments · 4 replies

mantissahz Jul 4, 2022 Collaborator

Citrullin Jul 4, 2022 Author

Citrullin Jul 4, 2022 Author

mantissahz Jul 5, 2022 Collaborator

mantissahz Jul 5, 2022 Collaborator

c3y1huang Jul 6, 2022 Maintainer

angelocorreia27 Oct 21, 2023

spuxx1701 Dec 21, 2024

Citrullin
Jul 4, 2022

Replies: 4 comments 4 replies

mantissahz
Jul 4, 2022
Collaborator

Citrullin Jul 4, 2022
Author

Citrullin Jul 4, 2022
Author

mantissahz Jul 5, 2022
Collaborator

mantissahz Jul 5, 2022
Collaborator

c3y1huang
Jul 6, 2022
Maintainer

angelocorreia27
Oct 21, 2023

spuxx1701
Dec 21, 2024