Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Location of credentials for accessing Google Cloud #377

Merged
merged 4 commits into from
Apr 21, 2022
Merged

Conversation

pjgo
Copy link
Contributor

@pjgo pjgo commented Nov 3, 2021

I could not figure out whether s5cmd was reading credentials from .aws/credentials, .boto, or some other location when accessing Google Cloud. Moreover, Google Cloud provides several options for providing keys. I figured out through trial and error that I needed to generate HMAC keys using the Google Cloud console or gsutil and entering them into .aws/credentials.

pjgo added 2 commits November 3, 2021 14:40
Added note on location of credentials used when accessing Google Cloud
@pjgo pjgo requested a review from a team as a code owner November 3, 2021 22:04
@pjgo pjgo requested review from aykutfarsak and seruman and removed request for a team November 3, 2021 22:04
Copy link
Member

@seruman seruman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution!

README.md Outdated Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
@sonmezonur
Copy link
Member

@pjgo ping

Co-authored-by: Selman Kayrancioglu <seruman@users.noreply.github.com>
@pjgo
Copy link
Contributor Author

pjgo commented Apr 11, 2022 via email

@seruman
Copy link
Member

seruman commented Apr 11, 2022

@pjgo

I'm not able to see your responses. I think you started a code review instead of commenting directly, that might be the reason it says 'Pending'.

Yes, this seems fine.

Added note on location of credentials used when accessing Google Cloud
@pjgo
Copy link
Contributor Author

pjgo commented Apr 16, 2022 via email

@@ -429,6 +430,8 @@ or an alternative with environment variable

all variants will return your GCS buckets.

`s5cmd` reads `.aws/credentials` to access Google Cloud Storage. Populate the `aws_access_key_id` and `aws_secret_access_key` fields in `.aws/credentials` with an HMAC key created using this [procedure](https://cloud.google.com/storage/docs/authentication/managing-hmackeys#create).
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might be helpful to point to an example of .aws/credentials, perhaps it is https://docs.aws.amazon.com/cli/latest/userguide/cli-configure-files.html ? This may be obvious for AWS users, but as a someone coming from GCP, I have no idea what that file should look like.

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also, the link mentioned above specifies key and secret without quotes. For me, until I added quotes, I was getting a parsing error.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As AWS SDK has multiple credentials providers, I think we might add a link to AWS Go SDK's documentation to the https://github.com/peak/s5cmd#specifying-credentials section in a separate PR.

Copy link
Member

@seruman seruman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@seruman seruman merged commit 9a7fa24 into peak:master Apr 21, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants