Tuesday, January 25, 2022

Configuring a Snowflake storage integration to access Amazon S3

Purpose of the article: Snow flake storage integration with IAM role and storage in s3 buckets 

Tools and Technology: AWS, Snowflake.

Keywords: Connect with snowflake and store the data in amazon console.

why storage integration is important????

Many more  secure way  of integration the external agent.
  • Snowflake provide is called as storage integrating 
  • provide trust between snowflake the external agents with represent to the storage.

step by step process to "snowflake and store the data in amazon console":

Step 1:

  • Firstly login with aws account then search for s3 service, now we need to create s3 buckets.

  • After clicking create bucket give buckets name.

  • Block public access setting for this bucket need to uncheck and select block public access acknowledge.




  • done s3 buckets get created in aws console.
Step 2:

What is IAM Role?

  • An IAM role is similar to an IAM user, in that it is an AWS identity with permission policies that determine what the identity can and cannot do in AWS. However, instead of being uniquely associated with one person, a role is intended to be assumable by anyone who needs it.
  • Search for roles in dashboard and select IAM (Identity and Access Management )  feature
  • In this we need to search for s3. As shown in figure.
  • Click s3 allow s3 to call AWS services on your behalf.
  • Next click to next permission.
  • Here we need to find Amazon a3 full access.
  • click next tags ,then role got create.


Step 3:
  • In this we have some query to execute in snowflake to fetch the data .
  • copy the  STORAGE_AWS_IAM_USER_ARN  ,STORAGE_AWS_EXTERNAL_ID  they properties values.
  • Connect between the aws and snowflake.
     


Step 4:

why policy AWS ..?
  • A policy is an object in AWS that, when associated with an identity or resource, defines their permissions. AWS evaluates these policies when an IAM principal (user or role) makes a request. Permissions in the policies determine whether the request is allowed or denied. Most policies are stored in AWS as JSON documents.
  • In this fig we notice trust relationship -----> edit trust relationship.
 
  • we check like edit trust relationship--->condition--->keys--->value.


Step 5:
  • Using some query we can find connection between the snowflake to aws.
  • step by step process to upload the csv file in s3 bucket.

Step 6:
  • Connection between the aws to snowflake by query.
  • Done with  the file loading in snowflake.



Conclusion:
         In this way, you can be able to fetch the data access Snowflake storage integration to access Amazon.























No comments:

Post a Comment