Redshift serverless auto-copy

0

Hello. Any updates when the auto-copy feature would be available for Redshift serverless cluster?

Best regards, Aki

Aki
asked 2 months ago194 views
1 Answer
1

Hello,

To implement the auto-copy feature from Amazon S3 to an Amazon Redshift serverless cluster, start by creating an IAM role with AmazonS3ReadOnlyAccess and AWSGlueConsoleFullAccess policies, and attach this role to your Redshift serverless workgroup. Then, configure an S3 bucket to store your data files. Use the following SQL command to create a table in Redshift and enable auto-copy:

CREATE TABLE my_table (
    column1 datatype,
    column2 datatype,
    ...
);

COPY my_table
FROM 's3://your-bucket-name/prefix/'
IAM_ROLE 'arn:aws:iam::your-account-id:role/RedshiftS3AccessRole'
AUTO COPY ON;

This command will set up Redshift to continuously monitor the specified S3 path and automatically copy new files as they arrive. Finally, verify the data load by querying your Redshift tables and monitor the process using CloudWatch and Redshift logging.

please look at AWS Document Link you will get more information.

https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-redshift-supports-auto-copy-amazon-s3/

https://docs.aws.amazon.com/redshift/latest/mgmt/working-with-clusters.html

EXPERT
answered 2 months ago
profile picture
EXPERT
reviewed 2 months ago
  • But this is for preview only for provisioned clusters?