Tools: 8.Sync Data to S3 Bucket with Terraform

Lab Information ## Lab Solutions ## Resources & Next Steps ## 📦 Full Code Repository: KodeKloud Learning Labs ## 📖 More Deep Dives: Whispering Cloud Insights - Read other technical articles ## 💬 Join Discussion: DEV Community - Share your thoughts and questions ## 💼 Let's Connect: LinkedIn - I'd love to connect with you ## Credits ## • All labs are from: KodeKloud ## • I sincerely appreciate your provision of these valuable resources. As part of a data migration project, the team lead has tasked the team with migrating data from an existing S3 bucket to a new S3 bucket. The existing bucket contains a substantial amount of data that must be accurately transferred to the new bucket. The team is responsible for creating the new S3 bucket using Terraform and ensuring that all data from the existing bucket is copied or synced to the new bucket completely and accurately. It is imperative to perform thorough verification steps to confirm that all data has been successfully transferred to the new bucket without any loss or corruption. As a member of the Nautilus DevOps Team, your task is to perform the following using Terraform: The grader explicitly checks that the bucket name comes from variables.tf. 3️⃣ Update main.tf (append below existing code) Because the lab already had partial state, do this cleanly: terraform init terraform validate terraform apply 🧠 Simple Explanation Let’s connect this to the lab requirements line by line: ✅ “Create a New Private S3 Bucket using variables.tf” ✔ Bucket name comes from var.KKE_BUCKET ✔ Value is set in terraform.tfvars ✔ ACL is private ✅ “Migrate all data from existing bucket” ✔ aws s3 sync copies all objects ✔ Folder structure preserved ✔ No missing files ✅ “Ensure data consistency” ✔ sync ensures source and destination match ✔ Can be re-run safely ✔ No duplication ✔ Terraform creates infrastructure ✔ Terraform triggers migration ✔ Terraform controls execution order ✅ “Do not create separate .tf file for resources” ✔ Everything added to main.tf ✔ Only variables.tf and outputs.tf are separate (as required) Templates let you quickly answer FAQs or store snippets for re-use. Are you sure you want to hide this comment? It will become hidden in your post, but will still be visible via the comment's permalink. Hide child comments as well For further actions, you may consider blocking this person and/or reporting abuse CODE_BLOCK: Create a New Private S3 Bucket: Name the bucket devops-sync-31997 and store this bucket name in a variable named KKE_BUCKET. Data Migration: Migrate all data from the existing devops-s3-17362 bucket to the new devops-sync-31997 bucket. Ensure Data Consistency: Ensure that both buckets contain the same data after migration. Update the main.tf file (do not create a separate .tf file) to provision a new private S3 bucket and migrate the data. Use the variables.tf file with the following variable: KKE_BUCKET: The name for the new bucket created. Use the outputs.tf file with the following outputs: new_kke_bucket_name: The name of the new bucket created. new_kke_bucket_acl: The ACL of the new bucket created. Enter fullscreen mode Exit fullscreen mode CODE_BLOCK: Create a New Private S3 Bucket: Name the bucket devops-sync-31997 and store this bucket name in a variable named KKE_BUCKET. Data Migration: Migrate all data from the existing devops-s3-17362 bucket to the new devops-sync-31997 bucket. Ensure Data Consistency: Ensure that both buckets contain the same data after migration. Update the main.tf file (do not create a separate .tf file) to provision a new private S3 bucket and migrate the data. Use the variables.tf file with the following variable: KKE_BUCKET: The name for the new bucket created. Use the outputs.tf file with the following outputs: new_kke_bucket_name: The name of the new bucket created. new_kke_bucket_acl: The ACL of the new bucket created. CODE_BLOCK: Create a New Private S3 Bucket: Name the bucket devops-sync-31997 and store this bucket name in a variable named KKE_BUCKET. Data Migration: Migrate all data from the existing devops-s3-17362 bucket to the new devops-sync-31997 bucket. Ensure Data Consistency: Ensure that both buckets contain the same data after migration. Update the main.tf file (do not create a separate .tf file) to provision a new private S3 bucket and migrate the data. Use the variables.tf file with the following variable: KKE_BUCKET: The name for the new bucket created. Use the outputs.tf file with the following outputs: new_kke_bucket_name: The name of the new bucket created. new_kke_bucket_acl: The ACL of the new bucket created. CODE_BLOCK: variable "KKE_BUCKET" { type = string } Enter fullscreen mode Exit fullscreen mode CODE_BLOCK: variable "KKE_BUCKET" { type = string } CODE_BLOCK: variable "KKE_BUCKET" { type = string } CODE_BLOCK: KKE_BUCKET = "devops-sync-31997" Enter fullscreen mode Exit fullscreen mode CODE_BLOCK: KKE_BUCKET = "devops-sync-31997" CODE_BLOCK: KKE_BUCKET = "devops-sync-31997" COMMAND_BLOCK: # Already existed resource "aws_s3_bucket" "wordpress_bucket" { bucket = "devops-s3-17362" } resource "aws_s3_bucket_acl" "wordpress_bucket_acl" { bucket = aws_s3_bucket.wordpress_bucket.id acl = "private" } # Create the NEW private bucket (from variable) resource "aws_s3_bucket" "sync_bucket" { bucket = var.KKE_BUCKET } resource "aws_s3_bucket_acl" "sync_bucket_acl" { bucket = aws_s3_bucket.sync_bucket.id acl = "private" } # Perform data migration (Terraform-triggered) resource "null_resource" "s3_sync" { provisioner "local-exec" { command = "aws s3 sync s3://devops-s3-17362 s3://${var.KKE_BUCKET}" } depends_on = [ aws_s3_bucket.sync_bucket ] } Enter fullscreen mode Exit fullscreen mode COMMAND_BLOCK: # Already existed resource "aws_s3_bucket" "wordpress_bucket" { bucket = "devops-s3-17362" } resource "aws_s3_bucket_acl" "wordpress_bucket_acl" { bucket = aws_s3_bucket.wordpress_bucket.id acl = "private" } # Create the NEW private bucket (from variable) resource "aws_s3_bucket" "sync_bucket" { bucket = var.KKE_BUCKET } resource "aws_s3_bucket_acl" "sync_bucket_acl" { bucket = aws_s3_bucket.sync_bucket.id acl = "private" } # Perform data migration (Terraform-triggered) resource "null_resource" "s3_sync" { provisioner "local-exec" { command = "aws s3 sync s3://devops-s3-17362 s3://${var.KKE_BUCKET}" } depends_on = [ aws_s3_bucket.sync_bucket ] } COMMAND_BLOCK: # Already existed resource "aws_s3_bucket" "wordpress_bucket" { bucket = "devops-s3-17362" } resource "aws_s3_bucket_acl" "wordpress_bucket_acl" { bucket = aws_s3_bucket.wordpress_bucket.id acl = "private" } # Create the NEW private bucket (from variable) resource "aws_s3_bucket" "sync_bucket" { bucket = var.KKE_BUCKET } resource "aws_s3_bucket_acl" "sync_bucket_acl" { bucket = aws_s3_bucket.sync_bucket.id acl = "private" } # Perform data migration (Terraform-triggered) resource "null_resource" "s3_sync" { provisioner "local-exec" { command = "aws s3 sync s3://devops-s3-17362 s3://${var.KKE_BUCKET}" } depends_on = [ aws_s3_bucket.sync_bucket ] } CODE_BLOCK: output "new_kke_bucket_name" { value = aws_s3_bucket.sync_bucket.bucket } output "new_kke_bucket_acl" { value = aws_s3_bucket_acl.sync_bucket_acl.acl } Enter fullscreen mode Exit fullscreen mode CODE_BLOCK: output "new_kke_bucket_name" { value = aws_s3_bucket.sync_bucket.bucket } output "new_kke_bucket_acl" { value = aws_s3_bucket_acl.sync_bucket_acl.acl } CODE_BLOCK: output "new_kke_bucket_name" { value = aws_s3_bucket.sync_bucket.bucket } output "new_kke_bucket_acl" { value = aws_s3_bucket_acl.sync_bucket_acl.acl }