Question

A data engineering team runs an AWS Glue Spark ETL job that must read from an Amazon RDS for PostgreSQL database located in a private subnet with no public IP. The Glue job also needs to write the transformed results to an Amazon S3 bucket. When the job runs, it fails with a connection timeout while attempting to reach the RDS instance. What is the correct way to configure Glue so it can reach both RDS and S3?

Accepted Answer

Attach a Glue connection that references the RDS VPC, subnet, and security group, and create an S3 VPC gateway endpoint in that VPC route table.

Answer

Enable a public IP on the Glue job and open the RDS security group to 0.0.0.0/0 on port 5432.

Answer

Move the RDS instance to a public subnet and assign it an Elastic IP so Glue can reach it over the internet.

Answer

Add an internet gateway to the RDS VPC and route all Glue traffic through a NAT gateway to access S3 and RDS.