all AI news
Installing Python Packages in AWS Glue using AWS CodeArtifact
DEV Community dev.to
Background of the Problem
I spent quite sometime figuring out how to install Python Packages in AWS Glue inside a VPC without internet access and I managed to figure it out after some tinkering. Just to recall, AWS introduced the support for installation of Python Packages via --additional-python-modules option. While this is a lifesaver - for those who started working with Glue 1.0, it only works if your Glue Job can connect to the internet.
Given the emphasis on security, …
aws aws glue dataengineering figure glue inside install installation internet internet access managed modules python recall support tutorial