Beechwood Centre, 40 Lower Gravel Road, Bromley, BR2 8GP

AWS Data Engineer

My Client is looking for a AWS Data Architect.

The selected consultant must have Hands on experience with AWS ETL services like Glue, Lambda, EMR and experience in Real-time AWS/Big Data Analytics AWS with Python hands-on programmer requirement.

Other areas that woule be beificial for the our client would be the folowing:

Knowledge on terraform
Knowledge and experience in Agile project delivery, i.e., sprint planning and updates using tools like Atlassian JIRA etc.
Experience on Python and/or Spark programming, working with data transformation, data migration implementations and creation and use of functions, libraries, data frame
Must have experience using Python IDEs, debugging, error-handling
Knowledge on Python integration with Cloud service tools for ETL
Handling CDC data with AWS pipelines
Willing to develop and test code using Python and AWS glue, lambda.
Skills: hands-on experience on relevant skills related to AWS Data Lake inclusive of Glue, S3, Athena, EMR, DynamoDB along with PySpark (mandatory) and CI/CD exposure.