Data Engineer

Barcelona, Spain
Posted 1 year ago

Role: Senior Data Engineer
Location: Barcelona, Spain
Type of Hiring: Permanent or FTE
Onsite

Job Description:
· AWS Certified Developer with 5+ years of designing, building, testing and operating data pipelines in AWS
· Hands on experience in building data pipelines with Python, Scala, or Java
· Hands on experiences building on the Hadoop stack especially Spark
· Experience modelling data in normalized, denormalized and graph structures
· Experience developing and operating workflow orchestration (Prefect, Apache Airflow)
· Excellent proficiency with Python, SQL, PySpark, Spark SQL
· Strong experience with schema design and data modelling
· Experience with streaming data services (Kafka, Kinesis, MKS, DMS)
· Experience with data warehousing solutions (Redshift, Snowflake)
· Experience with log based change data capture extraction (Qlik Data Integration, Attunity Replicate, AWS DMS)
· Experience with developing containerized solutions (Docker)
· Experience programming in Java and Scala
· Experience with Delta Lake, threat modeling
· Excellent verbal and written communications skills

Job Features

Job CategoryData Engineer

Apply Online