Senior Data Engineer
Damia Group PortugalTech recruitment experts on a mission to provide the best recruitment exper
Skills
Description
<!--block-->The Data & Analytics Hub focuses on data processes, bringing insights to the business and contributing to improving Truck & Bus products efficiency in areas related to vehicle engineering & production and sales & after-sales.
- <!--block-->Creating and managing data pipeline architecture for data ingestion, pipeline setup, and data curation
- <!--block-->Working with and creating cloud data solutions
- <!--block-->Assembling large, complex data sets that meet functional/non-functional business requirements
- <!--block-->Implementing the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using PySpark, SQL, and AWS big data technologies
- <!--block-->Building analytics tools that use the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
- <!--block-->Manipulating data at scale: getting data into a ready-to-use state in close alignment with various business and Spoke stakeholders
Requirements
- <!--block-->Bachelor's degree in Computer Science, Software Engineering, or comparable work experience
- <!--block-->At least 5 years of experience as a Data Engineer or Software Developer, preferably in the automotive sector
- <!--block-->Strong experience with Data Lake, Data Warehouse, and RDS architectures
- <!--block-->Experience with Python, SQL (any other OOP language is also valuable), PySpark (preferred) or Spark
- <!--block-->Proven experience in ETL
- <!--block-->Strong knowledge of AWS, namely S3, Athena, Lambda, Glue, IAM, SQS, etc.
- <!--block-->Strong communication and analytical skills
- <!--block-->Excellent English skills, both written and spoken
Nice to have
- <!--block-->Experience with AWS CDK (Cloud Development Kit)
- <!--block-->Experience with CI/CD pipelines



