Senior Data Platform Engineer

About the company: Damia Group is an international tech recruitment agency with 3 decades of experience. Our arrival in Portugal, 7 years later, was set on a mission to transform IT recruitment experiences and, through them, achieve better results. We believe in long-term relationships with a transparent and relaxed mindset. In a short period, we have reached the hearts of both scale-ups and larger organisations by delivering spot-on curated candidate shortlists, increased job offer acceptance rates and shorter time-to-fill.

<!--block-->About the role: We're looking for a talented multi-disciplinary Senior Data Platform Engineer with a passion for infrastructure, who will be responsible for the performance, scale, and stability of their core data platform products. They are a data-driven organization, ingesting data at high rates, with demands increasing each day.<!--block-->As a Senior Data Platform Engineer, you will be part of the Data Platform group and will be responsible for a large-scale production data platform that serves as the core infrastructure of their products. You'll develop self-service tools that support the accessibility of their platform for the use of their users from R&D and Analytics departments. They will look to you to be a center of knowledge, consult, and share your expertise with others.<!--block-->
<!--block-->What you'll be doing

• <!--block-->Lead the development of AI-ready data platform foundations, including data quality, contracts, observability, and self-service tooling that power machine learning and AI-driven products
• <!--block-->Administer, provision, and monitor their different platform products
• <!--block-->Develop, maintain, and enhance the application infrastructure that works tightly with their Data Platform infrastructure tools
• <!--block-->Guide development teams and mentor other team members
• <!--block-->Use your creativity to resolve complex and high-scale data-related issues
• <!--block-->Research new technologies, starting from POC level to production-grade systems

<!--block--> <!--block-->Requirements

• <!--block-->6+ years of prior experience as a Data Platform Engineer / Big Data Infrastructure engineer or equivalent
• <!--block-->Deep understanding of distributed systems, in terms of ingestion, storage, and access
• <!--block-->Hands-on experience with Data Streaming technologies: Apache Kafka / Apache Pulsar / Spark Streaming / Kstream / Apache Flink 
• <!--block-->B.Sc. in Computer Science (or equivalent)
• <!--block-->Experience working on large-scale, production-grade projects

<!--block-->Advantage

• <!--block-->Experience with tools like Apache Spark and Databricks.
• <!--block-->Experience with the Cloud Native stack( Kubernetes / Prometheus/Istio etc.)
• <!--block-->Experience with a cloud provider (AWS, Google etc.)
• <!--block-->Experience with Infrastructure tools (Helm, Ansible, Terraform etc.) 
• <!--block-->Experience with Scala