Big Data Engineer

Schibsted Spain
Empowering people in their daily lives

Job details

Apply now

Sign up to apply

Or sign up to refer and earn a reward of €300

Intro

Are you a curious, positive and proactive person? Are you passionate about technology? Do you need to work in an environment with real values? Then take a look at our 5 core values:

  • Sharing and collaborating for the common good
  • Satisfaction for our users and customers
  • Integrity in everything we do
  • Personal drive to achieve our dreams
  • Joy in working together

If you share and feel the same values, keep reading! Right now we are looking for a Big Data Engineer to join our Data and Insights team. In this role, you will have the following challenges:

  • Be part in our project of building the Schibsted Spain's centralized data source (DataSwamp & DataLake) and the company's Data Warehouse that will feed from it, consolidating data from our different sites: Infojobs, Fotocasa, Vibbo, Milanuncios, Coches.net, Motos.net, Habitaclia
  • Implement, automate & optimize data pipelines, both batch daily extractions and realtime streaming, to feed our data source in S3
  • Provide the department with tools to query our data repository in an easy & fast way
  • Help Schibsted Spain taking data-driven decisions to empower & improve our customer's experience

Main requirements

  • Amazon Web Services. Specifically, deploying EMR clusters, ingesting data from/to S3 FileSystem, querying Redshift, etc.

  • Good programming skills with Python and Java

  • Knowledge of SQL querying. Expertise in multiple DBs (PostgreSQL, SQLServer) and query optimization will be a plus

  • Good scripting skills to request API REST datasets, schedule queries, etc.

  • Big Data-related tools: Spark, Kafka consumers, Sqoop. Expertise in Spark transformations will be a plus

  • Continuous Integration and automation (Jenkins)

  • Version control (GitHub)

Nice to have

  • Having been involved in other Big Data and/or Business Intelligence projects

  • VMs (Docker)

  • Data visualization tools & dashboards: Zeppelin, Qlik, etc.

  • Scrum & Jira tools

Perks

  • Being part of a company, with an excellent working environment
  • Modern and creative offices
  • Flexible working hours 8-10h/17-19h
  • Fridays afternoon off
  • Intensive workday during summer months and Easter
  • Working with the best professionals in a leading company
  • Opportunities for development and growth within the company and the international group
  • Macbook Pro or Dell laptop

Apply now

Sign up to apply

Or sign up to refer and earn a reward of €300