Senior Data Engineer

We are looking for a skilled data engineer for a 6-12 month contract inside IR35 to work on-site 2 days per week. As the Data engineer you will build scalable data solutions in a cloud-native environment. You will work on data integrations, support global initiatives, and develop automated solutions. Your role will be key in maintaining a robust and efficient data infrastructure that adapts to business needs.

Responsibilities:

  • Work with business teams to understand data needs and opportunities.
  • Build and maintain data products, ensuring data quality and governance.
  • Develop cloud-based solutions using GCP tools (e.g., BigQuery, DataFlow, DataProc).
  • Automate data processes to ensure quality, timeliness, and completeness.
  • Optimise data processing systems for performance and scalability.
  • Participate in design reviews for scalability and business acceleration.
  • Guide team members on best practices and standards.
  • Document processes and create user guides.

Skills Required:

  • Experience with GCP tools like BigQuery, DataFlow, and DataFusion.
  • Strong knowledge of SQL, Python, and PySpark.
  • Familiarity with CI/CD, Terraform, and Apache Airflow.
  • Ability to design and maintain efficient data pipelines.
  • Understanding of data security, governance, and compliance.
  • Strong problem-solving, communication, and collaboration skills.
  • Ability to work independently and with teams in a global environment.

Skills Preferred:

  • Experience with Java, MDM, and front-end technologies (Angular/React).
  • Familiarity with data visualisation tools (Tableau, Power BI).
  • Knowledge of software quality and performance tools.

Experience Required:

  • 5+ years in programming and scripting with SQL, Python, and PySpark.
  • 5+ years working across teams and with business partners.
  • 5+ years of experience leading data engineering projects.
  • 2+ years of experience with GCP cloud solutions at production scale.
  • Experience with Data Warehousing and ETL processes.

Experience Preferred:

  • Excellent communication and collaboration skills.
  • In-depth knowledge of GCP data services (BigQuery, DataFlow, etc.).
  • Experience with data governance, GDPR, and technical architecture.

Education:

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
Apply