Overview
Azure Databricks Data Engineer – London
Reference Code: 343400-en_GB
Contract Type: Permanent
Professional Communities: Data & AI
Get The Future You Want!
Choosing Capgemini means choosing a company where you will be empowered to shape yourcareer in the way you’d like, where you’ll be supported and inspired by a collaborativecommunity of colleagues around the world, and where you’ll be able to reimagine what’spossible. Join us and help the world’s leading organizations unlock the value of technology andbuild a more sustainable, more inclusive world.
Your Role:
- Design and implement robust ETL/ELT pipelines on Databricks.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver high-quality solutions.
- Optimize data workflows for performance, scalability.
- Develop and maintain data lake and data warehouse architectures.
- Ensure data quality, governance, and security standards are met.
- Lead code reviews, mentor junior engineers, and contribute to best practices in data engineering.
- Integrate Databricks with other enterprise systems and tools (e.g., Delta Lake, MLflow, Power BI, etc.).
- Monitor and troubleshoot production data pipelines and jobs.
Your Profile:
- Lead the design, development, and optimization of scalable data pipelines using Databricks.
- Drive data modernization initiatives to support advanced analytics and machine learning.
- Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
- Implement best practices for data engineering, including performance tuning and cost optimization.
- Ensure data quality, reliability, and consistency across all data platforms.
- Leverage Databricks features such as Delta Lake, notebooks, and MLflow for end-to-end workflows.
- Apply knowledge of data governance frameworks and tools, including Unity Catalog.
- Maintain and enhance data security, access controls, and compliance standards.
- Mentor junior engineers and contribute to the development of engineering standards.
- Hold relevant Databricks certifications (e.g., Databricks Certified Data Engineer Professional).
About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations toaccelerate their dual transition to a digital and sustainable world while creating tangible impact forenterprises and society. It is a responsible and diverse group of 350,000 team members in morethan 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlockthe value of technology to address the entire breadth of their business needs. It delivers end-to-endservices and solutions leveraging strengths from strategy and design to engineering, all fueled byits market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise andpartner ecosystem. The Group reported 2023 global revenues of €22.5 billion.
Get The Future You Want
www.capgemini.com
