Lead Data Engineer
Graphcore is seeking a Lead Data Engineer to join its Data & Analytics team in Bristol, UK. This role involves leading the development and enhancement of data pipelines and platform services that support analytics, reporting, and operational decision-making across the company. As a senior individual contributor, the Lead Data Engineer will play a pivotal role in shaping the direction of Graphcore's data platform and engineering practices.
The Lead Data Engineer will be responsible for designing, building, and operating Python-based batch and streaming workflows, ensuring their reliability, scalability, and performance. Key duties include developing data solutions on AWS using services such as S3, Lambda, Aurora PostgreSQL, Athena, Glue, and Redshift. The role also involves defining and applying engineering standards for data quality, observability, documentation, and operational support. Collaboration with analysts, engineers, and business stakeholders is essential to translate requirements into trusted datasets and reusable data products.
Candidates should have strong experience in designing and operating production-grade data pipelines and platforms in Python, along with hands-on experience with modern data orchestration, testing, deployment, and monitoring practices. Proficiency in building solutions on AWS data services and a solid understanding of data modeling, data quality, schema design, and performance optimization are required. Experience in designing reliable data systems that recover gracefully from failure and operate efficiently is also essential.
Graphcore offers a dynamic and innovative work environment, focusing on cutting-edge AI compute technologies. Employees have the opportunity to work alongside experts in AI research, silicon design, software engineering, and systems architecture. The company fosters a culture of collaboration and continuous learning, providing growth opportunities for professionals passionate about advancing AI technologies.