Data Engineer
As a Data Engineer at Lighthouse, you will play a pivotal role in the end-to-end lifecycle of our large-scale data ingestion and transformation engine. You will be part of a dynamic team dedicated to designing, developing, scaling, and maintaining data pipelines that handle vast data streams, processing over 100 terabytes daily. This position offers the opportunity to work on greenfield data engineering projects, delve into complex hospitality data domains, and enhance the stability and quality of existing pipelines.
Your primary responsibilities will include designing, building, and deploying scalable data pipelines that ingest data from diverse sources such as APIs, webhooks, SFTP, and cloud storage. You will implement complex domain modeling and transformation logic to unify disparate data sources into high-fidelity data products. Additionally, you will focus on architectural improvements by transitioning legacy processes into modern, scalable, and stable data architectures. Ensuring operational excellence, you will enhance the reliability and quality of our data pipelines through advanced observability, automated testing, and self-healing features. Collaboration with product teams, other engineering teams, support and business units, customers, and partners will be essential. You will also participate in investigating and resolving complex technical issues, performing deep-dive analyses into our code and systems to identify root causes, and drive engineering velocity by applying AI to expedite development and streamline debugging and recurring tasks.
The ideal candidate will have experience in architecting, designing, implementing, testing, deploying, and maintaining complex data architectures and pipelines. Proficiency in Python for large-scale data processing and pipeline development is required. Strong knowledge of data cloud technologies, data streaming systems like Kafka or Google Cloud Pub/Sub, and cloud database solutions such as BigQuery, Snowflake, or Databricks is essential. Hands-on experience with major cloud platforms like GCP, AWS, or Azure is also necessary. A forward-thinking approach to using AI-assisted tools to enhance code quality and development speed is highly valued. Fluency in English, with excellent communication and stakeholder management skills, is crucial for navigating technical discussions and explaining complex data flows to non-technical stakeholders.
Lighthouse offers a flexible time-off policy, allowing you to manage your work-life balance autonomously. Career development is supported through workshops, frameworks, and training to maximize your professional potential. Your work will have a significant impact, shaping products relied on by over 85,000 users worldwide. Additional benefits include mobility options such as a mobility budget or company car, net allowances to support home office-related expenses, lunch and eco vouchers, comprehensive health insurance covering you and your dependents, pension funding through group insurance, and referral bonuses for bringing in new talent.
At Lighthouse, we foster a collaborative, fun, and deeply committed community, working together to revolutionize the hospitality sector. Joining our team means becoming part of an exciting journey to disrupt commercial strategy for the hospitality industry. With a diverse team spanning 35 countries and representing 34 nationalities, we are dedicated to innovation and growth. If you are ready to shine brighter in the industry's most exciting rocket-ship, we invite you to join us.