Lead Data Engineer (Microsoft Fabric / Azure)

Role Overview:
Join our high-impact Data & AI team as a Lead Data Engineer (Microsoft Fabric / Azure). This role offers a chance to shape and build a modern, Fabric-first data platform. As a Technical Lead, you’ll spend ~70% of your time on hands-on engineeringand the rest on technical leadership—guiding best practices, designing architecture, and collaborating across teams and with clients. We need a data expert ready to lead by example and deliver business value through scalable, cloud-native (Fabric)data solutions.

What You Will Do:

• End-to-End Data Engineering (Hands-On Development  ~70%):Architect, develop, and orchestrate data pipelines and ETL/ELT workflows using Microsoft Fabric and Azureservices. Write and optimize SQL, Spark, and Python code to ingest, transform, and integrate large datasets from multiple sources (including APIs) into our data platform (e.g., OneLake, Fabric Lakehouse, Data Warehouse).

• Platform Architecture & Best Practices: Lead the design of a scalable, reusable Fabric-first data platform. Establish standards for data modeling, pipeline configuration, and system integration. Introduce reusable frameworks (e.g., config-driven pipeline architectures, centralized metadata) that streamline development across the team. Support the coexistence and integration of new Fabric components with existing Azure data services during the transition.

• Data Consumption & Analytics Enablement:Deliver analytics-ready datasets and well-defined semantic data models. Work with Power BI developers and analysts to ensure pipelines produce reliable, high-quality data for business reporting and self-service analytics. Partner with data scientists and AI/ML teams to deliver the data needed for advanced analytics and machine learning use cases.

• DevOps & Quality Assurance:Implement robust CI/CD pipelines (e.g., Azure DevOps) for data projects. Uphold code quality standards, testing practices, and documentation to ensure consistent, secure releases across development, test, and production. Manage deployments across multiple environments (internal and client) to ensure reliability and compliance with enterprise standards.

• Technical Leadership & Collaboration (~30%):Act as a “player-coach” in our small team. Mentor and guide developers through code reviews and design sessions, cultivating best practices in data engineering. Work closely with data architects, software engineers, business stakeholders, and client teams to align solutions with needs and to plan project delivery. Take a lead role in the adoption of Microsoft Fabric—guiding the migration of data pipelines and assets to Fabric, and championing its benefits across the organization.

What You Will NotDo:

• Line Management:This is not a people-manager role. You will lead technicallybut not be responsible for direct HR management (no direct reports or performance appraisals).

• Work in Isolation:You won’t be expected to single-handedly own every aspect of the data platform. Collaboration is key—you’ll work with a team and engage stakeholders rather than working in a silo.

Experience & Technical Skills:

• Must-Have Qualifications:

  • 6+ years of hands-on data engineering experience, with a track record of progression into senior or technical lead responsibilities on data projects.

  • Demonstrated success in designing and delivering scalable data pipelines and ETL/ELT processes using Azure data services (e.g., Azure Data Factory, Azure Synapse, Databricks/Spark) and modern data processing languages (SQL, Python, Spark).

  • Strong experience in data modeling for analytics (e.g., designing efficient relational schemas, data warehouses, or lakehouse structures) and understanding of data governance, quality, and security best practices.

  • Hands-on expertise with DevOps for data (version control, CI/CD pipelines for analytics code, ideally using Azure DevOps) and managing deployments across multiple environments.

  • Excellent collaboration and communication skills. Able to work closely with business stakeholders, analysts, and possibly external clients to gather requirements and deliver suitable data solutions.

• Desirable Skills & Nice-to-Haves:

  • Microsoft Fabric (or Azure Synapse) experience. If you’re not already hands-on with Fabric, you bring a strong desire and ability to quickly learn it.

  • Background in data platform migration or introducing new data technologies into existing stacks—especially within the Azure data ecosystem.

  • Familiarity with Power BI or similar BI tools for building data models and enabling analytics (you won’t create all reports, but understanding the needs of BI consumers is valuable).

  • Experience in a client-facing or cross-functional role requiring strong stakeholder management, requirement analysis, and clear communication.

Ways of Working & Behaviours:

• Hands-On Leadership:You thrive on tackling technical challenges directly and leading by doing, while guiding teammates through example and support.

• Accountability & Ownership:You are a self-driven professional who takes full responsibility for delivering end-to-end solutions. You follow through on commitments and are dedicated to building robust, reliable systems.

• Collaborative & Communicative:You work effectively across disciplines and with external partners. You can translate complex technical concepts for non-technical stakeholders and value open communication and collaboration.

• Adaptable & Curious:You stay current with new technologies (especially Microsoft Fabric) and enjoy working in a fast-paced, evolving environment. You are pragmatic, focusing on delivering meaningful results while navigating new tools and challenges.

• Mentorship & Growth Mindset:You invest time in helping others improve. You provide constructive feedback, share knowledge, and foster a culture of continuous learning within the team.

This role represents a unique opportunity to take a lead role in shaping an Azure-based data platform that leverages the cutting-edge capabilities of Microsoft Fabric.