Senior Data QA Engineer

We are looking for a Senior Data QA Engineer to design and implement scalable quality assurance solutions for enterprise data platforms, pipelines and data products. The role combines strong Data QA expertise with hands-on data engineering knowledge across Azure, Databricks, PySpark and modern lakehouse environments.

Key accountabilities

• Design and establish a reusable Data Framework covering data quality, validation, testing, monitoring and governance.
• Define and implement a scalable Data QA framework for automated testing of data pipelines, transformations and data products.
• Establish data quality rules, validation patterns, reconciliation mechanisms and regression testing.
• Create reusable testing components and standards that can be adopted across multiple data engineering projects.
• Validate end-to-end ETL/ELT workflows, data transformations, business rules, schemas and analytical datasets.
• Integrate Data QA capabilities into CI/CD and the overall data development lifecycle.
• Investigate data defects, perform root-cause analysis and collaborate with engineering teams on resolution.
• Validate the performance, reliability and scalability of Spark workloads and distributed data solutions.
• Support production incident analysis and continuous improvement of data quality and pipeline reliability.
• Collaborate with engineers, architects, analysts and business stakeholders to define test scenarios and acceptance criteria.
• Ensure alignment with enterprise security, governance and data management requirements.
• Define framework standards, documentation and best practices to ensure consistency, scalability and maintainability.

Required experience

• 5+ years of experience in Data QA, data testing or data engineering within enterprise environments.
• Proven experience designing and implementing automated testing frameworks for enterprise data solutions.
• Strong hands-on experience with Azure Databricks and Azure Data Factory.
• Advanced knowledge of PySpark or Apache Spark.
• Strong Python and SQL development skills.
• Experience testing production-grade ETL/ELT pipelines and batch or near real-time data solutions.
• Strong understanding of data modelling, Delta Lake and lakehouse architecture.
• Experience working with CI/CD pipelines and DevOps delivery practices.
• Understanding of distributed data processing, performance optimisation and production support.

Why join us?

• Work on high-impact projects integrating cloud, AI, and data technologies.
• A collaborative environment focused on innovation, mentorship, and knowledge-sharing.
• Access to continuous learning and career development opportunities through training and certifications.
• Flexible working environment.
• Competitive salary and benefits package.
• Yearly fixed reimbursement amount.
• Annual performance bonus based on achievements.
• Opportunities for professional growth and career advancement.
• Additional vacation days.