The Quality Assurance Engineer role focuses on validating data pipelines and ensuring data quality within Microsoft Fabric. Candidates should have a Bachelor's degree and at least 6 years of QA experience, with strong skills in SQL, Python, and data testing. The position involves collaboration with cross-functional teams and requires excellent communication skills.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Location
Abu Dhabi, Abu Dhabi, United Arab Emirates
Responsibilities
- Design and execute end-to-end data testing for Fabric-based data pipelines
- Validate data ingestion into Fabric Lakehouse and Warehouse layers
- Perform source-to-target reconciliation (row counts, aggregates, checksums)
- Validate data transformations implemented via Fabric Data Factory Gen2, Dataflows, Spark Notebooks (PySpark)
- Validate dimensional data models, business rules, and derived metrics
- Ensure consistency of KPIs across analytical and reporting layers
- Define and execute data quality checks (completeness, accuracy, consistency, timeliness)
- Validate data lineage, metadata, and governance artifacts in Microsoft Purview and MDM systems
- Support ongoing data quality monitoring and issue detection
- Develop and maintain automated data validation using SQL and Python or PySpark
- Support performance, regression, UAT, and production data validation
- Collaborate with Data Engineers, BI teams, and Analysts to track and resolve defects
- Maintain test documentation, data quality metrics, and release readiness reports
- Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.
Requirements
- Bachelor's Degree in Artificial Intelligence, Computer Science, Business Analytics, Engineering or related field
- 6+ years of overall QA/testing experience, with 4+ years focused on data testing, including migration, ingestion (batch and API), ETL/ELT, and data quality testing
- Strong understanding of data warehouse concepts and analytics data flows
- Advanced SQL for data validation and reconciliation
- Experience testing data on Microsoft Fabric (Lakehouse/Warehouse)
- Hands-on testing of: Fabric Data Factory Gen2 pipelines, Dataflows, Spark-based transformations (PySpark understanding)
- Strong knowledge of dimensional modeling and SCD Type 1 & 2
- Familiarity with Microsoft Purview for lineage, metadata, and governance validation
- Experience with Python or PySpark for automated data testing
- Experience testing Power BI semantic models, measures, and dashboards
- Familiarity with CI/CD pipelines for data platforms
Ideally, you’ll also need
- In-depth market and domain knowledge
- A passion for constant improvement
- An innovative and creative approach to problem-solving
- Excellent communication skills
