The Azure Data Engineer is responsible for designing, implementing, and managing robust data solutions to meet business needs. This includes overseeing data pipelines, Azure data platform services, and delivering actionable insights through Power BI dashboards and reports. The specialist will play a critical role in transforming raw data into valuable insights, ensuring data accuracy, and supporting business intelligence initiatives across the organization.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Responsibilities
- Design, implement, and manage Azure SQL databases, Azure Data Lake Storage, and related Azure & Fabric services.
- Create, monitor, and optimize ETL (Extract, Transform, Load) workflows to integrate data from multiple sources into centralized systems, ensuring reliability and performance.
- Utilize SQL for querying, analysing, and managing relational databases, and develop Python scripts to automate data processes, integrate data sources, and support advanced analytics.
- Leverage Azure Databricks for big data processing, analytics, and machine learning workflows, and utilize tools like Apache Spark and Hadoop for processing large datasets.
- Develop and maintain enterprise data warehouses to support analytics and reporting needs while ensuring seamless integration with visualization tools.
- Implement robust data security measures to protect sensitive data, maintain compliance with organizational and regulatory standards, and support disaster recovery processes.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions while maintaining detailed documentation of data architectures, ETL processes, and Power BI standards.
- Design, implement, and manage data solutions for AI needs.
Qualifications
- Bachelor’s degree in Computer Science, Information Technology, Business Administration, or a related field.
- Advanced certifications in Azure Data Engineering, SQL, or Microsoft Power BI are preferred.
Experience
- Minimum of 7 years of experience in data engineering, data warehousing, ETL processes, and business intelligence development.
- Proven expertise in Azure Data Factory, Azure Databricks, and Power BI development.
- Strong experience in SQL for database management, querying, and optimization.
- Demonstrated proficiency in Python for data automation, analytics, and advanced transformations.
- Experience in managing data pipelines and integrating large data sets for analysis.
- Demonstrated experience in collaborating with stakeholders and presenting data-driven insights.
Skills & Abilities
- Proficient in Azure services: Data Factory, Databricks, Data Lake, SQL Database, and Synapse Analytics.
- Advanced Power BI expertise, including DAX, data modelling, and report development.
- Strong SQL and Python skills for data processing, analysis, and automation.
- Experience with big data frameworks like Apache Spark and Hadoop.
- Proficiency in relational databases: Microsoft SQL Server, MySQL, and PostgreSQL.
- Excellent organizational, problem-solving, and communication skills.
- Familiarity with data security and compliance standards.
