About the Job:
Shory is revolutionizing the Insurtech market, aiming to empower customers through technology that fosters trust and ease around insurance needs. We are seeking a seasoned Senior Data Engineer to join our expanding AI & Data team. This critical role involves designing, building, and scaling a secure and high-performance data infrastructure to support analytics, machine learning, and enterprise decision-making.
The ideal candidate will have a strong background in data architecture, cloud data services, and data engineering best practices. Responsibilities include leading the development of robust data pipelines, batch and real-time processing frameworks, and cloud-native data solutions, while collaborating with cross-functional teams to ensure reliable and accessible data throughout the organization.
Responsibilities:
- Design and implement scalable, cloud-native data pipelines (batch and streaming) and ETL/ELT processes across Azure and AWS.
- Architect and optimize data infrastructure using cloud storage, SQL, Spark, and distributed computing.
- Collaborate with Data Scientists, Analysts, and ML Engineers for efficient feature engineering and data access.
- Ensure data integrity, security, quality, and compliance while establishing standards for data modeling.
- Evaluate and integrate open-source tools and modern data stack technologies.
- Enforce data security, privacy, and compliance standards.
- Support data governance efforts and monitor data integrity issues.
- Partner with cross-functional teams to understand data needs and deliver impactful solutions.
Requirements:
- Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.
- 3-5 years in data engineering or cloud data architecture, with hands-on experience in Azure or AWS environments.
- Proven expertise in designing and building ETL/ELT pipelines and handling large-scale data processing.
- Proficiency with cloud-native data services (e.g., Azure Data Factory, AWS Glue).
- Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation).
- Strong background in Python, SQL, data modeling, and performance optimization.
Location: Abu Dhabi Emirate, United Arab Emirates
Work Conditions: On-site, Full-time
Language Requirements: Not specified.
