About the Role
This position requires a highly skilled Data Engineer who will play a crucial role in advancing enterprise OCI Data Lakehouse (DLH) initiatives within the Data Management Office. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, ingestion frameworks, and data products that support business analytics, regulatory reporting, and AI/ML-driven innovation. The Data Engineer will collaborate closely with cross-functional stakeholders in Actuarial, Underwriting, Claims, Finance, and Business teams, transforming raw data into trusted, high-value data assets that drive strategic decision-making.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Responsibilities
-
Data Engineering & Pipeline Development
- Design, build, and maintain scalable data ingestion, transformation, and orchestration pipelines using OCI Data Flow, Oracle Data Integrator (ODI), and AIDP.
- Develop robust ETL/ELT processes to support enterprise data integration and analytics requirements.
- Implement and manage Delta Lakehouse architectures, including ingestion, curation, and consumption layers.
-
Data Modeling & Analytics Enablement
- Design and optimize analytical data models, data marts, and datasets on Oracle Autonomous Data Warehouse (ADW).
- Ensure data structures are aligned with business reporting, operational analytics, and advanced AI/ML use cases.
- Collaborate with business stakeholders to translate requirements into scalable technical solutions and reusable data products.
-
Data Lakehouse & Storage Management
- Manage both structured and unstructured datasets within OCI Object Storage.
- Implement storage lifecycle strategies, governance policies, and cost optimization measures.
- Ensure efficient organization and accessibility of enterprise data assets across the Data Lakehouse ecosystem.
-
Architecture, Quality & Governance
- Partner with data architects to create reusable and high-performance ingestion frameworks for new initiatives.
- Embed data quality, lineage, metadata management, and governance controls into all data pipelines.
- Drive continuous improvements in platform performance, scalability, and reliability.
-
Performance Optimization
- Tune and optimize SQL workloads, Spark jobs, ETL processes, and ADW performance.
- Monitor data processing efficiency and proactively resolve bottlenecks to ensure optimal platform utilization.
Required Skills & Experience
-
OCI Data Platform Expertise
- Strong hands-on experience with the following Oracle Cloud Infrastructure services:
- Oracle Autonomous Data Warehouse (ADW)
- OCI Object Storage
- OCI Data Flow (Apache Spark)
- Oracle Data Integrator (ODI)
- Oracle AI Data Platform (AIDP)
-
Technical Competencies
- Advanced proficiency in SQL and Python development.
- Strong experience in performance tuning, optimization, and troubleshooting of large-scale data workloads.
- Hands-on experience building modern data pipelines and cloud-native data platforms, preferably on Oracle Cloud Infrastructure (OCI).
- Solid understanding of Delta Lakehouse architecture, Medallion Architecture, data versioning, and modern data engineering best practices.
-
Domain Knowledge
- Exposure to Insurance data domains such as:
- Policy Administration
- Claims Management
- Underwriting
- Finance & Regulatory Reporting (Preferred but not mandatory.)
-
Soft Skills
- Strong analytical and problem-solving capabilities.
- Effective communication and stakeholder management skills.
- Ability to work collaboratively across business and technology teams in a fast-paced environment.
Preferred Qualifications
- Experience with Oracle GoldenGate for real-time data replication and Change Data Capture (CDC) pipelines.
- Familiarity with modern data governance, metadata management, and data observability frameworks.
- Exposure to AI/ML data preparation and feature engineering workflows within enterprise Data Lakehouse environments.
Must Have
- OCI Data Platform Expertise
- Strong hands-on experience with Oracle Cloud Infrastructure services listed previously.
- Advanced proficiency in SQL and Python development.
- Strong experience in performance tuning and optimization of large-scale data workloads.
- Hands-on experience building modern data pipelines and cloud-native data platforms, preferably on OCI.
- Solid understanding of Delta Lakehouse architecture and modern data engineering best practices.
Good to Have
- Experience with Oracle GoldenGate for real-time data replication and CDC pipelines.
- Familiarity with data governance, metadata management, and data observability frameworks.
- Exposure to AI/ML data preparation and feature engineering workflows.
