Data Engineer – OCI Data Lakehouse (DLH) Projects

About the Role
We are seeking a highly skilled Data Engineer to join our Data Management Office and play a key role in advancing our enterprise OCI Data Lakehouse (DLH) initiatives. As a Data Engineer, you will be responsible for designing, developing, and optimizing scalable data pipelines, ingestion frameworks, and data products that support business analytics, regulatory reporting, and AI/ML-driven innovation. You will collaborate closely with cross-functional stakeholders from Actuarial, Underwriting, Claims, Finance, and Business teams to transform raw data into trusted, high-value data assets that drive strategic decision-making.

Key Responsibilities

• Data Engineering & Pipeline Development

  • Design, build, and maintain scalable data ingestion, transformation, and orchestration pipelines using OCI Data Flow, Oracle Data Integrator (ODI), and AIDP.
  • Develop robust ETL/ELT processes to support enterprise data integration and analytics requirements.
  • Implement and manage Delta Lakehouse architectures, including ingestion, curation, and consumption layers.

• Data Modeling & Analytics Enablement

  • Design and optimize analytical data models, data marts, and datasets on Oracle Autonomous Data Warehouse (ADW).
  • Ensure data structures are aligned with business reporting, operational analytics, and advanced AI/ML use cases.
  • Collaborate with business stakeholders to translate requirements into scalable technical solutions and reusable data products.

• Data Lakehouse & Storage Management

  • Manage structured and unstructured datasets within OCI Object Storage.
  • Implement storage lifecycle strategies, governance policies, and cost optimization measures.
  • Ensure efficient organization and accessibility of enterprise data assets across the Data Lakehouse ecosystem.

• Architecture, Quality & Governance

  • Partner with data architects to create reusable and high-performance ingestion frameworks for new initiatives.
  • Embed data quality, lineage, metadata management, and governance controls into all data pipelines.
  • Drive continuous improvements in platform performance, scalability, and reliability.

• Performance Optimization

  • Tune and optimize SQL workloads, Spark jobs, ETL processes, and ADW performance.
  • Monitor data processing efficiency and proactively resolve bottlenecks to ensure optimal platform utilization.

Required Skills & Experience

• OCI Data Platform Expertise
  • Strong hands-on experience with the following Oracle Cloud Infrastructure services:
    • Oracle Autonomous Data Warehouse (ADW)
    • OCI Object Storage
    • OCI Data Flow (Apache Spark)
    • Oracle Data Integrator (ODI)
    • Oracle AI Data Platform (AIDP)

Technical Competencies

• Advanced proficiency in SQL and Python development.
• Strong experience in performance tuning, optimization, and troubleshooting of large-scale data workloads.
• Hands-on experience building modern data pipelines and cloud-native data platforms, preferably on Oracle Cloud Infrastructure (OCI).
• Solid understanding of Delta Lakehouse architecture, Medallion Architecture, data versioning, and modern data engineering best practices.

Domain Knowledge

• Exposure to Insurance data domains such as:
  • Policy Administration
  • Claims Management
  • Underwriting
  • Finance & Regulatory Reporting (Preferred but not mandatory.)

Soft Skills

• Strong analytical and problem-solving capabilities.
• Effective communication and stakeholder management skills.
• Ability to work collaboratively across business and technology teams in a fast-paced environment.

Preferred Qualifications

• Experience with Oracle GoldenGate for real-time data replication and Change Data Capture (CDC) pipelines.
• Familiarity with modern data governance, metadata management, and data observability frameworks.
• Exposure to AI/ML data preparation and feature engineering workflows within enterprise Data Lakehouse environments.