Data Engineer OCI

About the Job:
The company is a global data and AI consulting organization with a strong presence in the UAE since 2013. We support both private and public sector organizations in data and AI-led transformation initiatives. Our services include data strategy and consulting, artificial intelligence solutions, big data platform implementation, data governance, digital transformation, and data-driven marketing.

Job Role: Data Engineer (Oracle Cloud Infrastructure)

Location: Dubai, United Arab Emirates
Employment Type: Contract (3 Months extendable)
Work Conditions: On-site
Notice Period: Immediate – 15 Days

Responsibilities:

• Design, build, and maintain batch and streaming data pipelines on OCI across bronze, silver, and gold layers.
• Implement Change Data Capture (CDC) and real-time ingestion using OCI GoldenGate and OCI Streaming with Kafka.
• Develop transformation workloads using Oracle Data Transforms and OCI Data Flow (Spark, Spark Streaming).
• Model and manage curated data in Autonomous AI Lakehouse and OCI Object Storage, including partitioning, schema evolution, and performance tuning.
• Write advanced SQL and PySpark for data cleansing, enrichment, aggregation, and historization (Slowly Changing Dimension handling).
• Integrate source systems (ERP, CRM, IoT, third-party APIs, files) through Oracle Integration and connector-based patterns.
• Implement data quality, validation, and reconciliation checks across the pipeline, with monitoring and alerting on pipeline health and SLAs.
• Orchestrate and schedule workloads, manage dependencies, handle late arriving data, restarts, and backfills.
• Expose curated datasets to consumers via semantic models, Power BI, ORDS/APEX APIs, and support Data Science and MLOps teams with feature-ready data.
• Apply data governance, cataloguing, lineage, and security controls including IAM policies, encryption, masking, and Data Safe.
• Automate the deployment of data assets using Terraform and CI/CD pipelines, with version-controlled code and environment promotion.
• Optimize cost and performance of storage, compute, and query workloads across the platform.

If this opportunity aligns with your expertise and career aspirations, please share your updated resume at [email protected]. Our team looks forward to connecting with suitable candidates for further discussions.