Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to design, build, and optimize large-scale, distributed data infrastructure that powers advanced analytics and real-time intelligence across the organization. The role requires deep technical expertise in Kafka-based CDC pipelines, cloud data warehousing, and database optimization.

Key Responsibilities

• Data Infrastructure Design & Development

  • Architect and maintain robust real-time data pipelines using Apache Kafka, Debezium, and Confluent connectors (Oracle, MongoDB, BigQuery, etc.).
  • Implement robust CDC pipelines that maintain efficient message delivery and data integrity and are fault-tolerant.
  • Develop and automate ETL/ELT workflows within platforms such as Dataiku or custom Python/SQL frameworks.

• Database Engineering & Optimization

  • Administer and tune large-scale Oracle databases, including partitioning, indexing, and performance tuning for analytical workloads.
  • Design data models that support both operational reporting and advanced analytics.
  • Develop SQL reporting queries and reconciliation logic to ensure transactional consistency across multiple systems.

• Cloud & Integration Engineering

  • Build and manage integrations across hybrid environments.
  • Lead and synchronize efforts between on-prem systems and cloud warehouses.
  • Implement data validation, observability, and alerting frameworks for production pipelines.

• Data Governance & Automation

  • Create metadata, lineage, and quality monitoring tools for datasets across domains.
  • Ensure compliance with internal data policies, access control, and security standards.

• Collaboration

  • Partner with analytics and product teams to translate business requirements into technical data solutions.
  • Support cross-functional data initiatives from financial reporting to sector benchmarking and cultural GDP measurement frameworks.