About the Job:
As a Kafka Architect / Streaming Data Architect at the company, you will play a critical role in designing and implementing enterprise-scale Kafka architecture aligned with innovative banking solutions. This full-time position is based on-site in Jeddah, Makkah, Saudi Arabia.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
About Us:
The company is an IT services, consulting, and business solutions organization with over 50 years of experience in partnering with leading global businesses during their transformation journeys. The company provides a consulting-led, cognitive-powered integrated portfolio of services and solutions, supported by its unique Location Independent Agile™ delivery model. As part of the Tata group, the company boasts a diverse workforce of over 616,171 consultants from 157 nationalities across 53 countries.
Key Responsibilities:
- Architecture & Design:
- Design enterprise-scale Kafka architecture aligned with Bank Lakehouse (Medallion - Bronze/Silver/Gold).
- Define event-driven architecture patterns for real-time ingestion and processing.
- Establish topic strategies, partitioning, replication, and retention policies.
- Architect multi-cluster Kafka setups (dev/test/prod) with a disaster recovery strategy.
- Ensure exact point-in-time recovery and fault tolerance.
- Platform Implementation:
- Lead setup and configuration of Kafka brokers, Zookeeper/Kraft mode, Kafka Connect framework, and Schema Registry.
- Implement stream processing using Kafka Streams, Spark Streaming, or Flink.
- Integrate Kafka with Cloudera Data Platform (CDP), Informatica, Data Warehouse (Teradata), and Denodo.
- Real-Time Data Engineering:
- Design pipelines for event streaming ingestion and near real-time batch ingestion.
- Build CDC (Change Data Capture) pipelines using Kafka Connect (Debezium).
- Enable ingestion from source systems with support for incremental and historical load integration.
- Performance & Scalability:
- Ensure high throughput and low latency, supporting concurrent consumers without degradation.
- Optimize partition strategy, consumer group scaling, and producer configurations.
- Resilience & Reliability:
- Implement failover strategies and ensure data replication and durability.
- Handle hardware failures and data corruption scenarios.
- Data Governance & Security:
- Enforce Role-Based Access Control (RBAC) and ensure data encryption in transit and at rest.
- Integrate with metadata and lineage tools for governance.
- Monitoring & Operations:
- Implement monitoring using Cloudera Manager and Kafka metrics.
- Define alerting thresholds and SLA monitoring for ingestion pipelines.
- Phase 1 Remediation Support:
- Assess existing Kafka pipelines and components, identifying defective pipelines and missing ingestion flows.
- Documentation & Governance:
- Deliver high-level architecture design and low-level design (LLD) for Kafka pipelines.
Key Technical Skills:
- Core Technologies:
- Cloudera, Kafka (mandatory), Kafka Connect, Kafka Streams, Schema Registry (Avro/Protobuf/JSON).
- Ecosystem Tools:
- Apache Spark/Spark Streaming, Apache Flink (preferred), Informatica, Teradata, Denodo.
- Data & Integration Tools:
- CDC tools (Debezium preferred), REST APIs, Microservices integration.
- DevOps & Infrastructure:
- Knowledge of Kubernetes/Docker (optional but preferred), CI/CD for pipeline deployment, Linux environments.
- Banking Domain Experience:
- Experience in the BFSI domain is mandatory, with an understanding of regulatory reporting and data reconciliation.
Soft Skills:
- Strong stakeholder management (business + IT)
- Ability to work in a multi-vendor environment
- Experience in large-scale transformation programs
- Strong problem-solving and root cause analysis skills
Application Deadline: 30 June 2026
Language Requirements: Not specified.
