Data Architecture Specialist

Extracted text

• Lead Data Engineering efforts / teams working jointly with our delivery canters.
• Work across workstreams to support data requirements including pipelines, reports, and dashboards.
• Analyse and perform data profiling to understand data patterns and discrepancies following Data Quality and Data Management processes.
• Understand and follow best practices to design and develop the E2E Data Pipeline: data transformation, ingestion, processing, and surfacing of data for large-scale applications.
• Understand business requirements to translate them into technical requirements that the system analysts and other technical team members can drive into the project design and delivery.
• Analyze source data and perform data ingestion in both batch and real-time patterns via various methods; for example, file transfer, API, Data Streaming using Kafka and Spark Streaming.
• Analyze and understand data processing and standardization requirements, develop ETL processing to transform data.
• Understand data/reports and dashboards requirements, develop data export, data API, or data visualization using Power BI, Tableau, or other visualization tools.