As a Vertica Data Engineer, you will be responsible for architecting, developing, and maintaining our Vertica database systems and data pipelines. You will collaborate with cross-functional teams, including data scientists, analysts, and developers, to ensure seamless data integration, transformation, and retrieval from Vertica. Your expertise in Vertica's architecture, ETL processes, data modeling, and performance tuning will be crucial in delivering robust and scalable data solutions to support our business objectives.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Principal Responsibilities:
- Design and implement efficient data pipelines to extract, transform, and load (ETL) data from various sources into Vertica using popular ETL tools like SAP BODS and INFORMATICA.
- Develop and maintain data models and database structures optimized for high-performance data retrieval and analysis in Vertica.
- Migrate data from Oracle, SQL Server, and SQLite to the Vertica database in a timely manner.
- Write program units (functions/procedures) to prepare data based on business requirements.
- Collaborate with data scientists and analysts to understand their data needs and provide scalable solutions.
- Implement data quality checks and validation processes to ensure data accuracy and integrity.
- Utilize VerticaPy to work with machine learning libraries for data science use cases.
- Work with the DevOps team to ensure smooth deployment, monitoring, and maintenance of Vertica instances.
- Optimize database performance and query execution through indexing, partitioning, and other tuning techniques.
- Monitor Vertica database health, troubleshoot performance issues, and address potential bottlenecks.
- Define best practices and data governance standards for Vertica usage in collaboration with data engineers and stakeholders.
- Stay updated with advancements in Vertica and big data technologies and recommend improvements.
- Document technical specifications, data flows, and architectural designs related to Vertica implementations.
- Provide training and support to end-users for effective interaction with Power BI reports.
