We are seeking a highly skilled and experienced Vertica Data Engineer to join our dynamic team in Dubai. In this role, you will be instrumental in architecting, developing, and maintaining our large-scale data infrastructure to support critical business objectives. The contract duration is 1 year and is renewable, with an ideal start date within 1 month and a notice period considered of 30 days.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Key Responsibilities:
- Data Pipeline & ETL Development: Design and implement efficient data pipelines to extract, transform, and load (ETL) data from various sources into Vertica using popular ETL tools like SAP BODS and Informatica.
- Data Migration: Lead and execute the migration of data from legacy systems such as Oracle, SQL Server, and SQL Lite to the Vertica database.
- Data Modeling & Optimization: Develop and maintain robust data models and database structures optimized for high-performance data retrieval and analysis within Vertica.
- Program Unit Development: Write program units (Functions/Procedures) to prepare and transform data based on specific business requirements.
- Cross-functional Collaboration: Work closely with data scientists and analysts to understand their data needs and provide scalable, effective solutions for complex analytical requirements.
- Data Quality & Integrity: Implement rigorous data quality checks and validation processes to ensure the accuracy and integrity of all data within Vertica.
- Machine Learning Integration: Utilize VerticaPy to integrate and work with Machine Learning libraries for advanced data science use cases.
- Performance Tuning: Optimize database performance and query execution through advanced techniques including indexing, partitioning, and other tuning methods.
- Database Health & Maintenance: Proactively monitor Vertica database health, troubleshoot performance issues, and address potential bottlenecks.
- Deployment & DevOps Collaboration: Work with the DevOps team to ensure smooth deployment, monitoring, and maintenance of Vertica instances.
- Data Governance: Collaborate with data engineers and stakeholders to define and enforce best practices and data governance standards for Vertica usage.
- Innovation & Documentation: Stay current with the latest advancements in Vertica and big data technologies, recommending improvements. Document technical specifications, data flows, and architectural designs.
Qualifications & Experience:
- Essential: Bachelor's Degree in Computer Science, Information Technology, or a related field.
- Required Experience: A minimum of 4+ years of proven experience as a Data Engineer with hands-on expertise in designing and managing data solutions within the Vertica database environment.
- Technical Must-Haves:
- Strong proficiency in SQL and extensive experience with data modeling and schema design in Vertica.
- In-depth knowledge of ETL processes and tools for data integration into Vertica.
- Proven experience in performance tuning and optimization of Vertica databases.
- Experience migrating data from Oracle, SQL Server, or similar RDBMS to Vertica.
- Desirable Skills:
- Vertica Certification.
- Familiarity with other big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS, Azure).
- Experience with data visualization tools (e.g., Power BI, SAP BI, Tableau).
- Familiarity with Linux environments and shell scripting for automation.
- Understanding of data warehousing concepts and best practices.
Behavioral Competencies:
- Achievement Orientation
- Adaptability
- Analytical Thinking
- Attention to Detail
- Creativity
- Decisiveness
- Energy
Additional Requirements:
- Candidates must be available for an interview via Microsoft Teams and be available to be placed onsite.
- A valid UAE Driving License is required.
- Prior work experience with reputable companies is highly preferred.
