Senior Specialist - Data Engineering

About the Role
As an integral member of our delivery team, the Senior Specialist - Data Engineering is responsible for the design, development, implementation, management, and support of mission-critical enterprise BI reporting and Extract, Transform, Load (ETL) processes and environments. You will drive the adoption of the Analytics and Reporting experience by prototyping and showcasing dashboards to collect additional feedback and build additional requirements in an iterative manner. Working with business and cross-functional teams, you will gather, document, and approve business requirements for data analytics reporting projects, as well as develop robust data engineering capabilities to build pipelines and reports via visualization tools. Utilizing your skills and experience, you will design, develop, and implement ETL processes to transform structured, unstructured, and disparate source data into target data stores, data warehouses, or data marts.

Responsibilities
Strategic:

• Support the development of data strategy and internal processes of the organization.
• Drive business to self-enable on self-service analytics and provide support to upskill.
• Recommend the best ways to organize, analyze, and present data to enable a data-driven strategy.
• Evaluate existing data and analytics systems and support planning of Data Analytics and AI roadmap.
• Build a data community among the business and lead them to deliver business value on data and embrace data as a strategic asset.

Operational:

• Design and develop scalable and robust data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
• Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical specifications and data models.
• Optimize and tune data pipelines for performance, reliability, and scalability.
• Implement data quality checks, validation rules, and monitoring systems to ensure data integrity and accuracy.
• Design and maintain data warehouses, data lakes, and other data storage systems.
• Develop and maintain data processing frameworks and tools to facilitate efficient data analysis and reporting.
• Expertise in data modelling using Star/Snowflake Schema Design, Data Marts, Relational and Dimensional Data Modelling, Fact and Dimensional tables, Physical and logical data modelling.
• Manage the business analytics portfolio for the respective business you will be leading.
• Conduct business analysis to gather required needs on overall analytic needs.
• Translate business requirements into specifications that will be used to drive data store, data warehouse, or data mart design and configuration.
• Proven track record in administering, developing, and implementing Data Warehousing using Alteryx and Business Intelligence (BI) applications using Power BI, Tableau, and Business Objects.
• Possess cloud knowledge on AWS, Azure, or Google platform for data warehousing.
• Transition developed BI systems to the Operations & Support team.
• Provide support as required to ensure the availability and performance of enterprise data and BI environments for both external and internal users.
• Perform duties with moderate to low supervision.
• Manage multiple priorities and adjust quickly to changing priorities.
• Stay up-to-date with the latest trends, technologies, and best practices in data engineering and recommend innovative solutions to improve data infrastructure and processes.

People Management:

• Provide technical assistance and cross-training to other team members.
• Develop the team in line with target competencies.
• Motivate team members to maintain excellence in service delivery and seek opportunities for professional development.
• Exhibit leadership qualities to mentor junior members of the team.
• Communicate effectively with excellent interpersonal skills (verbal and written) to support work in project environments that include internal, external, and customer teams.

Product/Process Improvement:

• Ensure proper configuration management and change controls are implemented.
• Design and implement technology best practices, guidelines, and repeatable processes.
• Exhibit strong analytical, conceptual, and problem-solving abilities.

Qualifications
Education & Certifications:

• PREFERRED: Certification in Data Warehousing, ETL, Analytics, and Reporting Solutions is desired.
• MINIMUM: Bachelor’s or master’s degree in computer science.

Knowledge & Skills:

• Ability to work with users in a requirements analysis role.
• Hands-on experience with Python for Data Engineering.
• Knowledge of using Airflow.
• Hands-on experience working with multiple data sources and APIs.
• Good understanding of algorithms and basic statistics.
• Extensive use of SQL and RDBMS systems (DB2, Oracle, SQL Server, etc.).
• Proficiency in Data Wrangling, Data Visualization, Analytics, and Reporting.
• Expertise in administering, developing, and implementing Data Warehousing using Alteryx and BI applications (Power BI, Tableau, Business Objects).
• Strong experience in query languages like PL/SQL, SQL Server, Spark SQL, and T-SQL.

Experience:

• MINIMUM: 8 to 11 years of experience implementing Advanced Analytics, Data Engineering, and Reporting Solutions.