As part of a cross-functional team of engineers, data scientists, and product owners, you will be responsible for designing, implementing, optimizing, and evaluating our product algorithms. If you enjoy seeing your ideas thrive from concept to execution for millions of users, Avrioc is the place for you!
Responsibilities:
- Collaborate with stakeholders to understand the needs of data practitioners and deliver at scale.
- Define, build, and maintain the Data Platform.
- Work with emerging technologies to build distributed applications.
- Ensure on-time delivery of high-quality solutions that conform to requirements and architectural vision.
- Present technical solutions and features in business terms.
- Participate in critical initiatives, such as Data Discovery, Data Lineage, and Data Quality.
- Build data systems, pipelines, analytical tools, and programs.
- Conduct complex data analysis and report results.
Skills and Attributes:
- Strong technical expertise in data modeling, data ingestion, distributed processing, data warehousing, and ETL processes.
- Experience with Apache Kafka and Spark Streaming.
- Familiarity with NoSQL databases (e.g., MongoDB), MySQL, Elasticsearch, and Kafka topics.
- Proficiency in SQL, Python, PySpark, Spark SQL, and a solid understanding of the Databricks platform.
- Ability to build large-scale batch and real-time data pipelines.
- Knowledge of best practices for optimizing Databricks cluster configurations based on data requirements.
- Experience in maintaining and enhancing data pipelines.
- Familiarity with visualization tools such as Kibana and QlikView.
- Exposure to Docker, Kubernetes, and GitLab.
- Experience with JIRA for project management and Confluence for documentation.
Qualification & Requirements:
- Degree in Computer Science, Data Science, Mathematics, IT, or a related field.
- 8+ years of experience as a Data Engineer or in a similar role.
Information Security:
As an employee of Avrioc, you will be required to comply with all applicable UAE laws and regulations, as well as Avrioc’s Acceptable Use, Information Security, IT Service Management, and Data Privacy policies. You are expected to maintain confidentiality, attend mandatory information security training, and report any incidents promptly.
Avrioc is an equal-opportunity employer committed to diversity and inclusion. We encourage candidates from all backgrounds to apply.
Work Conditions: On-site, Full-time.
Location: Abu Dhabi, Abu Dhabi Emirate, United Arab Emirates.
