As part of a cross-functional team of engineers, data scientists, and product owners, you will be responsible for designing, implementing, optimizing, and evaluating our product algorithms. If you enjoy seeing your ideas grow from concept to engagement with millions of users, Avrioc is the place for you!
Responsibilities:
- Collaborate with stakeholders to understand the needs of data practitioners and deliver at scale.
- Define, build, and maintain the Data Platform.
- Work with emerging technologies to build distributed applications.
- Manage end-to-end development efforts for timely delivery of high-quality solutions.
- Present technical solutions and features in business terms.
- Contribute to critical initiatives such as Data Discovery, Data Lineage, and Data Quality.
- Build data systems, pipelines, analytical tools, and programs.
- Conduct complex data analyses and report on results.
Skills and Attributes:
- Strong technical expertise in data modeling, data ingestion, distributed processing, data warehousing, and ETL processes.
- Experience with Apache Kafka and Spark Streaming.
- Familiarity with various data sources, including NoSQL databases (e.g., MongoDB), MySQL, Elasticsearch, and Kafka topics.
- Proficiency in SQL, Python, PySpark, Spark SQL, and a solid understanding of the Databricks platform.
- Ability to build large-scale batch and real-time data pipelines.
- Knowledge of best practices for optimizing Databricks cluster configurations.
- Experience in maintaining, monitoring, and enhancing data pipelines.
- Familiarity with visualization tools such as Kibana and QlikView.
- Exposure to Docker, Kubernetes, and GitLab.
- Experience with JIRA processes and Confluence for documentation and project management.
Qualification & Requirements:
- Degree in Computer Science, Data Science, Mathematics, IT, or a related field.
- 5 years of experience as a data engineer or similar role.
Location:
Abu Dhabi Emirate, United Arab Emirates
Work Conditions:
On-site, Full-time
Company Overview:
Avrioc Technologies is a technology company based in Abu Dhabi, dedicated to innovation and growth, focusing on cutting-edge software development and operational efficiency.
Benefits:
- Transportation from designated areas
- New modern office in a technological cluster in Abu Dhabi
- Recreation and fitness zone
- Flexible work-life balance support
- Career development plans
- Engagement and well-being programs
