As a Senior Data Engineer at Avrioc Technologies, you will collaborate with various stakeholders to understand the needs of data practitioners and deliver scalable solutions. Your responsibilities will include defining, building, and maintaining the Data Platform, working with emerging technologies to build distributed applications, and managing end-to-end development efforts to ensure high-quality solutions are delivered on time, conforming to requirements and architectural visions. Additionally, you will present technical solutions and features in business-oriented terms, contribute to critical initiatives such as Data Discovery, Data Lineage, and Data Quality, build data systems, pipelines, analytical tools, and programs, and conduct complex data analysis and reporting on results.
Ready to apply for roles like this?
Unlock the company name and direct application link. Subscribers get instant access to fresh jobs across Dubai, Abu Dhabi and Riyadh, many with visa support.
Unlock employer & apply directly
Strong technical expertise in data modeling, data ingestion, distributed processing, data warehousing, and ETL processes is essential. You should have experience with Apache Kafka and Spark Streaming, proficiency in connecting and querying different data sources including NoSQL databases (e.g., MongoDB), MySQL, Elasticsearch, and Kafka topics, along with SQL, Python, PySpark, Spark SQL, and a solid understanding of the Databricks platform. The ability to build large-scale batch and real-time data pipelines, knowledge of best practices for optimizing Databricks cluster configurations, and experience in maintaining, monitoring, and enhancing data pipelines are also required. Familiarity with visualization tools such as Kibana and QlikView, exposure to Docker, Kubernetes, and GitLab, as well as experience with JIRA processes and Confluence for documentation and project management are beneficial.
You should have 8+ years of experience in data engineering or a similar role, along with a degree in Computer Science, Data Science, Mathematics, IT, or a related field, and a minimum of 5 years of relevant experience as a data engineer. Language requirements are not specified. The position is based in Abu Dhabi Emirate, United Arab Emirates, working on-site full-time.
