We are looking for a Senior Big Data Engineer (Databricks) to join our Big Data & Analytics Center of Excellence in Abu Dhabi, United Arab Emirates. This full-time, on-site role is integral to our team, which has evolved from a small group of enthusiasts in 2013 to hundreds of Data Engineers and Architects delivering comprehensive data solutions across various sectors including Healthcare, Finance, Manufacturing, Retail, and Energy.
In this role, you will design data models and construct ETL pipelines using Python/PySpark, proficiently work with Databricks Lakehouse architecture, and utilize Azure cloud technologies such as Azure Data Factory and Azure Synapse. You will be responsible for managing relational databases with your advanced SQL skills, designing, building, and scaling both streaming and batch data pipelines, and fostering effective communication with stakeholders in both written and verbal forms.
Key Responsibilities:
- Design data models and build ETL pipelines using Python/PySpark.
- Work proficiently with Databricks Lakehouse architecture and principles.
- Utilize Azure cloud technologies such as Azure Data Factory, Azure DevOps, Azure Synapse, and Azure Data Lake Services.
- Apply advanced SQL skills to manage relational databases effectively.
- Design, build, and scale streaming and batch data pipelines.
- Collaborate with stakeholders through effective communication in both written and verbal forms (Upper-Intermediate English level).
Qualifications:
- 2+ years of experience in data modeling, ETL pipeline construction, and data wrangling.
- Familiarity with database and data warehouse design best practices.
- Proven analytical skills for conducting trade-off analysis and problem-solving.
- A passion for continuous learning, improvement, and knowledge sharing.
Why Join Us?
- Be part of a team of dedicated data-focused engineers.
- Engage with cutting-edge technology and innovative services from leading cloud providers.
- Participate fully in the project lifecycle, from initial design to full-scale implementation.
- Support your career growth with tailored career plans, continuous learning opportunities, and access to professional certifications.
SoftServe is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, age, sex, national origin, disability, sexual orientation, gender identity/expression, or protected veteran status.
