About the Job
We are looking for an Associate Data Engineer to create and maintain optimal data pipeline architecture. You will assemble large, complex data sets that meet functional and non-functional business requirements and identify, design, and implement internal process improvements, such as automating manual processes, optimizing data delivery, and redesigning infrastructure for greater scalability.
Your responsibilities will include building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of sources and developing analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics. You will collaborate with stakeholders, including Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
Additionally, you will create data tools for analytics and data science team members, aiding them in building and optimizing our products to remain an innovative industry leader. You will work closely with data and analytics experts to enhance the functionality of our data systems and build processes supporting data transformation, structures, metadata, dependency, and workload management.
Qualifications
- A minimum of 1 year of experience in a Data Engineer role, with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field.
- Experience with big data tools such as Hadoop, Spark, and Kafka.
- Proficiency in relational SQL and NoSQL databases, including Postgres and Cassandra.
- Familiarity with data pipeline and workflow management tools like Azkaban, Luigi, and Airflow.
- Experience with AWS cloud services, including EC2, EMR, RDS, and Redshift.
- Knowledge of stream-processing systems such as Storm and Spark-Streaming.
- Proficiency in object-oriented/object function scripting languages like Python, Java, C++, or Scala.
- Advanced working SQL knowledge and experience with relational databases.
- Experience in building and optimizing 'big data' data pipelines, architectures, and datasets.
- Strong analytic skills for working with unstructured datasets and performing root cause analysis to answer specific business questions and identify opportunities for improvement.
- Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
About the Company
KPMG Lower Gulf has provided audit, tax, and advisory services for almost 50 years to a diverse range of domestic and international clients in the UAE and Oman. Our focus on integrity, excellence, courage, and teamwork allows us to build trust with our clients while mitigating risks and identifying business opportunities. We are committed to exceptional quality service, public interest, and building empowered teams to inspire confidence and empower change.
