We are looking for an astute, proficient and qualified Senior Data Engineer to assess, analyze, and work with data concepts, use cases, and complex new data sources to provide business insights to customers and support the implementation and integration of these data sources into the Presight platform. This position offers an opportunity to play a critical role in the development of high-performance data solutions and information products at Presight. As a leading big data analytics company in the region, powered by Artificial Intelligence, Presight combines big data, analytics, and AI expertise to create business impact and societal benefits.
Key Responsibilities:
- Develop data pipelines with Cloud Services & On-premise Data Centers.
- Perform web crawling, data cleaning, data annotation, data ingestion, and data processing.
- Create and maintain data pipelines with a continual focus on process improvement for efficiency and productivity.
- Utilize Python, SQL, ES, Shell, etc., to build the infrastructure for optimal data extraction, transformation, and loading.
- Support the wider business with ad hoc data needs.
- Open to extensive international business travel as required.
Qualifications:
- 4+ years of programming experience, with solid coding skills in Python, Shell, and Java.
- Bachelor's degree in Computer Engineering, Computer Science, or Electrical Engineering and Computer Sciences.
- Strong practical knowledge in data processing and migration tools (e.g., Apache NiFi, Kafka, Spark).
- Experience in designing, building, and maintaining data processing with CDP (Cloudera Data Platform) Private Cloud, as well as developing and maintaining Data Workflow with Apache Airflow.
- Knowledge of distributed computing, web crawling, and cleaning, as well as ETL and ELT processes.
- Proficient understanding of SQL and NoSQL databases, and best practices in optimizing data processing systems.
- Knowledge of machine learning and data mining techniques.
Skills and Attributes for Success:
- Strong analytical and data visualization skills.
- Excellent communication and presentation skills.
- An innovative and creative approach to problem-solving.
- A performance-driven and curious mindset with the ability to adapt to ambiguity.
Language Requirements:
- Proficiency in English is required.
Work Conditions:
On-site, Full-time.
What We Offer:
- An open, diverse, and inclusive environment focused on personal growth and groundbreaking innovations.
- Outstanding learning, development, and growth opportunities through structured training programs.
- Competitive remuneration package with healthcare, education support, leave benefits, and more.
