About the Job:
Presight is seeking a proficient Senior Data Engineer to assess, analyze, and work with data concepts, use cases, and complex new data sources to provide business insights to customers. This role will support the implementation and integration of data sources into the Presight AI platform.
Key Responsibilities:
- Solve challenging problems using Python coding skills.
- Design, build, and launch new data extraction, transformation, and loading processes in production.
- Conduct web crawling, data cleaning, annotation, ingestion, and processing.
- Read and collate complex data sets, creating and maintaining data pipelines.
- Continuously focus on process improvement to drive efficiency and productivity.
- Utilize Python, SQL, and relevant tools to build optimal infrastructure for data processing.
- Provide insights into key business performance metrics through analytical tools.
- Support wider business data needs as required.
- Comply with all relevant policies and procedures related to Quality, Health, Safety, Environment, and Governance.
Qualifications Requirements:
- Bachelor's degree in Computer Engineering, Computer Science, or Electrical Engineering and Computer Sciences.
- 6+ years of programming experience with strong coding skills in Python, Shell, and Java.
- Experience with web crawling, data cleaning, Spark jobs, Spark SQL, and Postgres.
- Proficient in containerization technologies (Docker) and orchestration tools (Kubernetes).
- Familiar with real-time data processing tools (Apache Kafka, Apache Flink) and data orchestration tools (Apache Airflow, Apache NiFi).
- Comprehensive understanding of Elasticsearch and data platform concepts (data lake, data warehouse, ETL, ELT).
- Strong analytical and problem-solving skills.
- Knowledge of machine learning and data mining techniques is a plus.
What We Look For:
We seek a performance-driven individual with an agile mindset who can adapt to ambiguity, build collaborations, and create customer-centric solutions. A passion for innovation and exploration in the AI space is essential.
What Working At Presight Offers:
- Culture: An open, diverse, and inclusive environment promoting personal growth and innovation.
- Career: Opportunities for learning and growth through structured training programs and high-tech projects.
- Rewards: Competitive remuneration package along with healthcare and leave benefits.
