Data Engineer (Cloud Data Platform & AI)

About the Role

We are partnering with a leading public sector organisation to hire a Data Engineer to support the design, development, and optimisation of enterprise-scale cloud data platforms.

This role offers the opportunity to work on modern Data & AI platforms, designing scalable data architectures, building high-performance data pipelines, and enabling advanced analytics and AI capabilities. You'll collaborate with cross-functional teams to deliver cloud-native data solutions that support business intelligence, machine learning, and data-driven decision-making.

If you enjoy solving complex data engineering challenges and working with cloud technologies, this is an excellent opportunity to contribute to large-scale digital transformation initiatives.

Key Responsibilities

Data Architecture & Platform Engineering

• Design and implement scalable, secure, and highly available cloud-based data architectures.
• Develop and maintain enterprise Data Lakehouse solutions to support analytics and AI workloads.
• Collaborate with business and technical stakeholders to gather requirements and translate them into scalable technical solutions.
• Develop architectural documentation and technical specifications for enterprise data platforms.

Data Pipeline Development

• Design, build, and maintain robust ETL/ELT data pipelines using modern data engineering frameworks.
• Optimise data processing workflows for scalability, reliability, and cost efficiency.
• Implement automated data quality validation, monitoring, and alerting mechanisms.
• Ensure data integrity and operational excellence across production environments.

Cloud Data & AI Solutions

• Design and implement cloud-native Data & AI solutions aligned with business and technical objectives.
• Support cloud migration initiatives and modernisation of enterprise data platforms.
• Integrate AI and machine learning capabilities into enterprise data architectures.
• Evaluate emerging technologies and recommend modern cloud-native solutions.

Cloud Infrastructure & Operations

• Build and manage cloud-based data infrastructure using cloud-native services.
• Implement Infrastructure-as-Code (IaC) using Terraform.
• Ensure compliance with cloud security, governance, and data protection standards.
• Support platform monitoring, optimisation, and operational excellence.

Technical Leadership

• Provide technical guidance and mentorship to junior engineers.
• Participate in architecture reviews and contribute to technology roadmaps and best practices.
• Collaborate closely with solution architects, developers, data scientists, and business stakeholders to deliver enterprise data solutions.

Requirements

Essential Skills & Experience

• Bachelor's Degree in Computer Science, Information Technology, Computer Engineering, or a related discipline.
• Minimum 3 years of experience in Data Engineering, Data Platform Engineering, or Data Architecture.
• Proven experience designing and implementing production-scale data pipelines and cloud-based data platforms.
• Strong understanding of:Data Lakehouse architectureDataOps principlesCloud-native architecturesDistributed systemsInfrastructure-as-Code (IaC)Microservices architectureCloud security and Identity & Access Management (IAM)
• Strong hands-on experience with:SQLPythonApache Spark
• Experience with data orchestration and streaming technologies such as:Apache KafkaApache AirflowSimilar workflow orchestration tools
• Ability to translate business requirements into scalable technical solutions.
• Strong communication and stakeholder management skills.

All information will be kept strictly confidential. Only shortlisted candidates will be contacted.

TALENT PULSE PTE. LTD.
EA License No: 25S2956