Data Engineer (PySpark)

Responsibilities

• Analyze existing Talend ETL jobs and design equivalent Spark-based pipelines.
• Migrate and optimize data workflows from Talend to Spark (PySpark/Scala).
• Collaborate with data architects to define scalable data lake/lakehouse solutions.
• Developer for data-warehousing, ETL and BI projects in Informatica IDMC and Databricks.
• Responsible for all technical development work and support the leads on technical design and systems impact analysis.
• Integrate Spark pipelines with cloud platforms (AWS, Azure, GCP).
• Work with orchestration tools (Airflow, Databricks Jobs, etc.) to schedule and monitor workflows.

Skills/Requirement

• Degree in Computer Science, Information Technology, Computer Engineering or equivalent
• Minimum 5 years of experience in data engineering, with expertise in AWS or Azure services, Databricks, and/or Informatica IDMC.
• Understanding and hands on experience in all phases of project lifecycle & has implementation involvement in at least 4 project cycles.
• Solid understanding of data warehousing concepts and SQL.
• Familiarity with cloud services (AWS EMR, Azure Databricks, GCP DataProc).

Interested candidates, who wish to apply for the above position, please send in your resume to: ansari.abdulrahman@persolapac.com

PERSOL Singapore Pte Ltd EA License No. 01C4394 EA Reg No: R23118975 (ABDUL RAHMAN ANSARI RAJA)

We regret to inform you that only shortlisted candidates will be contacted.

**********************************

This is in partnership with Employment and Employability Institute Pte Ltd (“e2i”). e2i is the empowering network for workers and employers seeking employment and employability solutions. e2i serves as a bridge between workers and employers, connecting with workers to offer job security through job-matching, career guidance and skills upgrading services, and partnering employers to address their manpower needs through recruitment, training, and job redesign solutions. e2i is a tripartite initiative of the National Trades Union Congress set up to support nation-wide manpower and skills upgrading initiatives. By applying for this role, you consent to e2i’s PDPA.

By sending us your personal data and curriculum vitae (CV), you are deemed to consent to PERSOL Singapore Pte Ltd and its affiliates to collect, use and disclose your personal data for the purposes set out in the Privacy Policy available at https://www.persol.com.sg/policies. You acknowledge that you have read, understood, and agree with the Privacy Policy.

**********************************